Skip to content

Add operational value and dashboarding for software development practices - #516

Merged
pelikhan merged 2 commits into
mainfrom
copilot/add-operational-value-dashboarding
Sep 2, 2026
Merged

Add operational value and dashboarding for software development practices#516
pelikhan merged 2 commits into
mainfrom
copilot/add-operational-value-dashboarding

Conversation

Copilot AI commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

Adds measurable operational outcomes and dashboard visibility to the Software Development Practices Advisor’s GitHub Well-Architected and NIST SSDF workers.

  • Operational value

    • Registers attainment-only evaluators for both workers.
    • Binds observations to framework, target repository, and assessed commit.
    • Scores explicit non-bot human acceptance within the 30-day evidence window.
  • Evidence contract

    • Adds machine-readable markers to guidance issues:
      <!-- operational-value: framework=nist-ssdf target=OWNER/REPO target-sha=40_HEX_SHA -->
    • Preserves framework provenance, maturity, evidence cutoff, and missing-evidence diagnostics.
  • Dashboard

    • Adds package-scoped views for workflow conclusions, guidance outcomes, accepted evidence, and framework-separated attainment trends.
    • Keeps operational value distinct from causation, certification, security, or conformance claims.
  • Distribution

    • Packages the dashboard, evaluator runtime, and grader sources.
    • Updates clean-install contracts and package documentation.

Copilot AI and others added 2 commits September 2, 2026 01:29
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Validator Summary

Check Status
test_unit pass
test_integration pass
test_load pass
docs_build pass
compile (agentic-workflows compile) fail

Compile failures affecting this PR's workflows

Both software-development-practices-github-well-architected.md and software-development-practices-nist-ssdf.md (added/modified in this PR) fail agentic-workflows compile:

.github/workflows/software-development-practices-github-well-architected.md:1:1: error: graders.operational-value.run ".github/graders/software-development-practices-github-well-architected-operational-value.sh" has invalid Bash syntax: exec: "bash" executable file not found in $PATH
.github/workflows/software-development-practices-nist-ssdf.md:1:1: error: graders.operational-value.run ".github/graders/software-development-practices-nist-ssdf-operational-value.sh" has invalid Bash syntax: exec: "bash" executable file not found in $PATH

Note: several other pre-existing workflows in the repo (not modified by this PR) show the same "bash not found in $PATH" compilation error, suggesting the compiler's grader Bash-syntax check may run in an environment where bash is not resolvable via PATH (even though /usr/bin/bash exists on this runner and the grader scripts execute correctly when invoked directly). This may be an environment/tooling issue rather than a defect in the grader script content itself, but it currently blocks agentic-workflows compile from validating these two new workflows, so I am flagging it as a compile failure per the validation contract.

All other compiled workflows (37 of 39) passed without errors; only manifest warning noted was "Using experimental feature: config" for aw.yml (pre-existing, unrelated to this PR).

Result: REQUEST_CHANGES — compile validation failed for workflows added by this PR.

Generated by PR Reviewer / Agentic Workflow Validation for #516 · copilot · auto · 30.4 AIC · ⌖ 4.53 AIC · ⊞ 6.7K

@pelikhan
pelikhan merged commit 59f4db8 into main Sep 2, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants