Skip to content

Improve outcome intent attribution#39718

Merged
mnkiefer merged 12 commits into
mainfrom
improve-outcome-resolver
Jun 17, 2026
Merged

Improve outcome intent attribution#39718
mnkiefer merged 12 commits into
mainfrom
improve-outcome-resolver

Conversation

@mnkiefer

Copy link
Copy Markdown
Collaborator
  • Replaces ad hoc outcome root tracing with a dedicated intent resolver.
  • Adds attribution status and source to outcome reports, keeps direct label fallback for clearly attributable items, and marks PRs with multiple closing issues as ambiguous instead of choosing one implicitly.
  • Adds coverage for the new resolver behavior and replaces the older objective-mapping spec with an intent-attribution/governance spec.

Copilot AI review requested due to automatic review settings June 17, 2026 02:56
@mnkiefer

Copy link
Copy Markdown
Collaborator Author

@copilot resolve the merge conflicts in this pull request

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR introduces a dedicated intent resolver for outcome attribution, replacing ad hoc PR root tracing and enriching outcome reports with explicit attribution status/source while avoiding implicit selection when multiple closing issues exist.

Changes:

  • Added a new pkg/intent resolver that deterministically classifies attribution (mapped/unmapped/unlinked/ambiguous) and records the attribution source.
  • Updated outcome evaluation to use the intent resolver, populate attribution_status / attribution_source, and treat multiple closing issues as ambiguous (no implicit “first issue wins”).
  • Replaced the prior objective-mapping/portfolio-reporting spec with a new intent-attribution & governance specification and added/updated tests accordingly.
Show a summary per file
File Description
specs/objective-mapping-portfolio-reporting.md Removed superseded objective-mapping/portfolio-reporting spec document.
specs/intent-attribution-agent-governance.md Added new intent attribution + agent governance specification (replacing the old spec).
pkg/workflow/action_resolver.go Minor formatting cleanup in ResolveGhAwRef error handling block.
pkg/intent/resolver.go Added new intent resolver types and deterministic PR/issue attribution resolution.
pkg/intent/resolver_test.go Added unit tests for resolver behavior (mapped/unmapped/unlinked/ambiguous + fallbacks).
pkg/cli/outcome_eval.go Switched objective enrichment to intent-based attribution; added status/source fields to reports.
pkg/cli/outcome_eval_test.go Updated/added tests for intent attribution behavior, including ambiguous multi-closing-issue case.
actions/setup/js/assign_agent_helpers.test.cjs Formatting-only change for the dynamic import statement.

Copilot's findings

Tip

Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

  • Files reviewed: 7/8 changed files
  • Comments generated: 3

Comment thread specs/intent-attribution-agent-governance.md Outdated
Comment thread pkg/intent/resolver.go
Comment thread pkg/cli/outcome_eval.go
mnkiefer and others added 7 commits June 17, 2026 05:03
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
# Conflicts:
#	specs/objective-mapping-portfolio-reporting.md

Co-authored-by: mnkiefer <8320933+mnkiefer@users.noreply.github.com>
Co-authored-by: mnkiefer <8320933+mnkiefer@users.noreply.github.com>
…mprove-outcome-resolver

Co-authored-by: mnkiefer <8320933+mnkiefer@users.noreply.github.com>
…tifact"

Co-authored-by: mnkiefer <8320933+mnkiefer@users.noreply.github.com>

Copilot AI commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

@copilot resolve the merge conflicts in this pull request

Merge conflicts resolved. The only conflict was specs/objective-mapping-portfolio-reporting.md (deleted in this branch, modified in main) — kept the deletion since this PR intentionally replaces it with the new intent-attribution spec. Also fixed a stale test assertion in TestResolverResolveIssueMapped that still expected RootType == "artifact" after the resolver was updated to correctly return "issue".

@mnkiefer

Copy link
Copy Markdown
Collaborator Author

@copilot Revert changes to .github/workflows/smoke-copilot-aoai-entra.lock.yml.

Agent-Logs-Url: https://github.com/github/gh-aw/sessions/145b93b5-a658-47fb-bd00-703e7adace08

Co-authored-by: mnkiefer <8320933+mnkiefer@users.noreply.github.com>
@mnkiefer

Copy link
Copy Markdown
Collaborator Author

@copilot Recompile workflows

@github-actions

Copy link
Copy Markdown
Contributor

✅ smoke-ci: safeoutputs CLI comment + comment-memory run (27664528235)

Generated by 🧪 Smoke CI for issue #39718 ·

@github-actions

Copy link
Copy Markdown
Contributor

Comment Memory

CI lights the path
Green checks bloom at dawn
Quiet bots still sing

Note

This comment is managed by comment memory.

It stores persistent context for this thread in the code block at the top of this comment.
Edit only the text inside the backtick fences; workflow metadata and the footer are regenerated automatically.

Learn more about comment memory

Generated by 🧪 Smoke CI for issue #39718 ·

@mnkiefer mnkiefer merged commit 040d31a into main Jun 17, 2026
29 checks passed
@mnkiefer mnkiefer deleted the improve-outcome-resolver branch June 17, 2026 03:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants