Skip to content

Refine AGENTS.md guidance on regression coverage and code comments - #30263

Open
AlexWaygood wants to merge 1 commit into
mainfrom
alex/refine-agents-regression-guidance
Open

AlexWaygood wants to merge 1 commit into
mainfrom
alex/refine-agents-regression-guidance

Conversation

@AlexWaygood

@AlexWaygood AlexWaygood commented Nov 10, 2026 •

Copy link
Copy Markdown
Member

Summary

  • Recommend microbenchmarks for regression coverage of hangs and pathological slowdowns. Agents keep trying to add mdtest coverage for these issues, which is very bad UX for humans running tests (you can't tell which test is hanging if the test "fails") and for agents, which often don't notice that the test suite has been running for 10 minutes and that this likely indicates that there's a problem.
  • Drop the blanket reminders to test every significant change and get tests passing. Frontier models these days are, if anything, pretty over-eager in adding exhaustive regression coverage. I feel like these reminders are probably working against us these days, and may be causing agents to add redundant/unnecessary tests in lots of cases.
  • Soften the language regarding comments. Most developers on Ruff/ty are using codex these days, which (I would argue) generally writes too few comments. That bullet was written at a time when most devs on Ruff/ty were using Claude, which often wrote very fatuous comments.

@AlexWaygood AlexWaygood added the internal An internal refactor or improvement (not for changelogs) label Nov 10, 2026
@AlexWaygood
AlexWaygood requested a review from carljm November 10, 2026 13:40

This branch was successfully deployed

1 active deployment
automations — e9e7b3f6 Deployed Nov 10, 2026 by AlexWaygood via security-review / security review #97988
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

internal An internal refactor or improvement (not for changelogs)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant