Search results

Default judge model uses deprecated Claude Sonnet 4 — should be updated

Status: Open.

#200 In strands-agents/evals;

· harshitpassi opened on Apr 16, 2026

[BUG] run_evaluations_async returns results in completion order, not input order

bugSomething isn't workingSomething isn't working

Status: Open.

#198 In strands-agents/evals;

· GengisAWS opened on Apr 13, 2026

feat(experiment): ExperimentTrendAnalyzer — cross-run overall_score regression detection

Status: Open.

#186 In strands-agents/evals;

· nanookclaw opened on Apr 3, 2026

[FEATURE] Built-in red teaming support

enhancementNew feature or requestNew feature or request

Status: Open.

#177 In strands-agents/evals;

· kevmyung opened on Mar 24, 2026

[BUG] Langfuse tests fail on Python 3.14 — langfuse SDK uses pydantic v1 internals incompatible with 3.14

Status: Open.

#171 In strands-agents/evals;

· afarntrog opened on Mar 20, 2026

[FEATURE] Pre/post call hooks on ToolSimulator for fault injection and response modification

enhancementNew feature or requestNew feature or request

Status: Open.

#167 In strands-agents/evals;

· kaghatim opened on Mar 18, 2026

[Experiment] Evals - Coding agent evaluation and iteration

enhancementNew feature or requestNew feature or request

Status: Open.

#152 In strands-agents/evals;

· poshinchen opened on Mar 3, 2026

[FEATURE] Extend TraceProvider

enhancementNew feature or requestNew feature or request

Status: Open.

#143 In strands-agents/evals;

· afarntrog opened on Feb 20, 2026

[FEATURE] Parse ground_truth results into evaluator's system prompt

enhancementNew feature or requestNew feature or request

Status: Open.

#129 In strands-agents/evals;

· poshinchen opened on Feb 9, 2026

[EPIC] Image - Multi-Modal Quality Evaluation and Generation

enhancementNew feature or requestNew feature or request

Status: Open.

#128 In strands-agents/evals;

· poshinchen opened on Feb 9, 2026

[EPIC] Document - Multi-Modal Quality Evaluation and Generation

enhancementNew feature or requestNew feature or request

Status: Open.

#127 In strands-agents/evals;

· poshinchen opened on Feb 9, 2026

[FEATURE] Add integration tests for all evaluators

enhancementNew feature or requestNew feature or request

Status: Open.

#121 In strands-agents/evals;

· poshinchen opened on Feb 5, 2026