Skip to content

Test apm-sdks-benchmarks 227 and 230 - #12152

Draft
sarahchen6 wants to merge 5 commits into
masterfrom
sarahchen6/test-benchmark-master-fallback
Draft

Test apm-sdks-benchmarks 227 and 230#12152
sarahchen6 wants to merge 5 commits into
masterfrom
sarahchen6/test-benchmark-master-fallback

Conversation

@sarahchen6

@sarahchen6 sarahchen6 commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

What Does This Do

Test https://github.com/DataDog/apm-sdks-benchmarks/pull/227 on startup benchmarks

Test https://github.com/DataDog/apm-sdks-benchmarks/pull/230 on startup benchmarks

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@sarahchen6 sarahchen6 added the tag: do not merge Do not merge changes label Aug 5, 2026
@datadog-prod-us1-6

datadog-prod-us1-6 Bot commented Aug 5, 2026

Copy link
Copy Markdown

🎯 Code Coverage (details)
Patch Coverage: 100.00%
Overall Coverage: 57.89% (-0.04%)

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 51ce604 | Docs | Datadog PR Page | Give us feedback!

@dd-octo-sts

dd-octo-sts Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite Status
Startup 🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results
Scenario Candidate master Δ (95% CI of mean)
startup:insecure-bank:iast:Agent 14.83 s 14.69 s [-0.0%; +2.0%] (no difference)
startup:insecure-bank:tracing:Agent 13.62 s 13.67 s [-1.3%; +0.5%] (no difference)
startup:petclinic:appsec:Agent 16.80 s 16.73 s [-0.4%; +1.2%] (no difference)
startup:petclinic:iast:Agent 16.45 s 16.92 s [-7.0%; +1.4%] (no difference)
startup:petclinic:profiling:Agent 16.72 s 16.81 s [-1.7%; +0.7%] (no difference)
startup:petclinic:sca:Agent 16.80 s 16.71 s [-0.5%; +1.5%] (no difference)
startup:petclinic:tracing:Agent 15.94 s 16.22 s [-2.9%; -0.6%] (maybe better)

Commit: 51ce604d · CI Pipeline · Benchmarking Platform UI


Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

@sarahchen6 sarahchen6 changed the title Test apm-sdks-benchmarks 227 Test apm-sdks-benchmarks 227 and 230 Aug 6, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: do not merge Do not merge changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant