Skip to content

Test sarahchen6/use-analyzer branch of apm-sdks-benchmarks#11481

Draft
sarahchen6 wants to merge 1 commit into
masterfrom
sarahchen6/test-bp-analyzer-change
Draft

Test sarahchen6/use-analyzer branch of apm-sdks-benchmarks#11481
sarahchen6 wants to merge 1 commit into
masterfrom
sarahchen6/test-bp-analyzer-change

Conversation

@sarahchen6
Copy link
Copy Markdown
Contributor

@sarahchen6 sarahchen6 commented May 27, 2026 •
edited
Loading

What Does This Do

Test changes made in https://github.com/DataDog/apm-sdks-benchmarks/pull/160.

Motivation

This PR is never intended to be merged.

Additional Notes

Contributor Checklist

  • Format the title according to the contribution guidelines
  • Assign the type: and (comp: or inst:) labels in addition to any other useful labels
  • Avoid using close, fix, or any linking keywords when referencing an issue
    Use solves instead, and assign the PR milestone to the issue
  • Update the CODEOWNERS file on source file addition, migration, or deletion
  • Update public documentation with any new configuration flags or behaviors
  • Add your completed PR to the merge queue by commenting /merge. You can also:
    • Customize the commit message associated with the merge with /merge --commit-message "..."
    • Remove your PR from the merge queue with /merge -c
    • Skip all merge queue checks with /merge -f --reason "reason"; please use this judiciously, as some checks do not run at the PR-level
    • Get more information in this doc

Jira ticket: [PROJ-IDENT]

@sarahchen6 sarahchen6 added the tag: do not merge Do not merge changes label May 27, 2026
@datadog-datadog-prod-us1-2

This comment has been minimized.

Sign in to view
@sarahchen6 sarahchen6 force-pushed the sarahchen6/test-bp-analyzer-change branch from 7423620 to 2182e2d Compare May 28, 2026 17:51
@DataDog DataDog deleted a comment from dd-octo-sts Bot May 28, 2026
@sarahchen6 sarahchen6 force-pushed the sarahchen6/test-bp-analyzer-change branch from 82103b8 to 2182e2d Compare May 28, 2026 20:27
@sarahchen6 sarahchen6 force-pushed the sarahchen6/test-bp-analyzer-change branch from 2182e2d to f9a1fb8 Compare May 28, 2026 20:35
@DataDog DataDog deleted a comment from dd-octo-sts Bot May 28, 2026
@dd-octo-sts
Copy link
Copy Markdown
Contributor

dd-octo-sts Bot commented May 28, 2026 •
edited
Loading

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite Status
Startup 🟢 pass
Load 🟢 pass
DaCapo 🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results
Scenario Variant Metric Candidate master Δ (95% CI of mean)
dacapo:biojava:tracing datadog execution_time 14.51 s 14.44 s [-0.6%; +1.5%] (no difference)
dacapo:tomcat:tracing datadog execution_time 1.65 ms 1.66 ms [-1.6%; +1.1%] (no difference)
startup:insecure-bank:iast:Agent datadog execution_time 14.80 s 14.73 s [-0.8%; +1.7%] (no difference)
startup:insecure-bank:tracing:Agent datadog execution_time 13.69 s 13.72 s [-1.9%; +1.4%] (no difference)
webserver--insecure-bank--tracing--high_load load agg_http_req_duration_p50 828.30 µs 791.25 µs [+0.8%; +8.5%] (maybe worse)
startup:petclinic:appsec:Agent datadog execution_time 16.68 s 16.55 s [-0.7%; +2.2%] (no difference)
startup:petclinic:iast:Agent datadog execution_time 16.63 s 15.63 s [-2.4%; +15.1%] (unstable)
startup:petclinic:profiling:Agent datadog execution_time 16.52 s 16.43 s [-0.7%; +1.7%] (no difference)
startup:petclinic:tracing:Agent datadog execution_time 15.82 s 15.93 s [-1.7%; +0.4%] (no difference)
webserver--spring-petclinic--tracing--high_load load agg_http_req_duration_p50 24.31 ms 23.99 ms [-4.3%; +7.0%] (unstable)

Commit: f9a1fb83 · CI Pipeline · Benchmarking Platform UI

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

tag: do not merge Do not merge changes

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@sarahchen6