Skip to content

Wire -Pjmh.includes and -PtestJvm into internal-api JMH config#11703

Open
dougqh wants to merge 1 commit into
masterfrom
dougqh/jmh-gradle-improvements
Open

Wire -Pjmh.includes and -PtestJvm into internal-api JMH config#11703
dougqh wants to merge 1 commit into
masterfrom
dougqh/jmh-gradle-improvements

Conversation

@dougqh

@dougqh dougqh commented Jun 22, 2026

Copy link
Copy Markdown
Contributor

What This Does

Wires two previously-ignored Gradle properties into the internal-api JMH configuration:

  • -Pjmh.includes=<pattern> — filters which benchmarks run. Previously silently ignored by the me.champeau.jmh plugin, requiring a full fat-jar build to run a single benchmark.
  • -PtestJvm=<version> — selects the JVM used for benchmark execution. Previously ignored, defaulting to whatever JVM the Gradle daemon happened to use.

Usage:

./gradlew :internal-api:jmh -Pjmh.includes=AtomicsBenchmark -PtestJvm=17

Motivation

Running a single benchmark without this fix required building the full fat-jar and invoking it manually. The JVM defaulted to the daemon JVM rather than the requested version, making results non-reproducible across machines.

Additional Notes

The same pattern applies to other modules that use me.champeau.jmh (there are ~10 others). This PR fixes internal-api where current benchmark development is happening; other modules can adopt the pattern as needed.

tag: no release note

🤖 Generated with Claude Code

Without this, -Pjmh.includes is silently ignored by the me.champeau.jmh
plugin, requiring a full fat-jar build to run a single benchmark.
-PtestJvm was also ignored for JMH execution, defaulting to the Gradle
daemon JVM regardless of the requested version.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@dougqh dougqh requested a review from a team as a code owner June 22, 2026 23:58
@dougqh dougqh requested a review from mhlidd June 22, 2026 23:58
@dd-octo-sts dd-octo-sts Bot added the tag: ai generated Largely based on code generated by an AI or LLM label Jun 22, 2026
@dd-octo-sts

dd-octo-sts Bot commented Jun 22, 2026

Copy link
Copy Markdown
Contributor

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@datadog-prod-us1-4

datadog-prod-us1-4 Bot commented Jun 22, 2026

Copy link
Copy Markdown

Pipelines

Fix all issues with BitsAI

⚠️ Warnings

🚦 9 Pipeline jobs failed

Check pull requests | Check pull requests   View in Datadog   GitHub Actions

DataDog/apm-reliability/dd-trace-java | test_inst_latest: [17, 1/6]   View in Datadog   GitLab

DataDog/apm-reliability/dd-trace-java | test_inst_latest: [21, 1/6]   View in Datadog   GitLab

View all 9 failed jobs.

Useful? React with 👍 / 👎

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 912e1c6 | Docs | Datadog PR Page | Give us feedback!

@dd-octo-sts

dd-octo-sts Bot commented Jun 23, 2026

Copy link
Copy Markdown
Contributor

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite Status
Startup 🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results
Scenario Candidate master Δ (95% CI of mean)
startup:insecure-bank:iast:Agent 14.02 s 13.93 s [-0.2%; +1.4%] (no difference)
startup:insecure-bank:tracing:Agent 12.90 s 12.95 s [-1.1%; +0.2%] (no difference)
startup:petclinic:appsec:Agent 16.93 s 16.75 s [+0.3%; +1.8%] (maybe worse)
startup:petclinic:iast:Agent 17.01 s 16.98 s [-0.8%; +1.1%] (no difference)
startup:petclinic:profiling:Agent 16.89 s 16.98 s [-1.9%; +0.8%] (no difference)
startup:petclinic:sca:Agent 16.87 s 16.88 s [-1.0%; +0.8%] (no difference)
startup:petclinic:tracing:Agent 16.10 s 16.21 s [-1.9%; +0.4%] (no difference)

Commit: 912e1c6b · CI Pipeline · Benchmarking Platform UI


Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: ai generated Largely based on code generated by an AI or LLM

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant