Skip to content

mark Exception replay smoke test flaky#10005

Merged
jpbempel merged 1 commit into
masterfrom
jpbempel/mark-smoke-tests
Nov 20, 2025
Merged

mark Exception replay smoke test flaky#10005
jpbempel merged 1 commit into
masterfrom
jpbempel/mark-smoke-tests

Conversation

@jpbempel

@jpbempel jpbempel commented Nov 20, 2025

Copy link
Copy Markdown
Member

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@jpbempel jpbempel requested a review from a team as a code owner November 20, 2025 14:52
@jpbempel jpbempel requested review from evanchooly and removed request for a team November 20, 2025 14:52
@jpbempel jpbempel added comp: debugger Dynamic Instrumentation type: bug Bug report and fix tag: no release notes Changes to exclude from release notes labels Nov 20, 2025
@pr-commenter

pr-commenter Bot commented Nov 20, 2025

Copy link
Copy Markdown

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/mark-smoke-tests
git_commit_date 1763637994 1763650110
git_commit_sha c05874d f27cea1
release_version 1.56.0~c05874d84e 1.57.0-SNAPSHOT~f27cea1649
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763652076 1763652076
ci_job_id 1247794562 1247794562
ci_pipeline_id 83372110 83372110
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-dt4sut2o 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-dt4sut2o 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 6 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~f27cea1649, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.113 s) : 0, 1113083
Total [baseline] (10.917 s) : 0, 10917361
Agent [candidate] (1.104 s) : 0, 1103798
Total [candidate] (10.789 s) : 0, 10789294
section appsec
Agent [baseline] (1.286 s) : 0, 1285565
Total [baseline] (11.098 s) : 0, 11098470
Agent [candidate] (1.282 s) : 0, 1281910
Total [candidate] (11.161 s) : 0, 11161146
section iast
Agent [baseline] (1.252 s) : 0, 1252120
Total [baseline] (11.321 s) : 0, 11321088
Agent [candidate] (1.241 s) : 0, 1241483
Total [candidate] (11.293 s) : 0, 11293015
section profiling
Agent [baseline] (1.236 s) : 0, 1235925
Total [baseline] (11.129 s) : 0, 11129484
Agent [candidate] (1.246 s) : 0, 1246159
Total [candidate] (11.182 s) : 0, 11182268
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.113 s -
Agent appsec 1.286 s 172.482 ms (15.5%)
Agent iast 1.252 s 139.037 ms (12.5%)
Agent profiling 1.236 s 122.842 ms (11.0%)
Total tracing 10.917 s -
Total appsec 11.098 s 181.109 ms (1.7%)
Total iast 11.321 s 403.726 ms (3.7%)
Total profiling 11.129 s 212.123 ms (1.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.104 s -
Agent appsec 1.282 s 178.112 ms (16.1%)
Agent iast 1.241 s 137.685 ms (12.5%)
Agent profiling 1.246 s 142.361 ms (12.9%)
Total tracing 10.789 s -
Total appsec 11.161 s 371.852 ms (3.4%)
Total iast 11.293 s 503.721 ms (4.7%)
Total profiling 11.182 s 392.975 ms (3.6%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~f27cea1649, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.465 ms) : 0, 1465
crashtracking [candidate] (1.436 ms) : 0, 1436
BytebuddyAgent [baseline] (715.821 ms) : 0, 715821
BytebuddyAgent [candidate] (709.53 ms) : 0, 709530
GlobalTracer [baseline] (251.18 ms) : 0, 251180
GlobalTracer [candidate] (249.356 ms) : 0, 249356
AppSec [baseline] (32.349 ms) : 0, 32349
AppSec [candidate] (32.171 ms) : 0, 32171
Debugger [baseline] (64.333 ms) : 0, 64333
Debugger [candidate] (63.843 ms) : 0, 63843
Remote Config [baseline] (627.952 µs) : 0, 628
Remote Config [candidate] (634.291 µs) : 0, 634
Telemetry [baseline] (8.37 ms) : 0, 8370
Telemetry [candidate] (8.267 ms) : 0, 8267
Flare Poller [baseline] (3.793 ms) : 0, 3793
Flare Poller [candidate] (3.696 ms) : 0, 3696
section appsec
crashtracking [baseline] (1.449 ms) : 0, 1449
crashtracking [candidate] (1.444 ms) : 0, 1444
BytebuddyAgent [baseline] (734.093 ms) : 0, 734093
BytebuddyAgent [candidate] (732.693 ms) : 0, 732693
GlobalTracer [baseline] (241.582 ms) : 0, 241582
GlobalTracer [candidate] (240.523 ms) : 0, 240523
AppSec [baseline] (174.725 ms) : 0, 174725
AppSec [candidate] (173.658 ms) : 0, 173658
Debugger [baseline] (61.144 ms) : 0, 61144
Debugger [candidate] (61.204 ms) : 0, 61204
Remote Config [baseline] (671.207 µs) : 0, 671
Remote Config [candidate] (660.381 µs) : 0, 660
Telemetry [baseline] (8.152 ms) : 0, 8152
Telemetry [candidate] (8.13 ms) : 0, 8130
Flare Poller [baseline] (3.86 ms) : 0, 3860
Flare Poller [candidate] (3.903 ms) : 0, 3903
IAST [baseline] (24.882 ms) : 0, 24882
IAST [candidate] (24.755 ms) : 0, 24755
section iast
crashtracking [baseline] (1.468 ms) : 0, 1468
crashtracking [candidate] (1.444 ms) : 0, 1444
BytebuddyAgent [baseline] (841.193 ms) : 0, 841193
BytebuddyAgent [candidate] (832.913 ms) : 0, 832913
GlobalTracer [baseline] (239.579 ms) : 0, 239579
GlobalTracer [candidate] (238.244 ms) : 0, 238244
AppSec [baseline] (34.207 ms) : 0, 34207
AppSec [candidate] (32.051 ms) : 0, 32051
Debugger [baseline] (61.183 ms) : 0, 61183
Debugger [candidate] (60.926 ms) : 0, 60926
Remote Config [baseline] (542.807 µs) : 0, 543
Remote Config [candidate] (528.75 µs) : 0, 529
Telemetry [baseline] (7.707 ms) : 0, 7707
Telemetry [candidate] (7.689 ms) : 0, 7689
Flare Poller [baseline] (3.568 ms) : 0, 3568
Flare Poller [candidate] (3.59 ms) : 0, 3590
IAST [baseline] (27.529 ms) : 0, 27529
IAST [candidate] (29.153 ms) : 0, 29153
section profiling
ProfilingAgent [baseline] (97.441 ms) : 0, 97441
ProfilingAgent [candidate] (98.263 ms) : 0, 98263
crashtracking [baseline] (1.429 ms) : 0, 1429
crashtracking [candidate] (1.438 ms) : 0, 1438
BytebuddyAgent [baseline] (736.018 ms) : 0, 736018
BytebuddyAgent [candidate] (742.464 ms) : 0, 742464
GlobalTracer [baseline] (223.153 ms) : 0, 223153
GlobalTracer [candidate] (224.771 ms) : 0, 224771
AppSec [baseline] (32.399 ms) : 0, 32399
AppSec [candidate] (32.74 ms) : 0, 32740
Debugger [baseline] (63.354 ms) : 0, 63354
Debugger [candidate] (63.699 ms) : 0, 63699
Remote Config [baseline] (646.358 µs) : 0, 646
Remote Config [candidate] (664.549 µs) : 0, 665
Telemetry [baseline] (7.92 ms) : 0, 7920
Telemetry [candidate] (8.102 ms) : 0, 8102
Flare Poller [baseline] (3.81 ms) : 0, 3810
Flare Poller [candidate] (3.885 ms) : 0, 3885
Profiling [baseline] (98.025 ms) : 0, 98025
Profiling [candidate] (98.856 ms) : 0, 98856
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~f27cea1649, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.1 s) : 0, 1100219
Total [baseline] (8.865 s) : 0, 8864603
Agent [candidate] (1.119 s) : 0, 1118627
Total [candidate] (8.887 s) : 0, 8887127
section iast
Agent [baseline] (1.247 s) : 0, 1246860
Total [baseline] (9.634 s) : 0, 9633800
Agent [candidate] (1.261 s) : 0, 1261376
Total [candidate] (9.561 s) : 0, 9561145
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.1 s -
Agent iast 1.247 s 146.641 ms (13.3%)
Total tracing 8.865 s -
Total iast 9.634 s 769.197 ms (8.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.119 s -
Agent iast 1.261 s 142.749 ms (12.8%)
Total tracing 8.887 s -
Total iast 9.561 s 674.018 ms (7.6%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~f27cea1649, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.472 ms) : 0, 1472
crashtracking [candidate] (1.487 ms) : 0, 1487
BytebuddyAgent [baseline] (707.993 ms) : 0, 707993
BytebuddyAgent [candidate] (720.294 ms) : 0, 720294
GlobalTracer [baseline] (248.545 ms) : 0, 248545
GlobalTracer [candidate] (253.034 ms) : 0, 253034
AppSec [baseline] (31.974 ms) : 0, 31974
AppSec [candidate] (32.495 ms) : 0, 32495
Debugger [baseline] (62.899 ms) : 0, 62899
Debugger [candidate] (63.381 ms) : 0, 63381
Remote Config [baseline] (614.258 µs) : 0, 614
Remote Config [candidate] (625.301 µs) : 0, 625
Telemetry [baseline] (8.076 ms) : 0, 8076
Telemetry [candidate] (8.318 ms) : 0, 8318
Flare Poller [baseline] (3.657 ms) : 0, 3657
Flare Poller [candidate] (3.746 ms) : 0, 3746
section iast
crashtracking [baseline] (1.466 ms) : 0, 1466
crashtracking [candidate] (1.48 ms) : 0, 1480
BytebuddyAgent [baseline] (838.246 ms) : 0, 838246
BytebuddyAgent [candidate] (850.291 ms) : 0, 850291
GlobalTracer [baseline] (238.296 ms) : 0, 238296
GlobalTracer [candidate] (239.694 ms) : 0, 239694
IAST [baseline] (29.785 ms) : 0, 29785
IAST [candidate] (31.451 ms) : 0, 31451
AppSec [baseline] (32.205 ms) : 0, 32205
AppSec [candidate] (30.824 ms) : 0, 30824
Debugger [baseline] (60.088 ms) : 0, 60088
Debugger [candidate] (60.521 ms) : 0, 60521
Remote Config [baseline] (540.938 µs) : 0, 541
Remote Config [candidate] (546.441 µs) : 0, 546
Telemetry [baseline] (7.624 ms) : 0, 7624
Telemetry [candidate] (7.696 ms) : 0, 7696
Flare Poller [baseline] (3.446 ms) : 0, 3446
Flare Poller [candidate] (3.585 ms) : 0, 3585
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/mark-smoke-tests
git_commit_date 1763637994 1763650110
git_commit_sha c05874d f27cea1
release_version 1.56.0~c05874d84e 1.57.0-SNAPSHOT~f27cea1649
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763652562 1763652562
ci_job_id 1247794564 1247794564
ci_pipeline_id 83372110 83372110
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-eiszenkl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-eiszenkl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 4 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+138.489µs; +267.114µs] or [+4.884%; +9.420%]		 worse
[+244.495µs; +659.078µs] or [+3.075%; +8.288%]		 unstable
[-227.506op/s; +61.381op/s] or [-17.680%; +4.770%]		 3.038ms 8.404ms 1203.750op/s 2.836ms 7.952ms 1286.812op/s
scenario:load:insecure-bank:iast_FULL:high_load worse
[+122.189µs; +410.902µs] or [+2.424%; +8.153%]		 unsure
[+172.998µs; +871.979µs] or [+1.438%; +7.248%]		 unstable
[-126.407op/s; +51.782op/s] or [-15.573%; +6.380%]		 5.307ms 12.554ms 774.375op/s 5.040ms 12.031ms 811.688op/s
scenario:load:petclinic:iast:high_load worse
[+467.944µs; +1408.017µs] or [+2.688%; +8.087%]		 unsure
[+0.445ms; +1.878ms] or [+1.552%; +6.544%]		 unstable
[-39.879op/s; +14.754op/s] or [-15.140%; +5.601%]		 18.349ms 29.853ms 250.844op/s 17.411ms 28.691ms 263.406op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~f27cea1649, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.131 ms) : 17939, 18323
.   : milestone, 18131,
appsec (18.942 ms) : 18751, 19133
.   : milestone, 18942,
code_origins (17.842 ms) : 17661, 18023
.   : milestone, 17842,
iast (17.714 ms) : 17537, 17892
.   : milestone, 17714,
profiling (18.599 ms) : 18414, 18784
.   : milestone, 18599,
tracing (17.678 ms) : 17502, 17853
.   : milestone, 17678,
section candidate
no_agent (19.208 ms) : 19010, 19405
.   : milestone, 19208,
appsec (18.461 ms) : 18273, 18649
.   : milestone, 18461,
code_origins (18.083 ms) : 17903, 18263
.   : milestone, 18083,
iast (18.605 ms) : 18416, 18794
.   : milestone, 18605,
profiling (19.056 ms) : 18858, 19254
.   : milestone, 19056,
tracing (17.518 ms) : 17343, 17693
.   : milestone, 17518,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.131 ms [17.939 ms, 18.323 ms] -
appsec 18.942 ms [18.751 ms, 19.133 ms] 810.914 µs (4.5%)
code_origins 17.842 ms [17.661 ms, 18.023 ms] -289.299 µs (-1.6%)
iast 17.714 ms [17.537 ms, 17.892 ms] -416.967 µs (-2.3%)
profiling 18.599 ms [18.414 ms, 18.784 ms] 467.791 µs (2.6%)
tracing 17.678 ms [17.502 ms, 17.853 ms] -453.822 µs (-2.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.208 ms [19.01 ms, 19.405 ms] -
appsec 18.461 ms [18.273 ms, 18.649 ms] -746.964 µs (-3.9%)
code_origins 18.083 ms [17.903 ms, 18.263 ms] -1.124 ms (-5.9%)
iast 18.605 ms [18.416 ms, 18.794 ms] -602.457 µs (-3.1%)
profiling 19.056 ms [18.858 ms, 19.254 ms] -151.24 µs (-0.8%)
tracing 17.518 ms [17.343 ms, 17.693 ms] -1.689 ms (-8.8%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~f27cea1649, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.217 ms) : 1205, 1229
.   : milestone, 1217,
iast (3.206 ms) : 3165, 3246
.   : milestone, 3206,
iast_FULL (5.695 ms) : 5639, 5751
.   : milestone, 5695,
iast_GLOBAL (3.562 ms) : 3516, 3608
.   : milestone, 3562,
profiling (1.982 ms) : 1964, 2000
.   : milestone, 1982,
tracing (1.791 ms) : 1776, 1806
.   : milestone, 1791,
section candidate
no_agent (1.211 ms) : 1199, 1223
.   : milestone, 1211,
iast (3.191 ms) : 3151, 3231
.   : milestone, 3191,
iast_FULL (5.97 ms) : 5909, 6030
.   : milestone, 5970,
iast_GLOBAL (3.813 ms) : 3751, 3875
.   : milestone, 3813,
profiling (2.094 ms) : 2075, 2113
.   : milestone, 2094,
tracing (1.859 ms) : 1844, 1875
.   : milestone, 1859,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.217 ms [1.205 ms, 1.229 ms] -
iast 3.206 ms [3.165 ms, 3.246 ms] 1.989 ms (163.5%)
iast_FULL 5.695 ms [5.639 ms, 5.751 ms] 4.478 ms (368.1%)
iast_GLOBAL 3.562 ms [3.516 ms, 3.608 ms] 2.345 ms (192.7%)
profiling 1.982 ms [1.964 ms, 2.0 ms] 765.221 µs (62.9%)
tracing 1.791 ms [1.776 ms, 1.806 ms] 574.382 µs (47.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.211 ms [1.199 ms, 1.223 ms] -
iast 3.191 ms [3.151 ms, 3.231 ms] 1.98 ms (163.5%)
iast_FULL 5.97 ms [5.909 ms, 6.03 ms] 4.759 ms (393.0%)
iast_GLOBAL 3.813 ms [3.751 ms, 3.875 ms] 2.602 ms (214.9%)
profiling 2.094 ms [2.075 ms, 2.113 ms] 882.839 µs (72.9%)
tracing 1.859 ms [1.844 ms, 1.875 ms] 648.642 µs (53.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/mark-smoke-tests
git_commit_date 1763637994 1763650110
git_commit_sha c05874d f27cea1
release_version 1.56.0~c05874d84e 1.57.0-SNAPSHOT~f27cea1649
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1763652256 1763652256
ci_job_id 1247794566 1247794566
ci_pipeline_id 83372110 83372110
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-lukvbqrr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-lukvbqrr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~f27cea1649, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.482 ms) : 1471, 1494
.   : milestone, 1482,
appsec (3.664 ms) : 3449, 3879
.   : milestone, 3664,
iast (2.242 ms) : 2177, 2306
.   : milestone, 2242,
iast_GLOBAL (2.274 ms) : 2209, 2340
.   : milestone, 2274,
profiling (2.097 ms) : 2044, 2151
.   : milestone, 2097,
tracing (2.065 ms) : 2014, 2117
.   : milestone, 2065,
section candidate
no_agent (1.489 ms) : 1477, 1500
.   : milestone, 1489,
appsec (3.724 ms) : 3502, 3945
.   : milestone, 3724,
iast (2.231 ms) : 2166, 2297
.   : milestone, 2231,
iast_GLOBAL (2.281 ms) : 2215, 2347
.   : milestone, 2281,
profiling (2.092 ms) : 2038, 2147
.   : milestone, 2092,
tracing (2.065 ms) : 2014, 2116
.   : milestone, 2065,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.471 ms, 1.494 ms] -
appsec 3.664 ms [3.449 ms, 3.879 ms] 2.182 ms (147.2%)
iast 2.242 ms [2.177 ms, 2.306 ms] 759.22 µs (51.2%)
iast_GLOBAL 2.274 ms [2.209 ms, 2.34 ms] 791.744 µs (53.4%)
profiling 2.097 ms [2.044 ms, 2.151 ms] 615.138 µs (41.5%)
tracing 2.065 ms [2.014 ms, 2.117 ms] 582.858 µs (39.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.489 ms [1.477 ms, 1.5 ms] -
appsec 3.724 ms [3.502 ms, 3.945 ms] 2.235 ms (150.1%)
iast 2.231 ms [2.166 ms, 2.297 ms] 742.621 µs (49.9%)
iast_GLOBAL 2.281 ms [2.215 ms, 2.347 ms] 792.01 µs (53.2%)
profiling 2.092 ms [2.038 ms, 2.147 ms] 603.394 µs (40.5%)
tracing 2.065 ms [2.014 ms, 2.116 ms] 576.244 µs (38.7%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~f27cea1649, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.01 s) : 15010000, 15010000
.   : milestone, 15010000,
appsec (14.729 s) : 14729000, 14729000
.   : milestone, 14729000,
iast (18.418 s) : 18418000, 18418000
.   : milestone, 18418000,
iast_GLOBAL (18.077 s) : 18077000, 18077000
.   : milestone, 18077000,
profiling (14.745 s) : 14745000, 14745000
.   : milestone, 14745000,
tracing (14.812 s) : 14812000, 14812000
.   : milestone, 14812000,
section candidate
no_agent (15.357 s) : 15357000, 15357000
.   : milestone, 15357000,
appsec (14.575 s) : 14575000, 14575000
.   : milestone, 14575000,
iast (18.086 s) : 18086000, 18086000
.   : milestone, 18086000,
iast_GLOBAL (18.157 s) : 18157000, 18157000
.   : milestone, 18157000,
profiling (14.711 s) : 14711000, 14711000
.   : milestone, 14711000,
tracing (14.976 s) : 14976000, 14976000
.   : milestone, 14976000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.01 s [15.01 s, 15.01 s] -
appsec 14.729 s [14.729 s, 14.729 s] -281.0 ms (-1.9%)
iast 18.418 s [18.418 s, 18.418 s] 3.408 s (22.7%)
iast_GLOBAL 18.077 s [18.077 s, 18.077 s] 3.067 s (20.4%)
profiling 14.745 s [14.745 s, 14.745 s] -265.0 ms (-1.8%)
tracing 14.812 s [14.812 s, 14.812 s] -198.0 ms (-1.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.357 s [15.357 s, 15.357 s] -
appsec 14.575 s [14.575 s, 14.575 s] -782.0 ms (-5.1%)
iast 18.086 s [18.086 s, 18.086 s] 2.729 s (17.8%)
iast_GLOBAL 18.157 s [18.157 s, 18.157 s] 2.8 s (18.2%)
profiling 14.711 s [14.711 s, 14.711 s] -646.0 ms (-4.2%)
tracing 14.976 s [14.976 s, 14.976 s] -381.0 ms (-2.5%)

@jpbempel jpbempel merged commit a5cfe66 into master Nov 20, 2025
542 of 548 checks passed
@jpbempel jpbempel deleted the jpbempel/mark-smoke-tests branch November 20, 2025 16:09
@github-actions github-actions Bot added this to the 1.57.0 milestone Nov 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD AlexeyKuznetsov-DD approved these changes

@evanchooly evanchooly Awaiting requested review from evanchooly evanchooly is a code owner automatically assigned from DataDog/debugger-java

Assignees

No one assigned

Labels

comp: debugger Dynamic Instrumentation tag: no release notes Changes to exclude from release notes type: bug Bug report and fix

Projects

None yet

Milestone

1.57.0

Development

Successfully merging this pull request may close these issues.

2 participants

@jpbempel @AlexeyKuznetsov-DD