Skip to content

Add pin system tests workflow#10173

Merged
PerfectSlayer merged 15 commits into
masterfrom
sarahchen6/pin-system-tests-workflow
Dec 12, 2025
Merged

Add pin system tests workflow#10173
PerfectSlayer merged 15 commits into
masterfrom
sarahchen6/pin-system-tests-workflow

Conversation

@sarahchen6
Copy link
Copy Markdown
Contributor

@sarahchen6 sarahchen6 commented Dec 11, 2025

What Does This Do

Add workflow that pins system tests

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Dec 11, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/pin-system-tests-workflow
git_commit_date 1765481941 1765485390
git_commit_sha f2a8d05 2a2a8ea
release_version 1.57.0-SNAPSHOT~f2a8d05e73 1.57.0-SNAPSHOT~2a2a8ea3dc
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765487617 1765487617
ci_job_id 1288935702 1288935702
ci_pipeline_id 86336820 86336820
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-70neka86 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-70neka86 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 6 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~2a2a8ea3dc, baseline=1.57.0-SNAPSHOT~f2a8d05e73

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.089 s) : 0, 1088948
Total [baseline] (10.874 s) : 0, 10873815
Agent [candidate] (1.085 s) : 0, 1085417
Total [candidate] (10.826 s) : 0, 10825679
section appsec
Agent [baseline] (1.273 s) : 0, 1272756
Total [baseline] (11.142 s) : 0, 11141664
Agent [candidate] (1.273 s) : 0, 1273240
Total [candidate] (11.187 s) : 0, 11187434
section iast
Agent [baseline] (1.233 s) : 0, 1232857
Total [baseline] (11.261 s) : 0, 11261309
Agent [candidate] (1.221 s) : 0, 1221272
Total [candidate] (11.148 s) : 0, 11148087
section profiling
Agent [baseline] (1.207 s) : 0, 1206863
Total [baseline] (11.048 s) : 0, 11047974
Agent [candidate] (1.203 s) : 0, 1203145
Total [candidate] (10.975 s) : 0, 10975054
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.089 s -
Agent appsec 1.273 s 183.808 ms (16.9%)
Agent iast 1.233 s 143.909 ms (13.2%)
Agent profiling 1.207 s 117.915 ms (10.8%)
Total tracing 10.874 s -
Total appsec 11.142 s 267.848 ms (2.5%)
Total iast 11.261 s 387.494 ms (3.6%)
Total profiling 11.048 s 174.159 ms (1.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent appsec 1.273 s 187.823 ms (17.3%)
Agent iast 1.221 s 135.854 ms (12.5%)
Agent profiling 1.203 s 117.727 ms (10.8%)
Total tracing 10.826 s -
Total appsec 11.187 s 361.755 ms (3.3%)
Total iast 11.148 s 322.407 ms (3.0%)
Total profiling 10.975 s 149.374 ms (1.4%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~2a2a8ea3dc, baseline=1.57.0-SNAPSHOT~f2a8d05e73

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.21 ms) : 0, 1210
crashtracking [candidate] (1.205 ms) : 0, 1205
BytebuddyAgent [baseline] (653.472 ms) : 0, 653472
BytebuddyAgent [candidate] (652.617 ms) : 0, 652617
GlobalTracer [baseline] (283.564 ms) : 0, 283564
GlobalTracer [candidate] (282.021 ms) : 0, 282021
AppSec [baseline] (32.591 ms) : 0, 32591
AppSec [candidate] (32.319 ms) : 0, 32319
Debugger [baseline] (68.945 ms) : 0, 68945
Debugger [candidate] (68.25 ms) : 0, 68250
Remote Config [baseline] (630.807 µs) : 0, 631
Remote Config [candidate] (637.403 µs) : 0, 637
Telemetry [baseline] (9.056 ms) : 0, 9056
Telemetry [candidate] (8.992 ms) : 0, 8992
Flare Poller [baseline] (3.754 ms) : 0, 3754
Flare Poller [candidate] (3.71 ms) : 0, 3710
section appsec
crashtracking [baseline] (1.223 ms) : 0, 1223
crashtracking [candidate] (1.212 ms) : 0, 1212
BytebuddyAgent [baseline] (694.76 ms) : 0, 694760
BytebuddyAgent [candidate] (694.529 ms) : 0, 694529
GlobalTracer [baseline] (260.747 ms) : 0, 260747
GlobalTracer [candidate] (261.087 ms) : 0, 261087
AppSec [baseline] (175.316 ms) : 0, 175316
AppSec [candidate] (175.341 ms) : 0, 175341
Debugger [baseline] (66.549 ms) : 0, 66549
Debugger [candidate] (66.801 ms) : 0, 66801
Remote Config [baseline] (664.375 µs) : 0, 664
Remote Config [candidate] (714.566 µs) : 0, 715
Telemetry [baseline] (9.061 ms) : 0, 9061
Telemetry [candidate] (9.064 ms) : 0, 9064
Flare Poller [baseline] (3.895 ms) : 0, 3895
Flare Poller [candidate] (3.972 ms) : 0, 3972
IAST [baseline] (24.831 ms) : 0, 24831
IAST [candidate] (24.768 ms) : 0, 24768
section iast
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.21 ms) : 0, 1210
BytebuddyAgent [baseline] (795.966 ms) : 0, 795966
BytebuddyAgent [candidate] (788.901 ms) : 0, 788901
GlobalTracer [baseline] (257.964 ms) : 0, 257964
GlobalTracer [candidate] (255.856 ms) : 0, 255856
AppSec [baseline] (35.911 ms) : 0, 35911
AppSec [candidate] (35.521 ms) : 0, 35521
Debugger [baseline] (66.377 ms) : 0, 66377
Debugger [candidate] (65.196 ms) : 0, 65196
Remote Config [baseline] (579.383 µs) : 0, 579
Remote Config [candidate] (533.913 µs) : 0, 534
Telemetry [baseline] (8.64 ms) : 0, 8640
Telemetry [candidate] (8.434 ms) : 0, 8434
Flare Poller [baseline] (3.516 ms) : 0, 3516
Flare Poller [candidate] (3.462 ms) : 0, 3462
IAST [baseline] (27.304 ms) : 0, 27304
IAST [candidate] (26.829 ms) : 0, 26829
section profiling
ProfilingAgent [baseline] (97.854 ms) : 0, 97854
ProfilingAgent [candidate] (97.959 ms) : 0, 97959
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (703.02 ms) : 0, 703020
BytebuddyAgent [candidate] (700.448 ms) : 0, 700448
GlobalTracer [baseline] (221.089 ms) : 0, 221089
GlobalTracer [candidate] (220.62 ms) : 0, 220620
AppSec [baseline] (32.453 ms) : 0, 32453
AppSec [candidate] (32.024 ms) : 0, 32024
Debugger [baseline] (67.955 ms) : 0, 67955
Debugger [candidate] (67.969 ms) : 0, 67969
Remote Config [baseline] (639.172 µs) : 0, 639
Remote Config [candidate] (632.7 µs) : 0, 633
Telemetry [baseline] (9.171 ms) : 0, 9171
Telemetry [candidate] (8.972 ms) : 0, 8972
Flare Poller [baseline] (3.78 ms) : 0, 3780
Flare Poller [candidate] (3.755 ms) : 0, 3755
Profiling [baseline] (98.429 ms) : 0, 98429
Profiling [candidate] (98.549 ms) : 0, 98549
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~2a2a8ea3dc, baseline=1.57.0-SNAPSHOT~f2a8d05e73

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.08 s) : 0, 1080456
Total [baseline] (8.767 s) : 0, 8766968
Agent [candidate] (1.087 s) : 0, 1087345
Total [candidate] (8.749 s) : 0, 8749221
section iast
Agent [baseline] (1.222 s) : 0, 1222271
Total [baseline] (9.479 s) : 0, 9479309
Agent [candidate] (1.22 s) : 0, 1219912
Total [candidate] (9.459 s) : 0, 9458688
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.08 s -
Agent iast 1.222 s 141.816 ms (13.1%)
Total tracing 8.767 s -
Total iast 9.479 s 712.341 ms (8.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.087 s -
Agent iast 1.22 s 132.568 ms (12.2%)
Total tracing 8.749 s -
Total iast 9.459 s 709.467 ms (8.1%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~2a2a8ea3dc, baseline=1.57.0-SNAPSHOT~f2a8d05e73

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.184 ms) : 0, 1184
crashtracking [candidate] (1.206 ms) : 0, 1206
BytebuddyAgent [baseline] (648.193 ms) : 0, 648193
BytebuddyAgent [candidate] (652.078 ms) : 0, 652078
GlobalTracer [baseline] (282.367 ms) : 0, 282367
GlobalTracer [candidate] (284.147 ms) : 0, 284147
AppSec [baseline] (32.555 ms) : 0, 32555
AppSec [candidate] (32.897 ms) : 0, 32897
Debugger [baseline] (67.227 ms) : 0, 67227
Debugger [candidate] (67.62 ms) : 0, 67620
Remote Config [baseline] (647.693 µs) : 0, 648
Remote Config [candidate] (664.069 µs) : 0, 664
Telemetry [baseline] (8.95 ms) : 0, 8950
Telemetry [candidate] (9.147 ms) : 0, 9147
Flare Poller [baseline] (3.724 ms) : 0, 3724
Flare Poller [candidate] (3.755 ms) : 0, 3755
section iast
crashtracking [baseline] (1.207 ms) : 0, 1207
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (790.341 ms) : 0, 790341
BytebuddyAgent [candidate] (788.903 ms) : 0, 788903
GlobalTracer [baseline] (255.662 ms) : 0, 255662
GlobalTracer [candidate] (254.761 ms) : 0, 254761
AppSec [baseline] (35.476 ms) : 0, 35476
AppSec [candidate] (34.413 ms) : 0, 34413
Debugger [baseline] (64.694 ms) : 0, 64694
Debugger [candidate] (66.011 ms) : 0, 66011
Remote Config [baseline] (540.428 µs) : 0, 540
Remote Config [candidate] (544.296 µs) : 0, 544
Telemetry [baseline] (8.429 ms) : 0, 8429
Telemetry [candidate] (8.471 ms) : 0, 8471
Flare Poller [baseline] (3.422 ms) : 0, 3422
Flare Poller [candidate] (3.499 ms) : 0, 3499
IAST [baseline] (27.047 ms) : 0, 27047
IAST [candidate] (26.695 ms) : 0, 26695
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/pin-system-tests-workflow
git_commit_date 1765481941 1765485390
git_commit_sha f2a8d05 2a2a8ea
release_version 1.57.0-SNAPSHOT~f2a8d05e73 1.57.0-SNAPSHOT~2a2a8ea3dc
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765487887 1765487887
ci_job_id 1288935708 1288935708
ci_pipeline_id 86336820 86336820
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-3zdbd0ur 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-3zdbd0ur 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 0 performance regressions! Performance is the same for 17 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load better
[-332.399µs; -99.403µs] or [-12.589%; -3.765%]		 unstable
[-1387.900µs; -36.137µs] or [-17.418%; -0.454%]		 unstable
[-68.601op/s; +236.976op/s] or [-5.038%; +17.404%]		 2.425ms 7.256ms 1445.812op/s 2.640ms 7.968ms 1361.625op/s
scenario:load:petclinic:no_agent:high_load better
[-1.959ms; -0.594ms] or [-11.022%; -3.344%]		 unstable
[-2.884ms; +0.365ms] or [-9.704%; +1.229%]		 unstable
[-13.827op/s; +44.639op/s] or [-5.383%; +17.380%]		 16.494ms 28.463ms 272.250op/s 17.770ms 29.722ms 256.844op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~2a2a8ea3dc, baseline=1.57.0-SNAPSHOT~f2a8d05e73
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.17 ms) : 17984, 18356
.   : milestone, 18170,
appsec (18.429 ms) : 18242, 18616
.   : milestone, 18429,
code_origins (17.679 ms) : 17506, 17851
.   : milestone, 17679,
iast (17.534 ms) : 17361, 17708
.   : milestone, 17534,
profiling (19.717 ms) : 19514, 19920
.   : milestone, 19717,
tracing (18.034 ms) : 17853, 18214
.   : milestone, 18034,
section candidate
no_agent (17.134 ms) : 16962, 17307
.   : milestone, 17134,
appsec (18.434 ms) : 18247, 18620
.   : milestone, 18434,
code_origins (17.572 ms) : 17399, 17746
.   : milestone, 17572,
iast (17.785 ms) : 17609, 17961
.   : milestone, 17785,
profiling (20.457 ms) : 20243, 20671
.   : milestone, 20457,
tracing (17.706 ms) : 17529, 17884
.   : milestone, 17706,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.17 ms [17.984 ms, 18.356 ms] -
appsec 18.429 ms [18.242 ms, 18.616 ms] 258.715 µs (1.4%)
code_origins 17.679 ms [17.506 ms, 17.851 ms] -491.469 µs (-2.7%)
iast 17.534 ms [17.361 ms, 17.708 ms] -635.516 µs (-3.5%)
profiling 19.717 ms [19.514 ms, 19.92 ms] 1.547 ms (8.5%)
tracing 18.034 ms [17.853 ms, 18.214 ms] -136.43 µs (-0.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.134 ms [16.962 ms, 17.307 ms] -
appsec 18.434 ms [18.247 ms, 18.62 ms] 1.299 ms (7.6%)
code_origins 17.572 ms [17.399 ms, 17.746 ms] 438.19 µs (2.6%)
iast 17.785 ms [17.609 ms, 17.961 ms] 650.871 µs (3.8%)
profiling 20.457 ms [20.243 ms, 20.671 ms] 3.322 ms (19.4%)
tracing 17.706 ms [17.529 ms, 17.884 ms] 572.12 µs (3.3%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~2a2a8ea3dc, baseline=1.57.0-SNAPSHOT~f2a8d05e73
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.195 ms) : 1184, 1206
.   : milestone, 1195,
iast (3.364 ms) : 3319, 3409
.   : milestone, 3364,
iast_FULL (5.958 ms) : 5899, 6018
.   : milestone, 5958,
iast_GLOBAL (3.631 ms) : 3574, 3688
.   : milestone, 3631,
profiling (1.997 ms) : 1980, 2015
.   : milestone, 1997,
tracing (1.829 ms) : 1814, 1844
.   : milestone, 1829,
section candidate
no_agent (1.204 ms) : 1193, 1216
.   : milestone, 1204,
iast (3.163 ms) : 3117, 3210
.   : milestone, 3163,
iast_FULL (5.73 ms) : 5673, 5787
.   : milestone, 5730,
iast_GLOBAL (3.62 ms) : 3568, 3673
.   : milestone, 3620,
profiling (2.027 ms) : 2010, 2045
.   : milestone, 2027,
tracing (1.851 ms) : 1836, 1866
.   : milestone, 1851,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.195 ms [1.184 ms, 1.206 ms] -
iast 3.364 ms [3.319 ms, 3.409 ms] 2.169 ms (181.5%)
iast_FULL 5.958 ms [5.899 ms, 6.018 ms] 4.764 ms (398.7%)
iast_GLOBAL 3.631 ms [3.574 ms, 3.688 ms] 2.436 ms (203.9%)
profiling 1.997 ms [1.98 ms, 2.015 ms] 802.593 µs (67.2%)
tracing 1.829 ms [1.814 ms, 1.844 ms] 633.952 µs (53.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.204 ms [1.193 ms, 1.216 ms] -
iast 3.163 ms [3.117 ms, 3.21 ms] 1.959 ms (162.7%)
iast_FULL 5.73 ms [5.673 ms, 5.787 ms] 4.526 ms (375.8%)
iast_GLOBAL 3.62 ms [3.568 ms, 3.673 ms] 2.416 ms (200.6%)
profiling 2.027 ms [2.01 ms, 2.045 ms] 823.011 µs (68.3%)
tracing 1.851 ms [1.836 ms, 1.866 ms] 646.643 µs (53.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/pin-system-tests-workflow
git_commit_date 1765481941 1765485390
git_commit_sha f2a8d05 2a2a8ea
release_version 1.57.0-SNAPSHOT~f2a8d05e73 1.57.0-SNAPSHOT~2a2a8ea3dc
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1765487604 1765487604
ci_job_id 1288935710 1288935710
ci_pipeline_id 86336820 86336820
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-wlbuveay 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-wlbuveay 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 1 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.338ms; -1.003ms] or [-36.772%; -27.559%]		 2.469ms 3.639ms
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~2a2a8ea3dc, baseline=1.57.0-SNAPSHOT~f2a8d05e73
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.481 ms) : 1469, 1493
.   : milestone, 1481,
appsec (3.639 ms) : 3425, 3853
.   : milestone, 3639,
iast (2.216 ms) : 2151, 2280
.   : milestone, 2216,
iast_GLOBAL (2.262 ms) : 2197, 2327
.   : milestone, 2262,
profiling (2.461 ms) : 2249, 2674
.   : milestone, 2461,
tracing (2.051 ms) : 2000, 2101
.   : milestone, 2051,
section candidate
no_agent (1.478 ms) : 1466, 1489
.   : milestone, 1478,
appsec (2.469 ms) : 2417, 2520
.   : milestone, 2469,
iast (2.226 ms) : 2161, 2291
.   : milestone, 2226,
iast_GLOBAL (2.264 ms) : 2199, 2329
.   : milestone, 2264,
profiling (2.069 ms) : 2016, 2121
.   : milestone, 2069,
tracing (2.051 ms) : 2000, 2102
.   : milestone, 2051,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.481 ms [1.469 ms, 1.493 ms] -
appsec 3.639 ms [3.425 ms, 3.853 ms] 2.158 ms (145.7%)
iast 2.216 ms [2.151 ms, 2.28 ms] 734.976 µs (49.6%)
iast_GLOBAL 2.262 ms [2.197 ms, 2.327 ms] 780.792 µs (52.7%)
profiling 2.461 ms [2.249 ms, 2.674 ms] 980.392 µs (66.2%)
tracing 2.051 ms [2.0 ms, 2.101 ms] 569.587 µs (38.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.466 ms, 1.489 ms] -
appsec 2.469 ms [2.417 ms, 2.52 ms] 990.755 µs (67.0%)
iast 2.226 ms [2.161 ms, 2.291 ms] 748.474 µs (50.6%)
iast_GLOBAL 2.264 ms [2.199 ms, 2.329 ms] 786.439 µs (53.2%)
profiling 2.069 ms [2.016 ms, 2.121 ms] 590.776 µs (40.0%)
tracing 2.051 ms [2.0 ms, 2.102 ms] 573.343 µs (38.8%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~2a2a8ea3dc, baseline=1.57.0-SNAPSHOT~f2a8d05e73
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.5 s) : 15500000, 15500000
.   : milestone, 15500000,
appsec (14.807 s) : 14807000, 14807000
.   : milestone, 14807000,
iast (18.321 s) : 18321000, 18321000
.   : milestone, 18321000,
iast_GLOBAL (17.738 s) : 17738000, 17738000
.   : milestone, 17738000,
profiling (14.501 s) : 14501000, 14501000
.   : milestone, 14501000,
tracing (14.848 s) : 14848000, 14848000
.   : milestone, 14848000,
section candidate
no_agent (14.78 s) : 14780000, 14780000
.   : milestone, 14780000,
appsec (14.923 s) : 14923000, 14923000
.   : milestone, 14923000,
iast (18.18 s) : 18180000, 18180000
.   : milestone, 18180000,
iast_GLOBAL (17.868 s) : 17868000, 17868000
.   : milestone, 17868000,
profiling (15.219 s) : 15219000, 15219000
.   : milestone, 15219000,
tracing (14.495 s) : 14495000, 14495000
.   : milestone, 14495000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.5 s [15.5 s, 15.5 s] -
appsec 14.807 s [14.807 s, 14.807 s] -693.0 ms (-4.5%)
iast 18.321 s [18.321 s, 18.321 s] 2.821 s (18.2%)
iast_GLOBAL 17.738 s [17.738 s, 17.738 s] 2.238 s (14.4%)
profiling 14.501 s [14.501 s, 14.501 s] -999.0 ms (-6.4%)
tracing 14.848 s [14.848 s, 14.848 s] -652.0 ms (-4.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.78 s [14.78 s, 14.78 s] -
appsec 14.923 s [14.923 s, 14.923 s] 143.0 ms (1.0%)
iast 18.18 s [18.18 s, 18.18 s] 3.4 s (23.0%)
iast_GLOBAL 17.868 s [17.868 s, 17.868 s] 3.088 s (20.9%)
profiling 15.219 s [15.219 s, 15.219 s] 439.0 ms (3.0%)
tracing 14.495 s [14.495 s, 14.495 s] -285.0 ms (-1.9%)

@sarahchen6 sarahchen6 mentioned this pull request Dec 11, 2025
Merged
@sarahchen6 sarahchen6 mentioned this pull request Dec 12, 2025
Merged
@sarahchen6 sarahchen6 mentioned this pull request Dec 12, 2025
Closed
PerfectSlayer
PerfectSlayer approved these changes Dec 12, 2025
View reviewed changes
Comment thread .github/workflows/pin-system-tests.yaml
if git ls-remote --heads origin "$BRANCH" | grep -q "$BRANCH"; then
echo "creating_new_branch=false" >> "$GITHUB_OUTPUT"
echo "Branch $BRANCH already exists - please delete it and re-run the workflow."
exit 0
Copy link
Copy Markdown
Contributor

@PerfectSlayer PerfectSlayer Dec 12, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not exiting the workflow

Comment thread .github/workflows/pin-system-tests.yaml
if [[ -z "$(git status -s)" ]]; then
echo "No changes to commit, exiting."
echo "commit_changes=false" >> "$GITHUB_OUTPUT"
exit 0
Copy link
Copy Markdown
Contributor

@PerfectSlayer PerfectSlayer Dec 12, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same

@sarahchen6 sarahchen6 added the tag: no release notes Changes to exclude from release notes label Dec 12, 2025
@sarahchen6 sarahchen6 marked this pull request as ready for review December 12, 2025 16:21
@sarahchen6 sarahchen6 requested a review from a team as a code owner December 12, 2025 16:21
@sarahchen6 sarahchen6 requested review from dougqh and removed request for a team December 12, 2025 16:21
@PerfectSlayer PerfectSlayer merged commit c2560c4 into master Dec 12, 2025
8 of 18 checks passed
@PerfectSlayer PerfectSlayer deleted the sarahchen6/pin-system-tests-workflow branch December 12, 2025 16:21
@github-actions github-actions Bot added this to the 1.57.0 milestone Dec 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

@dougqh dougqh Awaiting requested review from dougqh dougqh is a code owner automatically assigned from DataDog/apm-lang-platform-java

Assignees

No one assigned

Labels

tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.57.0

Development

Successfully merging this pull request may close these issues.

2 participants

@sarahchen6 @PerfectSlayer