DSM: Testing system-tests behaviour by robcarlan-datadog · Pull Request #10969 · DataDog/dd-trace-java

robcarlan-datadog · 2026-03-25T20:42:14Z

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Format the title according to the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any other useful labels
Avoid using close, fix, or any linking keywords when referencing an issue
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, migration, or deletion
Update public documentation with any new configuration flags or behaviors

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

pr-commenter · 2026-03-25T21:27:35Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	rob.carlan/test-dsm-consume-checkpoint-context
git_commit_date	1772833633	1774471263
git_commit_sha	`e5e0164`	`4af7e8f`
release_version	1.61.0-SNAPSHOT~e5e0164f28	1.61.0-SNAPSHOT~4af7e8ff18

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1774473141	1774473141
ci_job_id	1539369056	1539369056
ci_pipeline_id	104423378	104423378
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-22cznf6y 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-22cznf6y 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~4af7e8ff18, baseline=1.61.0-SNAPSHOT~e5e0164f28

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.068 s) : 0, 1067764
Total [baseline] (8.908 s) : 0, 8907599
Agent [candidate] (1.058 s) : 0, 1057760
Total [candidate] (8.826 s) : 0, 8825811
section iast
Agent [baseline] (1.226 s) : 0, 1226358
Total [baseline] (9.564 s) : 0, 9564377
Agent [candidate] (1.232 s) : 0, 1231666
Total [candidate] (9.547 s) : 0, 9546837

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.068 s	-
Agent	iast	1.226 s	158.594 ms (14.9%)
Total	tracing	8.908 s	-
Total	iast	9.564 s	656.777 ms (7.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.058 s	-
Agent	iast	1.232 s	173.906 ms (16.4%)
Total	tracing	8.826 s	-
Total	iast	9.547 s	721.026 ms (8.2%)

gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~4af7e8ff18, baseline=1.61.0-SNAPSHOT~e5e0164f28

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.201 ms) : 0, 1201
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (631.11 ms) : 0, 631110
BytebuddyAgent [candidate] (627.853 ms) : 0, 627853
AgentMeter [baseline] (29.638 ms) : 0, 29638
AgentMeter [candidate] (29.065 ms) : 0, 29065
GlobalTracer [baseline] (259.802 ms) : 0, 259802
GlobalTracer [candidate] (256.955 ms) : 0, 256955
AppSec [baseline] (32.204 ms) : 0, 32204
AppSec [candidate] (31.511 ms) : 0, 31511
Debugger [baseline] (59.403 ms) : 0, 59403
Debugger [candidate] (58.742 ms) : 0, 58742
Remote Config [baseline] (597.381 µs) : 0, 597
Remote Config [candidate] (584.11 µs) : 0, 584
Telemetry [baseline] (8.795 ms) : 0, 8795
Telemetry [candidate] (8.632 ms) : 0, 8632
Flare Poller [baseline] (8.862 ms) : 0, 8862
Flare Poller [candidate] (7.149 ms) : 0, 7149
section iast
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (795.7 ms) : 0, 795700
BytebuddyAgent [candidate] (800.162 ms) : 0, 800162
AgentMeter [baseline] (11.29 ms) : 0, 11290
AgentMeter [candidate] (11.559 ms) : 0, 11559
GlobalTracer [baseline] (247.563 ms) : 0, 247563
GlobalTracer [candidate] (247.9 ms) : 0, 247900
AppSec [baseline] (26.603 ms) : 0, 26603
AppSec [candidate] (27.349 ms) : 0, 27349
Debugger [baseline] (62.356 ms) : 0, 62356
Debugger [candidate] (61.807 ms) : 0, 61807
Remote Config [baseline] (537.877 µs) : 0, 538
Remote Config [candidate] (528.267 µs) : 0, 528
Telemetry [baseline] (14.857 ms) : 0, 14857
Telemetry [candidate] (14.849 ms) : 0, 14849
Flare Poller [baseline] (4.939 ms) : 0, 4939
Flare Poller [candidate] (4.859 ms) : 0, 4859
IAST [baseline] (25.361 ms) : 0, 25361
IAST [candidate] (25.268 ms) : 0, 25268

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~4af7e8ff18, baseline=1.61.0-SNAPSHOT~e5e0164f28

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1066214
Total [baseline] (11.108 s) : 0, 11107899
Agent [candidate] (1.065 s) : 0, 1064798
Total [candidate] (11.008 s) : 0, 11007984
section appsec
Agent [baseline] (1.257 s) : 0, 1257243
Total [baseline] (11.173 s) : 0, 11172782
Agent [candidate] (1.251 s) : 0, 1250505
Total [candidate] (11.103 s) : 0, 11103178
section iast
Agent [baseline] (1.232 s) : 0, 1232189
Total [baseline] (11.316 s) : 0, 11315959
Agent [candidate] (1.237 s) : 0, 1237089
Total [candidate] (11.343 s) : 0, 11342535
section profiling
Agent [baseline] (1.181 s) : 0, 1180842
Total [baseline] (11.075 s) : 0, 11075019
Agent [candidate] (1.188 s) : 0, 1187638
Total [candidate] (11.111 s) : 0, 11111101

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.066 s	-
Agent	appsec	1.257 s	191.029 ms (17.9%)
Agent	iast	1.232 s	165.975 ms (15.6%)
Agent	profiling	1.181 s	114.628 ms (10.8%)
Total	tracing	11.108 s	-
Total	appsec	11.173 s	64.883 ms (0.6%)
Total	iast	11.316 s	208.06 ms (1.9%)
Total	profiling	11.075 s	-32.881 ms (-0.3%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.065 s	-
Agent	appsec	1.251 s	185.707 ms (17.4%)
Agent	iast	1.237 s	172.291 ms (16.2%)
Agent	profiling	1.188 s	122.84 ms (11.5%)
Total	tracing	11.008 s	-
Total	appsec	11.103 s	95.194 ms (0.9%)
Total	iast	11.343 s	334.551 ms (3.0%)
Total	profiling	11.111 s	103.117 ms (0.9%)

gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~4af7e8ff18, baseline=1.61.0-SNAPSHOT~e5e0164f28

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.226 ms) : 0, 1226
crashtracking [candidate] (1.218 ms) : 0, 1218
BytebuddyAgent [baseline] (632.043 ms) : 0, 632043
BytebuddyAgent [candidate] (631.198 ms) : 0, 631198
AgentMeter [baseline] (29.4 ms) : 0, 29400
AgentMeter [candidate] (29.298 ms) : 0, 29298
GlobalTracer [baseline] (257.927 ms) : 0, 257927
GlobalTracer [candidate] (258.32 ms) : 0, 258320
AppSec [baseline] (31.757 ms) : 0, 31757
AppSec [candidate] (31.716 ms) : 0, 31716
Debugger [baseline] (59.543 ms) : 0, 59543
Debugger [candidate] (59.701 ms) : 0, 59701
Remote Config [baseline] (588.102 µs) : 0, 588
Remote Config [candidate] (587.154 µs) : 0, 587
Telemetry [baseline] (8.684 ms) : 0, 8684
Telemetry [candidate] (8.706 ms) : 0, 8706
Flare Poller [baseline] (8.882 ms) : 0, 8882
Flare Poller [candidate] (7.983 ms) : 0, 7983
section appsec
crashtracking [baseline] (1.203 ms) : 0, 1203
crashtracking [candidate] (1.207 ms) : 0, 1207
BytebuddyAgent [baseline] (665.046 ms) : 0, 665046
BytebuddyAgent [candidate] (661.321 ms) : 0, 661321
AgentMeter [baseline] (12.1 ms) : 0, 12100
AgentMeter [candidate] (12.047 ms) : 0, 12047
GlobalTracer [baseline] (260.23 ms) : 0, 260230
GlobalTracer [candidate] (259.453 ms) : 0, 259453
AppSec [baseline] (178.43 ms) : 0, 178430
AppSec [candidate] (177.739 ms) : 0, 177739
Debugger [baseline] (66.103 ms) : 0, 66103
Debugger [candidate] (65.304 ms) : 0, 65304
Remote Config [baseline] (583.475 µs) : 0, 583
Remote Config [candidate] (572.116 µs) : 0, 572
Telemetry [baseline] (9.099 ms) : 0, 9099
Telemetry [candidate] (8.894 ms) : 0, 8894
Flare Poller [baseline] (3.677 ms) : 0, 3677
Flare Poller [candidate] (3.565 ms) : 0, 3565
IAST [baseline] (24.263 ms) : 0, 24263
IAST [candidate] (24.05 ms) : 0, 24050
section iast
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (799.965 ms) : 0, 799965
BytebuddyAgent [candidate] (802.582 ms) : 0, 802582
AgentMeter [baseline] (11.549 ms) : 0, 11549
AgentMeter [candidate] (11.622 ms) : 0, 11622
GlobalTracer [baseline] (247.745 ms) : 0, 247745
GlobalTracer [candidate] (249.178 ms) : 0, 249178
AppSec [baseline] (26.688 ms) : 0, 26688
AppSec [candidate] (26.748 ms) : 0, 26748
Debugger [baseline] (63.371 ms) : 0, 63371
Debugger [candidate] (64.094 ms) : 0, 64094
Remote Config [baseline] (535.701 µs) : 0, 536
Remote Config [candidate] (537.377 µs) : 0, 537
Telemetry [baseline] (14.796 ms) : 0, 14796
Telemetry [candidate] (14.883 ms) : 0, 14883
Flare Poller [baseline] (4.893 ms) : 0, 4893
Flare Poller [candidate] (4.712 ms) : 0, 4712
IAST [baseline] (25.315 ms) : 0, 25315
IAST [candidate] (25.492 ms) : 0, 25492
section profiling
ProfilingAgent [baseline] (93.75 ms) : 0, 93750
ProfilingAgent [candidate] (94.165 ms) : 0, 94165
crashtracking [baseline] (1.167 ms) : 0, 1167
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (681.972 ms) : 0, 681972
BytebuddyAgent [candidate] (686.306 ms) : 0, 686306
AgentMeter [baseline] (8.558 ms) : 0, 8558
AgentMeter [candidate] (8.692 ms) : 0, 8692
GlobalTracer [baseline] (215.312 ms) : 0, 215312
GlobalTracer [candidate] (216.516 ms) : 0, 216516
AppSec [baseline] (31.983 ms) : 0, 31983
AppSec [candidate] (32.186 ms) : 0, 32186
Debugger [baseline] (63.482 ms) : 0, 63482
Debugger [candidate] (63.589 ms) : 0, 63589
Remote Config [baseline] (584.869 µs) : 0, 585
Remote Config [candidate] (584.532 µs) : 0, 585
Telemetry [baseline] (9.713 ms) : 0, 9713
Telemetry [candidate] (9.053 ms) : 0, 9053
Flare Poller [baseline] (3.531 ms) : 0, 3531
Flare Poller [candidate] (4.264 ms) : 0, 4264
Profiling [baseline] (94.318 ms) : 0, 94318
Profiling [candidate] (94.738 ms) : 0, 94738

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	rob.carlan/test-dsm-consume-checkpoint-context
git_commit_date	1772833633	1774471263
git_commit_sha	`e5e0164`	`4af7e8f`
release_version	1.61.0-SNAPSHOT~e5e0164f28	1.61.0-SNAPSHOT~4af7e8ff18

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1774473546	1774473546
ci_job_id	1539369058	1539369058
ci_pipeline_id	104423378	104423378
cpu_model	Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-bzaunimb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-bzaunimb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 18 metrics, 15 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:iast:high_load	worse [+115.614µs; +259.929µs] or [+4.350%; +9.780%]	unsure [+61.469µs; +548.990µs] or [+0.789%; +7.049%]	unstable [-219.667op/s; +79.604op/s] or [-16.366%; +5.931%]	2.845ms	8.094ms	1272.188op/s	2.658ms	7.789ms	1342.219op/s
scenario:load:petclinic:tracing:high_load	worse [+0.853ms; +1.727ms] or [+4.818%; +9.752%]	unsure [+0.476ms; +1.952ms] or [+1.619%; +6.639%]	unstable [-41.729op/s; +9.979op/s] or [-16.249%; +3.886%]	18.994ms	30.620ms	240.938op/s	17.705ms	29.406ms	256.812op/s
scenario:load:petclinic:profiling:high_load	better [-1429.235µs; -535.470µs] or [-7.141%; -2.675%]	same [-1775.989µs; +34.969µs] or [-5.643%; +0.111%]	unstable [-13.121op/s; +34.933op/s] or [-5.691%; +15.151%]	19.033ms	30.601ms	241.469op/s	20.015ms	31.472ms	230.562op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~4af7e8ff18, baseline=1.61.0-SNAPSHOT~e5e0164f28
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.486 ms) : 17308, 17663
.   : milestone, 17486,
appsec (19.106 ms) : 18912, 19301
.   : milestone, 19106,
code_origins (18.72 ms) : 18534, 18907
.   : milestone, 18720,
iast (18.144 ms) : 17963, 18325
.   : milestone, 18144,
profiling (20.246 ms) : 20045, 20448
.   : milestone, 20246,
tracing (18.171 ms) : 17988, 18353
.   : milestone, 18171,
section candidate
no_agent (17.968 ms) : 17786, 18151
.   : milestone, 17968,
appsec (19.142 ms) : 18946, 19339
.   : milestone, 19142,
code_origins (18.428 ms) : 18242, 18614
.   : milestone, 18428,
iast (18.234 ms) : 18054, 18414
.   : milestone, 18234,
profiling (19.323 ms) : 19128, 19518
.   : milestone, 19323,
tracing (19.369 ms) : 19174, 19564
.   : milestone, 19369,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.486 ms [17.308 ms, 17.663 ms]	-
appsec	19.106 ms [18.912 ms, 19.301 ms]	1.621 ms (9.3%)
code_origins	18.72 ms [18.534 ms, 18.907 ms]	1.235 ms (7.1%)
iast	18.144 ms [17.963 ms, 18.325 ms]	658.072 µs (3.8%)
profiling	20.246 ms [20.045 ms, 20.448 ms]	2.761 ms (15.8%)
tracing	18.171 ms [17.988 ms, 18.353 ms]	685.094 µs (3.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.968 ms [17.786 ms, 18.151 ms]	-
appsec	19.142 ms [18.946 ms, 19.339 ms]	1.174 ms (6.5%)
code_origins	18.428 ms [18.242 ms, 18.614 ms]	459.63 µs (2.6%)
iast	18.234 ms [18.054 ms, 18.414 ms]	265.967 µs (1.5%)
profiling	19.323 ms [19.128 ms, 19.518 ms]	1.354 ms (7.5%)
tracing	19.369 ms [19.174 ms, 19.564 ms]	1.4 ms (7.8%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~4af7e8ff18, baseline=1.61.0-SNAPSHOT~e5e0164f28
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.312 ms) : 1298, 1325
.   : milestone, 1312,
iast (3.412 ms) : 3368, 3456
.   : milestone, 3412,
iast_FULL (6.409 ms) : 6342, 6476
.   : milestone, 6409,
iast_GLOBAL (3.789 ms) : 3721, 3856
.   : milestone, 3789,
profiling (2.478 ms) : 2452, 2505
.   : milestone, 2478,
tracing (1.95 ms) : 1933, 1968
.   : milestone, 1950,
section candidate
no_agent (1.294 ms) : 1281, 1308
.   : milestone, 1294,
iast (3.604 ms) : 3550, 3657
.   : milestone, 3604,
iast_FULL (6.573 ms) : 6502, 6643
.   : milestone, 6573,
iast_GLOBAL (3.905 ms) : 3831, 3979
.   : milestone, 3905,
profiling (2.243 ms) : 2223, 2264
.   : milestone, 2243,
tracing (1.918 ms) : 1902, 1935
.   : milestone, 1918,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.312 ms [1.298 ms, 1.325 ms]	-
iast	3.412 ms [3.368 ms, 3.456 ms]	2.1 ms (160.1%)
iast_FULL	6.409 ms [6.342 ms, 6.476 ms]	5.098 ms (388.6%)
iast_GLOBAL	3.789 ms [3.721 ms, 3.856 ms]	2.477 ms (188.8%)
profiling	2.478 ms [2.452 ms, 2.505 ms]	1.167 ms (89.0%)
tracing	1.95 ms [1.933 ms, 1.968 ms]	638.823 µs (48.7%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.294 ms [1.281 ms, 1.308 ms]	-
iast	3.604 ms [3.55 ms, 3.657 ms]	2.309 ms (178.4%)
iast_FULL	6.573 ms [6.502 ms, 6.643 ms]	5.278 ms (407.8%)
iast_GLOBAL	3.905 ms [3.831 ms, 3.979 ms]	2.611 ms (201.7%)
profiling	2.243 ms [2.223 ms, 2.264 ms]	948.673 µs (73.3%)
tracing	1.918 ms [1.902 ms, 1.935 ms]	623.995 µs (48.2%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	rob.carlan/test-dsm-consume-checkpoint-context
git_commit_date	1772833633	1774471263
git_commit_sha	`e5e0164`	`4af7e8f`
release_version	1.61.0-SNAPSHOT~e5e0164f28	1.61.0-SNAPSHOT~4af7e8ff18

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1774473230	1774473230
ci_job_id	1539369060	1539369060
ci_pipeline_id	104423378	104423378
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-eq16hsp0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-eq16hsp0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~4af7e8ff18, baseline=1.61.0-SNAPSHOT~e5e0164f28
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (3.808 ms) : 3587, 4028
.   : milestone, 3808,
iast (2.251 ms) : 2182, 2320
.   : milestone, 2251,
iast_GLOBAL (2.294 ms) : 2225, 2364
.   : milestone, 2294,
profiling (2.537 ms) : 2373, 2702
.   : milestone, 2537,
tracing (2.072 ms) : 2018, 2125
.   : milestone, 2072,
section candidate
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (3.792 ms) : 3570, 4014
.   : milestone, 3792,
iast (2.254 ms) : 2185, 2323
.   : milestone, 2254,
iast_GLOBAL (2.298 ms) : 2229, 2368
.   : milestone, 2298,
profiling (2.106 ms) : 2050, 2162
.   : milestone, 2106,
tracing (2.066 ms) : 2013, 2120
.   : milestone, 2066,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.476 ms [1.465 ms, 1.488 ms]	-
appsec	3.808 ms [3.587 ms, 4.028 ms]	2.331 ms (157.9%)
iast	2.251 ms [2.182 ms, 2.32 ms]	774.966 µs (52.5%)
iast_GLOBAL	2.294 ms [2.225 ms, 2.364 ms]	818.18 µs (55.4%)
profiling	2.537 ms [2.373 ms, 2.702 ms]	1.061 ms (71.9%)
tracing	2.072 ms [2.018 ms, 2.125 ms]	595.434 µs (40.3%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.472 ms [1.461 ms, 1.484 ms]	-
appsec	3.792 ms [3.57 ms, 4.014 ms]	2.319 ms (157.5%)
iast	2.254 ms [2.185 ms, 2.323 ms]	781.369 µs (53.1%)
iast_GLOBAL	2.298 ms [2.229 ms, 2.368 ms]	825.719 µs (56.1%)
profiling	2.106 ms [2.05 ms, 2.162 ms]	633.633 µs (43.0%)
tracing	2.066 ms [2.013 ms, 2.12 ms]	593.799 µs (40.3%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~4af7e8ff18, baseline=1.61.0-SNAPSHOT~e5e0164f28
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.972 s) : 14972000, 14972000
.   : milestone, 14972000,
appsec (14.998 s) : 14998000, 14998000
.   : milestone, 14998000,
iast (17.923 s) : 17923000, 17923000
.   : milestone, 17923000,
iast_GLOBAL (17.77 s) : 17770000, 17770000
.   : milestone, 17770000,
profiling (14.797 s) : 14797000, 14797000
.   : milestone, 14797000,
tracing (14.951 s) : 14951000, 14951000
.   : milestone, 14951000,
section candidate
no_agent (14.906 s) : 14906000, 14906000
.   : milestone, 14906000,
appsec (15.116 s) : 15116000, 15116000
.   : milestone, 15116000,
iast (17.823 s) : 17823000, 17823000
.   : milestone, 17823000,
iast_GLOBAL (17.914 s) : 17914000, 17914000
.   : milestone, 17914000,
profiling (15.46 s) : 15460000, 15460000
.   : milestone, 15460000,
tracing (14.907 s) : 14907000, 14907000
.   : milestone, 14907000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.972 s [14.972 s, 14.972 s]	-
appsec	14.998 s [14.998 s, 14.998 s]	26.0 ms (0.2%)
iast	17.923 s [17.923 s, 17.923 s]	2.951 s (19.7%)
iast_GLOBAL	17.77 s [17.77 s, 17.77 s]	2.798 s (18.7%)
profiling	14.797 s [14.797 s, 14.797 s]	-175.0 ms (-1.2%)
tracing	14.951 s [14.951 s, 14.951 s]	-21.0 ms (-0.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.906 s [14.906 s, 14.906 s]	-
appsec	15.116 s [15.116 s, 15.116 s]	210.0 ms (1.4%)
iast	17.823 s [17.823 s, 17.823 s]	2.917 s (19.6%)
iast_GLOBAL	17.914 s [17.914 s, 17.914 s]	3.008 s (20.2%)
profiling	15.46 s [15.46 s, 15.46 s]	554.0 ms (3.7%)
tracing	14.907 s [14.907 s, 14.907 s]	1.0 ms (0.0%)

remove random context race

4af7e8f

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

DSM: Testing system-tests behaviour#10969

DSM: Testing system-tests behaviour#10969
robcarlan-datadog wants to merge 1 commit intomasterfrom
rob.carlan/test-dsm-consume-checkpoint-context

robcarlan-datadog commented Mar 25, 2026

Uh oh!

pr-commenter bot commented Mar 25, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

robcarlan-datadog commented Mar 25, 2026

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Mar 25, 2026

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant