Implement configuration error tagging for all backend requests by daniel-mohedano · Pull Request #10963 · DataDog/dd-trace-java

daniel-mohedano · 2026-03-25T16:42:48Z

What Does This Do

Replace the single _dd.ci.library_configuration_error tag with per-request error tags so each backend request failure is tracked individually:
- _dd.ci.library_configuration_error.settings
- _dd.ci.library_configuration_error.skippable_tests
- _dd.ci.library_configuration_error.flaky_tests
- _dd.ci.library_configuration_error.known_tests
- _dd.ci.library_configuration_error.test_management_tests

Motivation

This will help us surface warnings in the UI when any of our features didn't work as expected due to a failure in our backend.

Contributor Checklist

Format the title according to the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any other useful labels
Avoid using close, fix, or any linking keywords when referencing an issue
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, migration, or deletion
Update public documentation with any new configuration flags or behaviors

Jira ticket: SDTEST-3521

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

cit-pr-commenter-54b7da · 2026-03-25T16:51:46Z

Test Environment - sbt-scalatest

Job Status: success

Scenario	Overhead (%)
agent	58.41
agentEvpProxy	56.51

cit-pr-commenter-54b7da · 2026-03-25T16:54:07Z

Test Environment - nebula-release-plugin

Job Status: success

Scenario	Overhead (%)
agent	36.70
agentless	37.08
agentlessCodeCoverage	46.98
agentlessLineCoverage	76.46

cit-pr-commenter-54b7da · 2026-03-25T16:56:10Z

Test Environment - netflix-zuul

Job Status: success

Scenario	Overhead (%)
agent	88.92
agentless	82.38
agentlessCodeCoverage	99.70
agentlessLineCoverage	116.87

cit-pr-commenter-54b7da · 2026-03-25T16:56:21Z

Test Environment - pass4s

Job Status: success

Scenario	Overhead (%)
agent	5.69
agentless	9.21
agentlessCodeCoverage	13.43

cit-pr-commenter-54b7da · 2026-03-25T16:57:12Z

Test Environment - reactive-streams-jvm

Job Status: success

Scenario	Overhead (%)
agent	21.34
agentless	17.90
agentlessCodeCoverage	19.99
agentlessLineCoverage	29.29

cit-pr-commenter-54b7da · 2026-03-25T17:07:10Z

Test Environment - jolokia

Job Status: success

Scenario	Overhead (%)
agent	93.76
agentless	90.89
agentlessCodeCoverage	99.32
agentlessLineCoverage	101.11

cit-pr-commenter-54b7da · 2026-03-25T17:11:56Z

Test Environment - sonar-kotlin

Job Status: success

Scenario	Overhead (%)
agent	12.93
agentless	13.90
agentlessCodeCoverage	15.41
agentlessLineCoverage	21.00

pr-commenter · 2026-03-25T17:25:03Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/request-failures-tagging
git_commit_date	1774448623	1774611058
git_commit_sha	`fd08777`	`12ea5e4`
release_version	1.61.0-SNAPSHOT~fd087771cb	1.61.0-SNAPSHOT~12ea5e4e93

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1774612825	1774612825
ci_job_id	1544862991	1544862991
ci_pipeline_id	104735424	104735424
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-i3aziftt 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-i3aziftt 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 65 metrics, 6 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~12ea5e4e93, baseline=1.61.0-SNAPSHOT~fd087771cb

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1066322
Total [baseline] (11.183 s) : 0, 11182621
Agent [candidate] (1.061 s) : 0, 1061107
Total [candidate] (11.218 s) : 0, 11217732
section appsec
Agent [baseline] (1.257 s) : 0, 1257195
Total [baseline] (11.118 s) : 0, 11118134
Agent [candidate] (1.251 s) : 0, 1250612
Total [candidate] (11.237 s) : 0, 11236804
section iast
Agent [baseline] (1.232 s) : 0, 1231759
Total [baseline] (11.263 s) : 0, 11262696
Agent [candidate] (1.23 s) : 0, 1230252
Total [candidate] (11.402 s) : 0, 11402308
section profiling
Agent [baseline] (1.182 s) : 0, 1182343
Total [baseline] (11.002 s) : 0, 11002123
Agent [candidate] (1.183 s) : 0, 1182909
Total [candidate] (11.017 s) : 0, 11017191

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.066 s	-
Agent	appsec	1.257 s	190.873 ms (17.9%)
Agent	iast	1.232 s	165.437 ms (15.5%)
Agent	profiling	1.182 s	116.021 ms (10.9%)
Total	tracing	11.183 s	-
Total	appsec	11.118 s	-64.486 ms (-0.6%)
Total	iast	11.263 s	80.075 ms (0.7%)
Total	profiling	11.002 s	-180.497 ms (-1.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.061 s	-
Agent	appsec	1.251 s	189.505 ms (17.9%)
Agent	iast	1.23 s	169.145 ms (15.9%)
Agent	profiling	1.183 s	121.802 ms (11.5%)
Total	tracing	11.218 s	-
Total	appsec	11.237 s	19.072 ms (0.2%)
Total	iast	11.402 s	184.576 ms (1.6%)
Total	profiling	11.017 s	-200.541 ms (-1.8%)

gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~12ea5e4e93, baseline=1.61.0-SNAPSHOT~fd087771cb

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.204 ms) : 0, 1204
crashtracking [candidate] (1.213 ms) : 0, 1213
BytebuddyAgent [baseline] (634.235 ms) : 0, 634235
BytebuddyAgent [candidate] (629.464 ms) : 0, 629464
AgentMeter [baseline] (29.673 ms) : 0, 29673
AgentMeter [candidate] (29.659 ms) : 0, 29659
GlobalTracer [baseline] (258.955 ms) : 0, 258955
GlobalTracer [candidate] (258.792 ms) : 0, 258792
AppSec [baseline] (31.993 ms) : 0, 31993
AppSec [candidate] (32.041 ms) : 0, 32041
Debugger [baseline] (60.996 ms) : 0, 60996
Debugger [candidate] (60.847 ms) : 0, 60847
Remote Config [baseline] (594.299 µs) : 0, 594
Remote Config [candidate] (598.467 µs) : 0, 598
Telemetry [baseline] (8.884 ms) : 0, 8884
Telemetry [candidate] (8.07 ms) : 0, 8070
Flare Poller [baseline] (3.53 ms) : 0, 3530
Flare Poller [candidate] (4.296 ms) : 0, 4296
section appsec
crashtracking [baseline] (1.2 ms) : 0, 1200
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (664.708 ms) : 0, 664708
BytebuddyAgent [candidate] (660.796 ms) : 0, 660796
AgentMeter [baseline] (12.214 ms) : 0, 12214
AgentMeter [candidate] (12.115 ms) : 0, 12115
GlobalTracer [baseline] (260.287 ms) : 0, 260287
GlobalTracer [candidate] (258.981 ms) : 0, 258981
AppSec [baseline] (178.645 ms) : 0, 178645
AppSec [candidate] (177.992 ms) : 0, 177992
Debugger [baseline] (66.724 ms) : 0, 66724
Debugger [candidate] (66.393 ms) : 0, 66393
Remote Config [baseline] (616.88 µs) : 0, 617
Remote Config [candidate] (619.783 µs) : 0, 620
Telemetry [baseline] (8.334 ms) : 0, 8334
Telemetry [candidate] (8.43 ms) : 0, 8430
Flare Poller [baseline] (3.551 ms) : 0, 3551
Flare Poller [candidate] (3.55 ms) : 0, 3550
IAST [baseline] (24.399 ms) : 0, 24399
IAST [candidate] (24.22 ms) : 0, 24220
section iast
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.201 ms) : 0, 1201
BytebuddyAgent [baseline] (799.026 ms) : 0, 799026
BytebuddyAgent [candidate] (798.143 ms) : 0, 798143
AgentMeter [baseline] (11.467 ms) : 0, 11467
AgentMeter [candidate] (11.455 ms) : 0, 11455
GlobalTracer [baseline] (248.147 ms) : 0, 248147
GlobalTracer [candidate] (248.184 ms) : 0, 248184
AppSec [baseline] (26.509 ms) : 0, 26509
AppSec [candidate] (26.503 ms) : 0, 26503
Debugger [baseline] (70.933 ms) : 0, 70933
Debugger [candidate] (70.424 ms) : 0, 70424
Remote Config [baseline] (524.306 µs) : 0, 524
Remote Config [candidate] (525.0 µs) : 0, 525
Telemetry [baseline] (9.164 ms) : 0, 9164
Telemetry [candidate] (9.103 ms) : 0, 9103
Flare Poller [baseline] (3.323 ms) : 0, 3323
Flare Poller [candidate] (3.299 ms) : 0, 3299
IAST [baseline] (25.314 ms) : 0, 25314
IAST [candidate] (25.306 ms) : 0, 25306
section profiling
ProfilingAgent [baseline] (93.761 ms) : 0, 93761
ProfilingAgent [candidate] (93.616 ms) : 0, 93616
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.17 ms) : 0, 1170
BytebuddyAgent [baseline] (682.878 ms) : 0, 682878
BytebuddyAgent [candidate] (683.576 ms) : 0, 683576
AgentMeter [baseline] (9.008 ms) : 0, 9008
AgentMeter [candidate] (8.989 ms) : 0, 8989
GlobalTracer [baseline] (214.828 ms) : 0, 214828
GlobalTracer [candidate] (214.84 ms) : 0, 214840
AppSec [baseline] (32.111 ms) : 0, 32111
AppSec [candidate] (32.156 ms) : 0, 32156
Debugger [baseline] (65.188 ms) : 0, 65188
Debugger [candidate] (65.935 ms) : 0, 65935
Remote Config [baseline] (558.32 µs) : 0, 558
Remote Config [candidate] (556.342 µs) : 0, 556
Telemetry [baseline] (8.513 ms) : 0, 8513
Telemetry [candidate] (7.685 ms) : 0, 7685
Flare Poller [baseline] (3.441 ms) : 0, 3441
Flare Poller [candidate] (3.484 ms) : 0, 3484
Profiling [baseline] (94.334 ms) : 0, 94334
Profiling [candidate] (94.171 ms) : 0, 94171

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~12ea5e4e93, baseline=1.61.0-SNAPSHOT~fd087771cb

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.069 s) : 0, 1068956
Total [baseline] (8.916 s) : 0, 8916431
Agent [candidate] (1.06 s) : 0, 1059812
Total [candidate] (8.858 s) : 0, 8857857
section iast
Agent [baseline] (1.227 s) : 0, 1227443
Total [baseline] (9.581 s) : 0, 9581044
Agent [candidate] (1.229 s) : 0, 1229430
Total [candidate] (9.579 s) : 0, 9578839

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.069 s	-
Agent	iast	1.227 s	158.487 ms (14.8%)
Total	tracing	8.916 s	-
Total	iast	9.581 s	664.614 ms (7.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.06 s	-
Agent	iast	1.229 s	169.619 ms (16.0%)
Total	tracing	8.858 s	-
Total	iast	9.579 s	720.982 ms (8.1%)

gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~12ea5e4e93, baseline=1.61.0-SNAPSHOT~fd087771cb

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.211 ms) : 0, 1211
crashtracking [candidate] (1.212 ms) : 0, 1212
BytebuddyAgent [baseline] (636.908 ms) : 0, 636908
BytebuddyAgent [candidate] (630.052 ms) : 0, 630052
AgentMeter [baseline] (29.917 ms) : 0, 29917
AgentMeter [candidate] (29.554 ms) : 0, 29554
GlobalTracer [baseline] (259.224 ms) : 0, 259224
GlobalTracer [candidate] (257.702 ms) : 0, 257702
AppSec [baseline] (32.13 ms) : 0, 32130
AppSec [candidate] (31.815 ms) : 0, 31815
Debugger [baseline] (60.304 ms) : 0, 60304
Debugger [candidate] (59.71 ms) : 0, 59710
Remote Config [baseline] (599.869 µs) : 0, 600
Remote Config [candidate] (581.669 µs) : 0, 582
Telemetry [baseline] (8.804 ms) : 0, 8804
Telemetry [candidate] (9.547 ms) : 0, 9547
Flare Poller [baseline] (3.556 ms) : 0, 3556
Flare Poller [candidate] (3.525 ms) : 0, 3525
section iast
crashtracking [baseline] (1.194 ms) : 0, 1194
crashtracking [candidate] (1.205 ms) : 0, 1205
BytebuddyAgent [baseline] (796.574 ms) : 0, 796574
BytebuddyAgent [candidate] (797.549 ms) : 0, 797549
AgentMeter [baseline] (11.401 ms) : 0, 11401
AgentMeter [candidate] (11.384 ms) : 0, 11384
GlobalTracer [baseline] (247.209 ms) : 0, 247209
GlobalTracer [candidate] (248.029 ms) : 0, 248029
IAST [baseline] (25.348 ms) : 0, 25348
IAST [candidate] (25.322 ms) : 0, 25322
AppSec [baseline] (26.512 ms) : 0, 26512
AppSec [candidate] (26.544 ms) : 0, 26544
Debugger [baseline] (67.327 ms) : 0, 67327
Debugger [candidate] (68.134 ms) : 0, 68134
Remote Config [baseline] (521.691 µs) : 0, 522
Remote Config [candidate] (525.196 µs) : 0, 525
Telemetry [baseline] (11.267 ms) : 0, 11267
Telemetry [candidate] (10.738 ms) : 0, 10738
Flare Poller [baseline] (3.932 ms) : 0, 3932
Flare Poller [candidate] (3.801 ms) : 0, 3801

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/request-failures-tagging
git_commit_date	1774448623	1774611058
git_commit_sha	`fd08777`	`12ea5e4`
release_version	1.61.0-SNAPSHOT~fd087771cb	1.61.0-SNAPSHOT~12ea5e4e93

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1774613303	1774613303
ci_job_id	1544862992	1544862992
ci_pipeline_id	104735424	104735424
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-8c71ye62 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-8c71ye62 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 3 performance regressions! Performance is the same for 18 metrics, 15 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:petclinic:tracing:high_load	worse [+0.665ms; +1.429ms] or [+3.850%; +8.268%]	unsure [+50.835µs; +1159.813µs] or [+0.177%; +4.037%]	unstable [-40.027op/s; +13.152op/s] or [-15.149%; +4.978%]	18.330ms	29.335ms	250.781op/s	17.283ms	28.730ms	264.219op/s
scenario:load:petclinic:no_agent:high_load	worse [+1.589ms; +2.882ms] or [+9.596%; +17.412%]	worse [+1.296ms; +3.684ms] or [+4.613%; +13.110%]	unstable [-56.260op/s; -1.677op/s] or [-20.751%; -0.619%]	18.790ms	30.586ms	242.156op/s	16.554ms	28.097ms	271.125op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~12ea5e4e93, baseline=1.61.0-SNAPSHOT~fd087771cb
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.185 ms) : 1174, 1197
.   : milestone, 1185,
iast (3.286 ms) : 3242, 3331
.   : milestone, 3286,
iast_FULL (5.84 ms) : 5782, 5898
.   : milestone, 5840,
iast_GLOBAL (3.617 ms) : 3562, 3671
.   : milestone, 3617,
profiling (2.048 ms) : 2030, 2066
.   : milestone, 2048,
tracing (1.821 ms) : 1804, 1837
.   : milestone, 1821,
section candidate
no_agent (1.182 ms) : 1171, 1194
.   : milestone, 1182,
iast (3.162 ms) : 3123, 3200
.   : milestone, 3162,
iast_FULL (5.664 ms) : 5608, 5720
.   : milestone, 5664,
iast_GLOBAL (3.632 ms) : 3565, 3699
.   : milestone, 3632,
profiling (2.091 ms) : 2071, 2110
.   : milestone, 2091,
tracing (1.794 ms) : 1779, 1810
.   : milestone, 1794,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.185 ms [1.174 ms, 1.197 ms]	-
iast	3.286 ms [3.242 ms, 3.331 ms]	2.101 ms (177.2%)
iast_FULL	5.84 ms [5.782 ms, 5.898 ms]	4.654 ms (392.6%)
iast_GLOBAL	3.617 ms [3.562 ms, 3.671 ms]	2.432 ms (205.1%)
profiling	2.048 ms [2.03 ms, 2.066 ms]	862.723 µs (72.8%)
tracing	1.821 ms [1.804 ms, 1.837 ms]	635.244 µs (53.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.182 ms [1.171 ms, 1.194 ms]	-
iast	3.162 ms [3.123 ms, 3.2 ms]	1.979 ms (167.4%)
iast_FULL	5.664 ms [5.608 ms, 5.72 ms]	4.482 ms (379.0%)
iast_GLOBAL	3.632 ms [3.565 ms, 3.699 ms]	2.45 ms (207.2%)
profiling	2.091 ms [2.071 ms, 2.11 ms]	908.091 µs (76.8%)
tracing	1.794 ms [1.779 ms, 1.81 ms]	611.962 µs (51.8%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~12ea5e4e93, baseline=1.61.0-SNAPSHOT~fd087771cb
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.207 ms) : 17039, 17376
.   : milestone, 17207,
appsec (18.737 ms) : 18547, 18927
.   : milestone, 18737,
code_origins (18.03 ms) : 17854, 18206
.   : milestone, 18030,
iast (18.028 ms) : 17848, 18207
.   : milestone, 18028,
profiling (18.947 ms) : 18756, 19138
.   : milestone, 18947,
tracing (17.658 ms) : 17481, 17834
.   : milestone, 17658,
section candidate
no_agent (19.277 ms) : 19083, 19472
.   : milestone, 19277,
appsec (18.438 ms) : 18254, 18623
.   : milestone, 18438,
code_origins (17.847 ms) : 17673, 18022
.   : milestone, 17847,
iast (17.874 ms) : 17697, 18052
.   : milestone, 17874,
profiling (18.64 ms) : 18450, 18829
.   : milestone, 18640,
tracing (18.611 ms) : 18427, 18796
.   : milestone, 18611,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.207 ms [17.039 ms, 17.376 ms]	-
appsec	18.737 ms [18.547 ms, 18.927 ms]	1.53 ms (8.9%)
code_origins	18.03 ms [17.854 ms, 18.206 ms]	822.571 µs (4.8%)
iast	18.028 ms [17.848 ms, 18.207 ms]	820.262 µs (4.8%)
profiling	18.947 ms [18.756 ms, 19.138 ms]	1.739 ms (10.1%)
tracing	17.658 ms [17.481 ms, 17.834 ms]	450.198 µs (2.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.277 ms [19.083 ms, 19.472 ms]	-
appsec	18.438 ms [18.254 ms, 18.623 ms]	-839.345 µs (-4.4%)
code_origins	17.847 ms [17.673 ms, 18.022 ms]	-1.43 ms (-7.4%)
iast	17.874 ms [17.697 ms, 18.052 ms]	-1.403 ms (-7.3%)
profiling	18.64 ms [18.45 ms, 18.829 ms]	-637.95 µs (-3.3%)
tracing	18.611 ms [18.427 ms, 18.796 ms]	-666.138 µs (-3.5%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/request-failures-tagging
git_commit_date	1774448623	1774611058
git_commit_sha	`fd08777`	`12ea5e4`
release_version	1.61.0-SNAPSHOT~fd087771cb	1.61.0-SNAPSHOT~12ea5e4e93

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1774612959	1774612959
ci_job_id	1544862994	1544862994
ci_pipeline_id	104735424	104735424
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-ya759395 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-ya759395 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~12ea5e4e93, baseline=1.61.0-SNAPSHOT~fd087771cb
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.467 ms) : 1456, 1479
.   : milestone, 1467,
appsec (3.781 ms) : 3559, 4003
.   : milestone, 3781,
iast (2.249 ms) : 2180, 2318
.   : milestone, 2249,
iast_GLOBAL (2.291 ms) : 2221, 2360
.   : milestone, 2291,
profiling (2.141 ms) : 2083, 2200
.   : milestone, 2141,
tracing (2.053 ms) : 2000, 2106
.   : milestone, 2053,
section candidate
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (3.798 ms) : 3576, 4019
.   : milestone, 3798,
iast (2.242 ms) : 2173, 2311
.   : milestone, 2242,
iast_GLOBAL (2.285 ms) : 2215, 2354
.   : milestone, 2285,
profiling (2.073 ms) : 2018, 2127
.   : milestone, 2073,
tracing (2.057 ms) : 2003, 2110
.   : milestone, 2057,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.467 ms [1.456 ms, 1.479 ms]	-
appsec	3.781 ms [3.559 ms, 4.003 ms]	2.314 ms (157.7%)
iast	2.249 ms [2.18 ms, 2.318 ms]	781.476 µs (53.3%)
iast_GLOBAL	2.291 ms [2.221 ms, 2.36 ms]	823.106 µs (56.1%)
profiling	2.141 ms [2.083 ms, 2.2 ms]	674.004 µs (45.9%)
tracing	2.053 ms [2.0 ms, 2.106 ms]	585.627 µs (39.9%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.471 ms [1.46 ms, 1.483 ms]	-
appsec	3.798 ms [3.576 ms, 4.019 ms]	2.327 ms (158.2%)
iast	2.242 ms [2.173 ms, 2.311 ms]	770.652 µs (52.4%)
iast_GLOBAL	2.285 ms [2.215 ms, 2.354 ms]	813.459 µs (55.3%)
profiling	2.073 ms [2.018 ms, 2.127 ms]	601.598 µs (40.9%)
tracing	2.057 ms [2.003 ms, 2.11 ms]	585.497 µs (39.8%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~12ea5e4e93, baseline=1.61.0-SNAPSHOT~fd087771cb
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.93 s) : 14930000, 14930000
.   : milestone, 14930000,
appsec (14.709 s) : 14709000, 14709000
.   : milestone, 14709000,
iast (18.374 s) : 18374000, 18374000
.   : milestone, 18374000,
iast_GLOBAL (18.083 s) : 18083000, 18083000
.   : milestone, 18083000,
profiling (15.42 s) : 15420000, 15420000
.   : milestone, 15420000,
tracing (14.917 s) : 14917000, 14917000
.   : milestone, 14917000,
section candidate
no_agent (15.549 s) : 15549000, 15549000
.   : milestone, 15549000,
appsec (14.955 s) : 14955000, 14955000
.   : milestone, 14955000,
iast (18.048 s) : 18048000, 18048000
.   : milestone, 18048000,
iast_GLOBAL (17.884 s) : 17884000, 17884000
.   : milestone, 17884000,
profiling (14.939 s) : 14939000, 14939000
.   : milestone, 14939000,
tracing (14.76 s) : 14760000, 14760000
.   : milestone, 14760000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.93 s [14.93 s, 14.93 s]	-
appsec	14.709 s [14.709 s, 14.709 s]	-221.0 ms (-1.5%)
iast	18.374 s [18.374 s, 18.374 s]	3.444 s (23.1%)
iast_GLOBAL	18.083 s [18.083 s, 18.083 s]	3.153 s (21.1%)
profiling	15.42 s [15.42 s, 15.42 s]	490.0 ms (3.3%)
tracing	14.917 s [14.917 s, 14.917 s]	-13.0 ms (-0.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.549 s [15.549 s, 15.549 s]	-
appsec	14.955 s [14.955 s, 14.955 s]	-594.0 ms (-3.8%)
iast	18.048 s [18.048 s, 18.048 s]	2.499 s (16.1%)
iast_GLOBAL	17.884 s [17.884 s, 17.884 s]	2.335 s (15.0%)
profiling	14.939 s [14.939 s, 14.939 s]	-610.0 ms (-3.9%)
tracing	14.76 s [14.76 s, 14.76 s]	-789.0 ms (-5.1%)

cit-pr-commenter-54b7da · 2026-03-25T17:32:02Z

Test Environment - okhttp

Job Status: success

Scenario	Overhead (%)
agent	19.15
agentless	18.31
agentlessCodeCoverage	20.66
agentlessLineCoverage	39.27

cit-pr-commenter-54b7da · 2026-03-25T17:44:07Z

Test Environment - spring_boot

Job Status: success

Scenario	Overhead (%)
agent	15.57
agentless	9.35
agentlessCodeCoverage	13.30
agentlessLineCoverage	33.25

cit-pr-commenter-54b7da · 2026-03-25T18:34:31Z

Test Environment - sonar-java

Job Status: success

Scenario	Overhead (%)
agent	6.30
agentless	5.21
agentlessCodeCoverage	89.77
agentlessLineCoverage	144.09

ygree · 2026-03-27T17:25:20Z

dd-java-agent/agent-ci-visibility/src/main/java/datadog/trace/civisibility/domain/TestImpl.java

-    if (configurationError) {
-      span.setTag(DDTags.CI_LIBRARY_CONFIGURATION_ERROR, true);
-    }
+    configurationErrors.applyTags(span);


ygree · 2026-03-27T17:27:22Z

...agent-ci-visibility/src/main/java/datadog/trace/civisibility/config/ConfigurationErrors.java

+    return settings || skippableTests || flakyTests || knownTests || testManagementTests;
+  }
+
+  public void applyTags(AgentSpan span) {


After this patch, the old tag disappears entirely and only the new per-request tags are emitted. Should it continue setting the old tag so that any legacy tag consumer can still detect an error?

feat: include configuration error tagging for all requests

075a83c

daniel-mohedano added type: enhancement Enhancements and improvements comp: ci visibility Continuous Integration Visibility labels Mar 25, 2026

daniel-mohedano marked this pull request as ready for review March 27, 2026 09:44

daniel-mohedano requested review from a team as code owners March 27, 2026 09:44

daniel-mohedano requested a review from ygree March 27, 2026 09:44

ci: trigger

12ea5e4

ygree reviewed Mar 27, 2026

View reviewed changes

Conversation

daniel-mohedano commented Mar 25, 2026 • edited by atlassian bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Contributor Checklist

Uh oh!

cit-pr-commenter-54b7da bot commented Mar 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - sbt-scalatest

Uh oh!

cit-pr-commenter-54b7da bot commented Mar 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - nebula-release-plugin

Uh oh!

cit-pr-commenter-54b7da bot commented Mar 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - netflix-zuul

Uh oh!

cit-pr-commenter-54b7da bot commented Mar 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - pass4s

Uh oh!

cit-pr-commenter-54b7da bot commented Mar 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - reactive-streams-jvm

Uh oh!

cit-pr-commenter-54b7da bot commented Mar 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - jolokia

Uh oh!

cit-pr-commenter-54b7da bot commented Mar 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - sonar-kotlin

Uh oh!

pr-commenter bot commented Mar 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

cit-pr-commenter-54b7da bot commented Mar 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - okhttp

Uh oh!

cit-pr-commenter-54b7da bot commented Mar 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - spring_boot

Uh oh!

cit-pr-commenter-54b7da bot commented Mar 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Environment - sonar-java

Uh oh!

ygree Mar 27, 2026

Choose a reason for hiding this comment

Uh oh!

ygree Mar 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

daniel-mohedano commented Mar 25, 2026 •

edited by atlassian bot

Loading

cit-pr-commenter-54b7da bot commented Mar 25, 2026 •

edited

Loading

cit-pr-commenter-54b7da bot commented Mar 25, 2026 •

edited

Loading

cit-pr-commenter-54b7da bot commented Mar 25, 2026 •

edited

Loading

cit-pr-commenter-54b7da bot commented Mar 25, 2026 •

edited

Loading

cit-pr-commenter-54b7da bot commented Mar 25, 2026 •

edited

Loading

cit-pr-commenter-54b7da bot commented Mar 25, 2026 •

edited

Loading

cit-pr-commenter-54b7da bot commented Mar 25, 2026 •

edited

Loading

pr-commenter bot commented Mar 25, 2026 •

edited

Loading

cit-pr-commenter-54b7da bot commented Mar 25, 2026 •

edited

Loading

cit-pr-commenter-54b7da bot commented Mar 25, 2026 •

edited

Loading

cit-pr-commenter-54b7da bot commented Mar 25, 2026 •

edited

Loading

ygree Mar 27, 2026 •

edited

Loading