Improve instrumentation JUnit testing by PerfectSlayer · Pull Request #11096 · DataDog/dd-trace-java

PerfectSlayer · 2026-04-13T13:47:40Z

What Does This Do

This PR fixes base instrumentation tests class to initialize the tracer from per method to per class to match Spock setupSpec() / cleanUpSpec().

It introduces a InstrumentationTestConfig to help with configuring the tests.
As the tracer is now initialized in a static @BeforeEach, the instrumentation test config must be done in a static initializer block like:

class MyTest extends AbstractInstrumentationTest {
    static {
        testConfig.idGenerationStrategy("RANDOM").strictTraceWrites(false);
    }
}

Not ideal but it could have been worse. Not many tests should changed the default configuration any way.

Additionally, it improves error reports, add missing default tags to tag assert, and fix case when span link matchers are missing.

Motivation

This is the current behavior from the Spock specification and the per method was killing test execution performance.

Additional Notes

This PR is part of some bigger improvements in stacked PRs:

Contributor Checklist

Format the title according to the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any other useful labels
Avoid using close, fix, or any linking keywords when referencing an issue
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, migration, or deletion
Update public documentation with any new configuration flags or behaviors

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

pr-commenter · 2026-04-13T14:36:26Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/groovy-to-java-instrumented-tests
git_commit_date	1776382763	1776425144
git_commit_sha	`8b1580f`	`9d9228c`
release_version	1.62.0-SNAPSHOT~8b1580f2ad	1.62.0-SNAPSHOT~9d9228c11a

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1776430338	1776430338
ci_job_id	1605309020	1605309020
ci_pipeline_id	108219055	108219055
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-gmpj0vir 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-gmpj0vir 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 64 metrics, 7 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~9d9228c11a, baseline=1.62.0-SNAPSHOT~8b1580f2ad

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.056 s) : 0, 1055790
Total [baseline] (8.822 s) : 0, 8821651
Agent [candidate] (1.059 s) : 0, 1058610
Total [candidate] (8.851 s) : 0, 8850626
section iast
Agent [baseline] (1.225 s) : 0, 1224725
Total [baseline] (9.615 s) : 0, 9615070
Agent [candidate] (1.226 s) : 0, 1226439
Total [candidate] (9.566 s) : 0, 9566366

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.056 s	-
Agent	iast	1.225 s	168.935 ms (16.0%)
Total	tracing	8.822 s	-
Total	iast	9.615 s	793.419 ms (9.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.059 s	-
Agent	iast	1.226 s	167.829 ms (15.9%)
Total	tracing	8.851 s	-
Total	iast	9.566 s	715.741 ms (8.1%)

gantt
    title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~9d9228c11a, baseline=1.62.0-SNAPSHOT~8b1580f2ad

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.226 ms) : 0, 1226
crashtracking [candidate] (1.219 ms) : 0, 1219
BytebuddyAgent [baseline] (632.882 ms) : 0, 632882
BytebuddyAgent [candidate] (632.785 ms) : 0, 632785
AgentMeter [baseline] (29.495 ms) : 0, 29495
AgentMeter [candidate] (29.315 ms) : 0, 29315
GlobalTracer [baseline] (249.011 ms) : 0, 249011
GlobalTracer [candidate] (248.521 ms) : 0, 248521
AppSec [baseline] (32.425 ms) : 0, 32425
AppSec [candidate] (32.357 ms) : 0, 32357
Debugger [baseline] (59.158 ms) : 0, 59158
Debugger [candidate] (59.238 ms) : 0, 59238
Remote Config [baseline] (606.159 µs) : 0, 606
Remote Config [candidate] (587.845 µs) : 0, 588
Telemetry [baseline] (8.098 ms) : 0, 8098
Telemetry [candidate] (8.005 ms) : 0, 8005
Flare Poller [baseline] (6.611 ms) : 0, 6611
Flare Poller [candidate] (10.476 ms) : 0, 10476
section iast
crashtracking [baseline] (1.245 ms) : 0, 1245
crashtracking [candidate] (1.235 ms) : 0, 1235
BytebuddyAgent [baseline] (801.441 ms) : 0, 801441
BytebuddyAgent [candidate] (804.577 ms) : 0, 804577
AgentMeter [baseline] (11.436 ms) : 0, 11436
AgentMeter [candidate] (11.558 ms) : 0, 11558
GlobalTracer [baseline] (239.622 ms) : 0, 239622
GlobalTracer [candidate] (238.062 ms) : 0, 238062
AppSec [baseline] (30.429 ms) : 0, 30429
AppSec [candidate] (32.792 ms) : 0, 32792
Debugger [baseline] (64.998 ms) : 0, 64998
Debugger [candidate] (62.798 ms) : 0, 62798
Remote Config [baseline] (548.77 µs) : 0, 549
Remote Config [candidate] (544.513 µs) : 0, 545
Telemetry [baseline] (9.422 ms) : 0, 9422
Telemetry [candidate] (9.334 ms) : 0, 9334
Flare Poller [baseline] (3.608 ms) : 0, 3608
Flare Poller [candidate] (3.516 ms) : 0, 3516
IAST [baseline] (25.829 ms) : 0, 25829
IAST [candidate] (25.748 ms) : 0, 25748

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~9d9228c11a, baseline=1.62.0-SNAPSHOT~8b1580f2ad

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.057 s) : 0, 1057390
Total [baseline] (11.048 s) : 0, 11048274
Agent [candidate] (1.057 s) : 0, 1057300
Total [candidate] (11.101 s) : 0, 11100621
section appsec
Agent [baseline] (1.248 s) : 0, 1248463
Total [baseline] (11.201 s) : 0, 11201261
Agent [candidate] (1.258 s) : 0, 1257511
Total [candidate] (11.143 s) : 0, 11143436
section iast
Agent [baseline] (1.222 s) : 0, 1222428
Total [baseline] (11.318 s) : 0, 11318209
Agent [candidate] (1.226 s) : 0, 1225919
Total [candidate] (11.41 s) : 0, 11409518
section profiling
Agent [baseline] (1.186 s) : 0, 1186395
Total [baseline] (11.07 s) : 0, 11070173
Agent [candidate] (1.188 s) : 0, 1187955
Total [candidate] (11.107 s) : 0, 11107335

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.057 s	-
Agent	appsec	1.248 s	191.073 ms (18.1%)
Agent	iast	1.222 s	165.038 ms (15.6%)
Agent	profiling	1.186 s	129.005 ms (12.2%)
Total	tracing	11.048 s	-
Total	appsec	11.201 s	152.987 ms (1.4%)
Total	iast	11.318 s	269.935 ms (2.4%)
Total	profiling	11.07 s	21.899 ms (0.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.057 s	-
Agent	appsec	1.258 s	200.211 ms (18.9%)
Agent	iast	1.226 s	168.619 ms (15.9%)
Agent	profiling	1.188 s	130.655 ms (12.4%)
Total	tracing	11.101 s	-
Total	appsec	11.143 s	42.816 ms (0.4%)
Total	iast	11.41 s	308.898 ms (2.8%)
Total	profiling	11.107 s	6.715 ms (0.1%)

gantt
    title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~9d9228c11a, baseline=1.62.0-SNAPSHOT~8b1580f2ad

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.217 ms) : 0, 1217
crashtracking [candidate] (1.218 ms) : 0, 1218
BytebuddyAgent [baseline] (632.208 ms) : 0, 632208
BytebuddyAgent [candidate] (632.921 ms) : 0, 632921
AgentMeter [baseline] (29.231 ms) : 0, 29231
AgentMeter [candidate] (29.362 ms) : 0, 29362
GlobalTracer [baseline] (248.444 ms) : 0, 248444
GlobalTracer [candidate] (249.321 ms) : 0, 249321
AppSec [baseline] (32.316 ms) : 0, 32316
AppSec [candidate] (32.434 ms) : 0, 32434
Debugger [baseline] (59.926 ms) : 0, 59926
Debugger [candidate] (60.273 ms) : 0, 60273
Remote Config [baseline] (590.235 µs) : 0, 590
Remote Config [candidate] (600.763 µs) : 0, 601
Telemetry [baseline] (8.057 ms) : 0, 8057
Telemetry [candidate] (8.103 ms) : 0, 8103
Flare Poller [baseline] (9.203 ms) : 0, 9203
Flare Poller [candidate] (6.824 ms) : 0, 6824
section appsec
crashtracking [baseline] (1.227 ms) : 0, 1227
crashtracking [candidate] (1.221 ms) : 0, 1221
BytebuddyAgent [baseline] (661.657 ms) : 0, 661657
BytebuddyAgent [candidate] (667.478 ms) : 0, 667478
AgentMeter [baseline] (12.136 ms) : 0, 12136
AgentMeter [candidate] (12.181 ms) : 0, 12181
GlobalTracer [baseline] (249.412 ms) : 0, 249412
GlobalTracer [candidate] (250.34 ms) : 0, 250340
AppSec [baseline] (185.034 ms) : 0, 185034
AppSec [candidate] (186.158 ms) : 0, 186158
Debugger [baseline] (65.705 ms) : 0, 65705
Debugger [candidate] (66.358 ms) : 0, 66358
Remote Config [baseline] (604.768 µs) : 0, 605
Remote Config [candidate] (605.631 µs) : 0, 606
Telemetry [baseline] (8.366 ms) : 0, 8366
Telemetry [candidate] (8.422 ms) : 0, 8422
Flare Poller [baseline] (3.5 ms) : 0, 3500
Flare Poller [candidate] (3.543 ms) : 0, 3543
IAST [baseline] (24.434 ms) : 0, 24434
IAST [candidate] (24.653 ms) : 0, 24653
section iast
crashtracking [baseline] (1.218 ms) : 0, 1218
crashtracking [candidate] (1.219 ms) : 0, 1219
BytebuddyAgent [baseline] (799.173 ms) : 0, 799173
BytebuddyAgent [candidate] (802.061 ms) : 0, 802061
AgentMeter [baseline] (11.43 ms) : 0, 11430
AgentMeter [candidate] (11.514 ms) : 0, 11514
GlobalTracer [baseline] (238.586 ms) : 0, 238586
GlobalTracer [candidate] (239.383 ms) : 0, 239383
AppSec [baseline] (31.24 ms) : 0, 31240
AppSec [candidate] (33.668 ms) : 0, 33668
Debugger [baseline] (65.355 ms) : 0, 65355
Debugger [candidate] (62.674 ms) : 0, 62674
Remote Config [baseline] (541.23 µs) : 0, 541
Remote Config [candidate] (547.556 µs) : 0, 548
Telemetry [baseline] (9.395 ms) : 0, 9395
Telemetry [candidate] (9.292 ms) : 0, 9292
Flare Poller [baseline] (3.549 ms) : 0, 3549
Flare Poller [candidate] (3.497 ms) : 0, 3497
IAST [baseline] (25.799 ms) : 0, 25799
IAST [candidate] (25.932 ms) : 0, 25932
section profiling
crashtracking [baseline] (1.184 ms) : 0, 1184
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (693.436 ms) : 0, 693436
BytebuddyAgent [candidate] (692.383 ms) : 0, 692383
AgentMeter [baseline] (9.001 ms) : 0, 9001
AgentMeter [candidate] (9.153 ms) : 0, 9153
GlobalTracer [baseline] (207.281 ms) : 0, 207281
GlobalTracer [candidate] (208.201 ms) : 0, 208201
AppSec [baseline] (32.814 ms) : 0, 32814
AppSec [candidate] (32.972 ms) : 0, 32972
Debugger [baseline] (65.478 ms) : 0, 65478
Debugger [candidate] (65.841 ms) : 0, 65841
Remote Config [baseline] (570.857 µs) : 0, 571
Remote Config [candidate] (572.778 µs) : 0, 573
Telemetry [baseline] (7.8 ms) : 0, 7800
Telemetry [candidate] (7.895 ms) : 0, 7895
Flare Poller [baseline] (3.573 ms) : 0, 3573
Flare Poller [candidate] (3.613 ms) : 0, 3613
ProfilingAgent [baseline] (93.751 ms) : 0, 93751
ProfilingAgent [candidate] (94.669 ms) : 0, 94669
Profiling [baseline] (94.314 ms) : 0, 94314
Profiling [candidate] (95.232 ms) : 0, 95232

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/groovy-to-java-instrumented-tests
git_commit_date	1776382763	1776425144
git_commit_sha	`8b1580f`	`9d9228c`
release_version	1.62.0-SNAPSHOT~8b1580f2ad	1.62.0-SNAPSHOT~9d9228c11a

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1776430813	1776430813
ci_job_id	1605309023	1605309023
ci_pipeline_id	108219055	108219055
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-u2trkxzl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-u2trkxzl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 15 metrics, 19 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:iast:high_load	worse [+122.372µs; +233.681µs] or [+4.925%; +9.405%]	unsure [+98.981µs; +586.973µs] or [+1.352%; +8.020%]	unstable [-233.030op/s; +83.405op/s] or [-16.302%; +5.835%]	2.663ms	7.662ms	1354.688op/s	2.485ms	7.319ms	1429.500op/s
scenario:load:petclinic:profiling:high_load	better [-1600.660µs; -397.498µs] or [-8.671%; -2.153%]	unsure [-2.916ms; -0.330ms] or [-9.780%; -1.106%]	unstable [-22.826op/s; +38.889op/s] or [-9.148%; +15.585%]	17.461ms	28.193ms	257.562op/s	18.461ms	29.816ms	249.531op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~9d9228c11a, baseline=1.62.0-SNAPSHOT~8b1580f2ad
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.257 ms) : 1245, 1270
.   : milestone, 1257,
iast (3.2 ms) : 3151, 3249
.   : milestone, 3200,
iast_FULL (5.991 ms) : 5931, 6050
.   : milestone, 5991,
iast_GLOBAL (3.615 ms) : 3561, 3669
.   : milestone, 3615,
profiling (2.197 ms) : 2177, 2217
.   : milestone, 2197,
tracing (1.929 ms) : 1913, 1945
.   : milestone, 1929,
section candidate
no_agent (1.257 ms) : 1245, 1270
.   : milestone, 1257,
iast (3.38 ms) : 3338, 3422
.   : milestone, 3380,
iast_FULL (6.149 ms) : 6084, 6214
.   : milestone, 6149,
iast_GLOBAL (3.646 ms) : 3585, 3708
.   : milestone, 3646,
profiling (2.209 ms) : 2186, 2232
.   : milestone, 2209,
tracing (1.86 ms) : 1845, 1875
.   : milestone, 1860,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.257 ms [1.245 ms, 1.27 ms]	-
iast	3.2 ms [3.151 ms, 3.249 ms]	1.943 ms (154.5%)
iast_FULL	5.991 ms [5.931 ms, 6.05 ms]	4.733 ms (376.5%)
iast_GLOBAL	3.615 ms [3.561 ms, 3.669 ms]	2.358 ms (187.5%)
profiling	2.197 ms [2.177 ms, 2.217 ms]	939.37 µs (74.7%)
tracing	1.929 ms [1.913 ms, 1.945 ms]	671.74 µs (53.4%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.257 ms [1.245 ms, 1.27 ms]	-
iast	3.38 ms [3.338 ms, 3.422 ms]	2.123 ms (168.9%)
iast_FULL	6.149 ms [6.084 ms, 6.214 ms]	4.892 ms (389.1%)
iast_GLOBAL	3.646 ms [3.585 ms, 3.708 ms]	2.389 ms (190.0%)
profiling	2.209 ms [2.186 ms, 2.232 ms]	951.664 µs (75.7%)
tracing	1.86 ms [1.845 ms, 1.875 ms]	602.773 µs (47.9%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~9d9228c11a, baseline=1.62.0-SNAPSHOT~8b1580f2ad
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.348 ms) : 18164, 18532
.   : milestone, 18348,
appsec (18.904 ms) : 18712, 19096
.   : milestone, 18904,
code_origins (17.79 ms) : 17614, 17965
.   : milestone, 17790,
iast (18.568 ms) : 18385, 18752
.   : milestone, 18568,
profiling (18.698 ms) : 18512, 18884
.   : milestone, 18698,
tracing (17.87 ms) : 17694, 18047
.   : milestone, 17870,
section candidate
no_agent (18.349 ms) : 18156, 18541
.   : milestone, 18349,
appsec (18.609 ms) : 18420, 18798
.   : milestone, 18609,
code_origins (17.58 ms) : 17410, 17750
.   : milestone, 17580,
iast (18.704 ms) : 18515, 18893
.   : milestone, 18704,
profiling (18.112 ms) : 17934, 18290
.   : milestone, 18112,
tracing (18.16 ms) : 17981, 18338
.   : milestone, 18160,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.348 ms [18.164 ms, 18.532 ms]	-
appsec	18.904 ms [18.712 ms, 19.096 ms]	555.76 µs (3.0%)
code_origins	17.79 ms [17.614 ms, 17.965 ms]	-558.121 µs (-3.0%)
iast	18.568 ms [18.385 ms, 18.752 ms]	220.445 µs (1.2%)
profiling	18.698 ms [18.512 ms, 18.884 ms]	349.951 µs (1.9%)
tracing	17.87 ms [17.694 ms, 18.047 ms]	-477.909 µs (-2.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.349 ms [18.156 ms, 18.541 ms]	-
appsec	18.609 ms [18.42 ms, 18.798 ms]	260.375 µs (1.4%)
code_origins	17.58 ms [17.41 ms, 17.75 ms]	-768.708 µs (-4.2%)
iast	18.704 ms [18.515 ms, 18.893 ms]	355.639 µs (1.9%)
profiling	18.112 ms [17.934 ms, 18.29 ms]	-236.687 µs (-1.3%)
tracing	18.16 ms [17.981 ms, 18.338 ms]	-188.951 µs (-1.0%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/groovy-to-java-instrumented-tests
git_commit_date	1776382763	1776425144
git_commit_sha	`8b1580f`	`9d9228c`
release_version	1.62.0-SNAPSHOT~8b1580f2ad	1.62.0-SNAPSHOT~9d9228c11a

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1776430511	1776430511
ci_job_id	1605309025	1605309025
ci_pipeline_id	108219055	108219055
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-wg26kfq0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-wg26kfq0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 1 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:dacapo:tomcat:appsec	better [-1.361ms; -1.020ms] or [-36.497%; -27.369%]	2.538ms	3.728ms

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~9d9228c11a, baseline=1.62.0-SNAPSHOT~8b1580f2ad
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.487 ms) : 1476, 1499
.   : milestone, 1487,
appsec (3.728 ms) : 3512, 3945
.   : milestone, 3728,
iast (2.274 ms) : 2204, 2344
.   : milestone, 2274,
iast_GLOBAL (2.307 ms) : 2237, 2376
.   : milestone, 2307,
profiling (2.094 ms) : 2039, 2148
.   : milestone, 2094,
tracing (2.098 ms) : 2044, 2152
.   : milestone, 2098,
section candidate
no_agent (1.487 ms) : 1475, 1499
.   : milestone, 1487,
appsec (2.538 ms) : 2483, 2593
.   : milestone, 2538,
iast (2.27 ms) : 2201, 2340
.   : milestone, 2270,
iast_GLOBAL (2.304 ms) : 2235, 2374
.   : milestone, 2304,
profiling (2.534 ms) : 2369, 2700
.   : milestone, 2534,
tracing (2.08 ms) : 2027, 2134
.   : milestone, 2080,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.487 ms [1.476 ms, 1.499 ms]	-
appsec	3.728 ms [3.512 ms, 3.945 ms]	2.241 ms (150.7%)
iast	2.274 ms [2.204 ms, 2.344 ms]	786.515 µs (52.9%)
iast_GLOBAL	2.307 ms [2.237 ms, 2.376 ms]	819.419 µs (55.1%)
profiling	2.094 ms [2.039 ms, 2.148 ms]	606.275 µs (40.8%)
tracing	2.098 ms [2.044 ms, 2.152 ms]	610.803 µs (41.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.487 ms [1.475 ms, 1.499 ms]	-
appsec	2.538 ms [2.483 ms, 2.593 ms]	1.051 ms (70.7%)
iast	2.27 ms [2.201 ms, 2.34 ms]	783.171 µs (52.7%)
iast_GLOBAL	2.304 ms [2.235 ms, 2.374 ms]	817.167 µs (55.0%)
profiling	2.534 ms [2.369 ms, 2.7 ms]	1.047 ms (70.4%)
tracing	2.08 ms [2.027 ms, 2.134 ms]	593.362 µs (39.9%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~9d9228c11a, baseline=1.62.0-SNAPSHOT~8b1580f2ad
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.504 s) : 15504000, 15504000
.   : milestone, 15504000,
appsec (15.067 s) : 15067000, 15067000
.   : milestone, 15067000,
iast (17.973 s) : 17973000, 17973000
.   : milestone, 17973000,
iast_GLOBAL (17.827 s) : 17827000, 17827000
.   : milestone, 17827000,
profiling (14.852 s) : 14852000, 14852000
.   : milestone, 14852000,
tracing (14.767 s) : 14767000, 14767000
.   : milestone, 14767000,
section candidate
no_agent (15.677 s) : 15677000, 15677000
.   : milestone, 15677000,
appsec (14.947 s) : 14947000, 14947000
.   : milestone, 14947000,
iast (18.263 s) : 18263000, 18263000
.   : milestone, 18263000,
iast_GLOBAL (17.972 s) : 17972000, 17972000
.   : milestone, 17972000,
profiling (15.51 s) : 15510000, 15510000
.   : milestone, 15510000,
tracing (15.146 s) : 15146000, 15146000
.   : milestone, 15146000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.504 s [15.504 s, 15.504 s]	-
appsec	15.067 s [15.067 s, 15.067 s]	-437.0 ms (-2.8%)
iast	17.973 s [17.973 s, 17.973 s]	2.469 s (15.9%)
iast_GLOBAL	17.827 s [17.827 s, 17.827 s]	2.323 s (15.0%)
profiling	14.852 s [14.852 s, 14.852 s]	-652.0 ms (-4.2%)
tracing	14.767 s [14.767 s, 14.767 s]	-737.0 ms (-4.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.677 s [15.677 s, 15.677 s]	-
appsec	14.947 s [14.947 s, 14.947 s]	-730.0 ms (-4.7%)
iast	18.263 s [18.263 s, 18.263 s]	2.586 s (16.5%)
iast_GLOBAL	17.972 s [17.972 s, 17.972 s]	2.295 s (14.6%)
profiling	15.51 s [15.51 s, 15.51 s]	-167.0 ms (-1.1%)
tracing	15.146 s [15.146 s, 15.146 s]	-531.0 ms (-3.4%)

So child classes can benefits from class level configs and we can configure the tracer for example

…tension Move DD_* environment variable and dd.* system property validation logic from DDJavaSpecification into a reusable CleanConfigStateExtension. Improves error reporting with detailed leak information.

Fix tracer initialization from per method to per class to match Spock setupSpec() / cleanUpSpec()

PerfectSlayer requested a review from a team as a code owner April 13, 2026 13:47

PerfectSlayer requested a review from ygree April 13, 2026 13:47

PerfectSlayer added type: bug Bug report and fix comp: testing Testing tag: performance Performance related changes tag: ai generated Largely based on code generated by an AI or LLM labels Apr 13, 2026

PerfectSlayer mentioned this pull request Apr 13, 2026

Improve Config JUnit extension #11094

Merged

PerfectSlayer changed the title ~~fix(junit): Setup tracer per class only~~ Fix test tracer setup per class only Apr 13, 2026

PerfectSlayer changed the title ~~Fix test tracer setup per class only~~ Improve instrumentation JUnit testing Apr 13, 2026

This was referenced Apr 13, 2026

Add unit and instrumentation test documentation for JUnit #11097

Open

Migrate OpenTelemetry instrumentation tests to JUnit #11081

Draft

bric3 approved these changes Apr 15, 2026

View reviewed changes

PerfectSlayer added 3 commits April 17, 2026 09:24

feat(junit): Fix @WithConfig to be applied at any level

e749671

fix(junit): Only rebuild config once

8f6e54b

fix(junit): Apply class level configuration at @beforeeach level

b37c48c

So child classes can benefits from class level configs and we can configure the tracer for example

PerfectSlayer force-pushed the bbujon/groovy-to-java-config branch from 8d727de to cd97498 Compare April 17, 2026 07:27

PerfectSlayer added 6 commits April 17, 2026 13:25

feat(test): Extract config cleanup assertions into dedicated JUnit ex…

7536862

…tension Move DD_* environment variable and dd.* system property validation logic from DDJavaSpecification into a reusable CleanConfigStateExtension. Improves error reporting with detailed leak information.

feat(junit): Improve generated code readability

af45d6c

fix(junit): Setup tracer per class only

20c8e7b

Fix tracer initialization from per method to per class to match Spock setupSpec() / cleanUpSpec()

feat(testing): Improve error messages

6e1b214

fix(testing): Fix span links assertion

9d49c2a

feat(testing): Refine default tags

9d9228c

PerfectSlayer force-pushed the bbujon/groovy-to-java-config branch from cd97498 to af45d6c Compare April 17, 2026 11:26

PerfectSlayer force-pushed the bbujon/groovy-to-java-instrumented-tests branch from 1d931de to 9d9228c Compare April 17, 2026 12:23

Base automatically changed from bbujon/groovy-to-java-config to master April 17, 2026 13:31

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Improve instrumentation JUnit testing #11096

Improve instrumentation JUnit testing #11096
PerfectSlayer wants to merge 9 commits intomasterfrom
bbujon/groovy-to-java-instrumented-tests

PerfectSlayer commented Apr 13, 2026 •

edited

Loading

Uh oh!

pr-commenter bot commented Apr 13, 2026 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

PerfectSlayer commented Apr 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Apr 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

PerfectSlayer commented Apr 13, 2026 •

edited

Loading

pr-commenter bot commented Apr 13, 2026 •

edited

Loading