Skip to content

feat: improvements to line level granularity in per-test coverage#11122

Draft
daniel-mohedano wants to merge 2 commits intomasterfrom
daniel.mohedano/line-coverage-improvements
Draft

feat: improvements to line level granularity in per-test coverage#11122
daniel-mohedano wants to merge 2 commits intomasterfrom
daniel.mohedano/line-coverage-improvements

Conversation

@daniel-mohedano
Copy link
Copy Markdown
Contributor

@daniel-mohedano daniel-mohedano commented Apr 15, 2026

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@daniel-mohedano daniel-mohedano added type: enhancement Enhancements and improvements comp: ci visibility Continuous Integration Visibility labels Apr 15, 2026
@cit-pr-commenter-54b7da
Copy link
Copy Markdown

cit-pr-commenter-54b7da bot commented Apr 15, 2026 •
edited
Loading

Test Environment - sbt-scalatest

Job Status: success

Scenario Overhead (%)
agent 55.99
agentEvpProxy 56.03

@cit-pr-commenter-54b7da
Copy link
Copy Markdown

cit-pr-commenter-54b7da bot commented Apr 15, 2026 •
edited
Loading

Test Environment - nebula-release-plugin

Job Status: success

Scenario Overhead (%)
agent 36.35
agentless 34.98
agentlessCodeCoverage 43.69
agentlessLineCoverage 72.74

@cit-pr-commenter-54b7da
Copy link
Copy Markdown

cit-pr-commenter-54b7da bot commented Apr 15, 2026 •
edited
Loading

Test Environment - netflix-zuul

Job Status: failed

Scenario Overhead (%)
agent 88.37
agentless 81.81
agentlessCodeCoverage 97.58
agentlessLineCoverage 122.18

@cit-pr-commenter-54b7da
Copy link
Copy Markdown

cit-pr-commenter-54b7da bot commented Apr 15, 2026 •
edited
Loading

Test Environment - pass4s

Job Status: success

Scenario Overhead (%)
agent 4.95
agentless 5.51
agentlessCodeCoverage 13.90

@cit-pr-commenter-54b7da
Copy link
Copy Markdown

cit-pr-commenter-54b7da bot commented Apr 15, 2026 •
edited
Loading

Test Environment - reactive-streams-jvm

Job Status: success

Scenario Overhead (%)
agent 19.78
agentless 18.59
agentlessCodeCoverage 19.45
agentlessLineCoverage 28.17

@cit-pr-commenter-54b7da
Copy link
Copy Markdown

cit-pr-commenter-54b7da bot commented Apr 15, 2026 •
edited
Loading

Test Environment - jolokia

Job Status: success

Scenario Overhead (%)
agent 93.34
agentless 88.50
agentlessCodeCoverage 96.93
agentlessLineCoverage 99.04

@cit-pr-commenter-54b7da
Copy link
Copy Markdown

cit-pr-commenter-54b7da bot commented Apr 15, 2026 •
edited
Loading

Test Environment - sonar-kotlin

Job Status: success

Scenario Overhead (%)
agent 12.74
agentless 12.15
agentlessCodeCoverage 15.78
agentlessLineCoverage 28.09

@cit-pr-commenter-54b7da
Copy link
Copy Markdown

cit-pr-commenter-54b7da bot commented Apr 15, 2026 •
edited
Loading

Test Environment - okhttp

Job Status: failed

Scenario Overhead (%)
agent 18.88
agentless 19.77
agentlessCodeCoverage 23.11
agentlessLineCoverage 94.67

@cit-pr-commenter-54b7da
Copy link
Copy Markdown

cit-pr-commenter-54b7da bot commented Apr 15, 2026 •
edited
Loading

Test Environment - sonar-java

Job Status: success

Scenario Overhead (%)
agent -9.59
agentless -0.10
agentlessCodeCoverage 94.95
agentlessLineCoverage 131.33

@cit-pr-commenter-54b7da
Copy link
Copy Markdown

cit-pr-commenter-54b7da bot commented Apr 15, 2026 •
edited
Loading

Test Environment - spring_boot

Job Status: success

Scenario Overhead (%)
agent 15.50
agentless 9.52
agentlessCodeCoverage 13.79
agentlessLineCoverage 26.52

@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Apr 15, 2026 •
edited
Loading

Benchmarks

⚠️ Warning: Baseline build not found for merge-base commit. Comparing against the latest commit on master instead.

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/line-coverage-improvements
git_commit_date 1776286005 1776333319
git_commit_sha 42f154d 9922250
release_version 1.62.0-SNAPSHOT~42f154d2f6 1.62.0-SNAPSHOT~9922250541
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776335271 1776335271
ci_job_id 1600732971 1600732971
ci_pipeline_id 107968524 107968524
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-ry8hdq7q 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-ry8hdq7q 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 10 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~9922250541, baseline=1.62.0-SNAPSHOT~42f154d2f6

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1058698
Total [baseline] (8.883 s) : 0, 8883111
Agent [candidate] (1.063 s) : 0, 1063201
Total [candidate] (8.938 s) : 0, 8938473
section iast
Agent [baseline] (1.231 s) : 0, 1230641
Total [baseline] (9.595 s) : 0, 9594776
Agent [candidate] (1.231 s) : 0, 1230579
Total [candidate] (9.59 s) : 0, 9590024
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent iast 1.231 s 171.944 ms (16.2%)
Total tracing 8.883 s -
Total iast 9.595 s 711.665 ms (8.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent iast 1.231 s 167.377 ms (15.7%)
Total tracing 8.938 s -
Total iast 9.59 s 651.551 ms (7.3%) 
gantt
    title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~9922250541, baseline=1.62.0-SNAPSHOT~42f154d2f6

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.248 ms) : 0, 1248
crashtracking [candidate] (1.226 ms) : 0, 1226
BytebuddyAgent [baseline] (633.742 ms) : 0, 633742
BytebuddyAgent [candidate] (637.28 ms) : 0, 637280
AgentMeter [baseline] (29.458 ms) : 0, 29458
AgentMeter [candidate] (29.611 ms) : 0, 29611
GlobalTracer [baseline] (249.421 ms) : 0, 249421
GlobalTracer [candidate] (250.371 ms) : 0, 250371
AppSec [baseline] (32.401 ms) : 0, 32401
AppSec [candidate] (32.267 ms) : 0, 32267
Debugger [baseline] (59.445 ms) : 0, 59445
Debugger [candidate] (59.476 ms) : 0, 59476
Remote Config [baseline] (599.152 µs) : 0, 599
Remote Config [candidate] (591.778 µs) : 0, 592
Telemetry [baseline] (8.061 ms) : 0, 8061
Telemetry [candidate] (8.044 ms) : 0, 8044
Flare Poller [baseline] (8.16 ms) : 0, 8160
Flare Poller [candidate] (8.216 ms) : 0, 8216
section iast
crashtracking [baseline] (1.237 ms) : 0, 1237
crashtracking [candidate] (1.231 ms) : 0, 1231
BytebuddyAgent [baseline] (806.013 ms) : 0, 806013
BytebuddyAgent [candidate] (807.362 ms) : 0, 807362
AgentMeter [baseline] (11.387 ms) : 0, 11387
AgentMeter [candidate] (11.467 ms) : 0, 11467
GlobalTracer [baseline] (240.345 ms) : 0, 240345
GlobalTracer [candidate] (239.282 ms) : 0, 239282
IAST [baseline] (25.815 ms) : 0, 25815
IAST [candidate] (26.107 ms) : 0, 26107
AppSec [baseline] (32.341 ms) : 0, 32341
AppSec [candidate] (32.698 ms) : 0, 32698
Debugger [baseline] (61.462 ms) : 0, 61462
Debugger [candidate] (57.354 ms) : 0, 57354
Remote Config [baseline] (542.764 µs) : 0, 543
Remote Config [candidate] (525.554 µs) : 0, 526
Telemetry [baseline] (11.849 ms) : 0, 11849
Telemetry [candidate] (14.446 ms) : 0, 14446
Flare Poller [baseline] (3.47 ms) : 0, 3470
Flare Poller [candidate] (3.465 ms) : 0, 3465
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~9922250541, baseline=1.62.0-SNAPSHOT~42f154d2f6

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1065498
Total [baseline] (11.112 s) : 0, 11111765
Agent [candidate] (1.053 s) : 0, 1053074
Total [candidate] (11.089 s) : 0, 11088866
section appsec
Agent [baseline] (1.257 s) : 0, 1257309
Total [baseline] (11.231 s) : 0, 11231031
Agent [candidate] (1.264 s) : 0, 1264311
Total [candidate] (11.148 s) : 0, 11147826
section iast
Agent [baseline] (1.232 s) : 0, 1232353
Total [baseline] (11.338 s) : 0, 11337838
Agent [candidate] (1.223 s) : 0, 1222717
Total [candidate] (11.347 s) : 0, 11346661
section profiling
Agent [baseline] (1.195 s) : 0, 1194573
Total [baseline] (11.095 s) : 0, 11095354
Agent [candidate] (1.193 s) : 0, 1192667
Total [candidate] (11.142 s) : 0, 11142056
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent appsec 1.257 s 191.811 ms (18.0%)
Agent iast 1.232 s 166.855 ms (15.7%)
Agent profiling 1.195 s 129.075 ms (12.1%)
Total tracing 11.112 s -
Total appsec 11.231 s 119.267 ms (1.1%)
Total iast 11.338 s 226.073 ms (2.0%)
Total profiling 11.095 s -16.411 ms (-0.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent appsec 1.264 s 211.237 ms (20.1%)
Agent iast 1.223 s 169.644 ms (16.1%)
Agent profiling 1.193 s 139.593 ms (13.3%)
Total tracing 11.089 s -
Total appsec 11.148 s 58.96 ms (0.5%)
Total iast 11.347 s 257.795 ms (2.3%)
Total profiling 11.142 s 53.19 ms (0.5%) 
gantt
    title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~9922250541, baseline=1.62.0-SNAPSHOT~42f154d2f6

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.258 ms) : 0, 1258
crashtracking [candidate] (1.225 ms) : 0, 1225
BytebuddyAgent [baseline] (637.388 ms) : 0, 637388
BytebuddyAgent [candidate] (630.98 ms) : 0, 630980
AgentMeter [baseline] (29.666 ms) : 0, 29666
AgentMeter [candidate] (29.359 ms) : 0, 29359
GlobalTracer [baseline] (251.083 ms) : 0, 251083
GlobalTracer [candidate] (248.927 ms) : 0, 248927
AppSec [baseline] (32.661 ms) : 0, 32661
AppSec [candidate] (31.905 ms) : 0, 31905
Debugger [baseline] (60.151 ms) : 0, 60151
Debugger [candidate] (59.891 ms) : 0, 59891
Remote Config [baseline] (590.452 µs) : 0, 590
Remote Config [candidate] (593.777 µs) : 0, 594
Telemetry [baseline] (8.05 ms) : 0, 8050
Telemetry [candidate] (8.079 ms) : 0, 8079
Flare Poller [baseline] (8.28 ms) : 0, 8280
Flare Poller [candidate] (5.898 ms) : 0, 5898
section appsec
crashtracking [baseline] (1.236 ms) : 0, 1236
crashtracking [candidate] (1.239 ms) : 0, 1239
BytebuddyAgent [baseline] (665.542 ms) : 0, 665542
BytebuddyAgent [candidate] (671.554 ms) : 0, 671554
AgentMeter [baseline] (12.258 ms) : 0, 12258
AgentMeter [candidate] (12.236 ms) : 0, 12236
GlobalTracer [baseline] (251.431 ms) : 0, 251431
GlobalTracer [candidate] (252.193 ms) : 0, 252193
IAST [baseline] (24.645 ms) : 0, 24645
IAST [candidate] (24.903 ms) : 0, 24903
AppSec [baseline] (186.318 ms) : 0, 186318
AppSec [candidate] (185.929 ms) : 0, 185929
Debugger [baseline] (66.521 ms) : 0, 66521
Debugger [candidate] (66.428 ms) : 0, 66428
Remote Config [baseline] (626.457 µs) : 0, 626
Remote Config [candidate] (609.256 µs) : 0, 609
Telemetry [baseline] (8.553 ms) : 0, 8553
Telemetry [candidate] (8.799 ms) : 0, 8799
Flare Poller [baseline] (3.608 ms) : 0, 3608
Flare Poller [candidate] (3.651 ms) : 0, 3651
section iast
crashtracking [baseline] (1.236 ms) : 0, 1236
crashtracking [candidate] (1.215 ms) : 0, 1215
BytebuddyAgent [baseline] (808.227 ms) : 0, 808227
BytebuddyAgent [candidate] (799.931 ms) : 0, 799931
AgentMeter [baseline] (11.62 ms) : 0, 11620
AgentMeter [candidate] (11.358 ms) : 0, 11358
GlobalTracer [baseline] (239.887 ms) : 0, 239887
GlobalTracer [candidate] (238.785 ms) : 0, 238785
IAST [baseline] (25.796 ms) : 0, 25796
IAST [candidate] (25.812 ms) : 0, 25812
AppSec [baseline] (29.602 ms) : 0, 29602
AppSec [candidate] (32.687 ms) : 0, 32687
Debugger [baseline] (62.753 ms) : 0, 62753
Debugger [candidate] (59.761 ms) : 0, 59761
Remote Config [baseline] (1.095 ms) : 0, 1095
Remote Config [candidate] (538.57 µs) : 0, 539
Telemetry [baseline] (12.215 ms) : 0, 12215
Telemetry [candidate] (12.746 ms) : 0, 12746
Flare Poller [baseline] (3.597 ms) : 0, 3597
Flare Poller [candidate] (3.583 ms) : 0, 3583
section profiling
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.176 ms) : 0, 1176
BytebuddyAgent [baseline] (698.457 ms) : 0, 698457
BytebuddyAgent [candidate] (696.65 ms) : 0, 696650
AgentMeter [baseline] (9.15 ms) : 0, 9150
AgentMeter [candidate] (9.153 ms) : 0, 9153
GlobalTracer [baseline] (208.781 ms) : 0, 208781
GlobalTracer [candidate] (208.503 ms) : 0, 208503
AppSec [baseline] (33.032 ms) : 0, 33032
AppSec [candidate] (32.814 ms) : 0, 32814
Debugger [baseline] (66.182 ms) : 0, 66182
Debugger [candidate] (66.106 ms) : 0, 66106
Remote Config [baseline] (572.966 µs) : 0, 573
Remote Config [candidate] (572.404 µs) : 0, 572
Telemetry [baseline] (7.878 ms) : 0, 7878
Telemetry [candidate] (7.925 ms) : 0, 7925
Flare Poller [baseline] (3.549 ms) : 0, 3549
Flare Poller [candidate] (3.603 ms) : 0, 3603
ProfilingAgent [baseline] (94.062 ms) : 0, 94062
ProfilingAgent [candidate] (94.533 ms) : 0, 94533
Profiling [baseline] (94.643 ms) : 0, 94643
Profiling [candidate] (95.095 ms) : 0, 95095
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/line-coverage-improvements
git_commit_date 1776286005 1776333319
git_commit_sha 42f154d 9922250
release_version 1.62.0-SNAPSHOT~42f154d2f6 1.62.0-SNAPSHOT~9922250541
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776335825 1776335825
ci_job_id 1600732972 1600732972
ci_pipeline_id 107968524 107968524
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-ej52xih3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-ej52xih3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 2 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load worse
[+35.025µs; +189.247µs] or [+2.008%; +10.847%]		 unstable
[+173.517µs; +1132.541µs] or [+3.508%; +22.894%]		 unstable
[-419.873op/s; +60.248op/s] or [-19.973%; +2.866%]		 1.857ms 5.600ms 1922.344op/s 1.745ms 4.947ms 2102.156op/s
scenario:load:insecure-bank:iast:high_load better
[-243.655µs; -126.859µs] or [-8.890%; -4.628%]		 better
[-614.847µs; -159.151µs] or [-7.767%; -2.010%]		 unstable
[-75.246op/s; +213.621op/s] or [-5.738%; +16.291%]		 2.556ms 7.529ms 1380.469op/s 2.741ms 7.916ms 1311.281op/s
scenario:load:petclinic:profiling:high_load unsure
[-1615.050µs; -331.919µs] or [-8.320%; -1.710%]		 better
[-3.419ms; -1.055ms] or [-10.786%; -3.330%]		 unstable
[-12.033op/s; +44.283op/s] or [-5.090%; +18.732%]		 18.437ms 29.460ms 252.531op/s 19.411ms 31.697ms 236.406op/s
scenario:load:petclinic:no_agent:high_load worse
[+0.935ms; +2.617ms] or [+5.354%; +14.981%]		 unstable
[+1.070ms; +4.099ms] or [+3.696%; +14.164%]		 unstable
[-51.348op/s; +7.035op/s] or [-19.648%; +2.692%]		 19.244ms 31.527ms 239.188op/s 17.468ms 28.943ms 261.344op/s
scenario:load:petclinic:appsec:high_load better
[-1.529ms; -0.627ms] or [-7.942%; -3.257%]		 unsure
[-1.888ms; -0.177ms] or [-6.144%; -0.575%]		 unstable
[-16.122op/s; +39.560op/s] or [-6.722%; +16.494%]		 18.171ms 29.705ms 251.562op/s 19.249ms 30.737ms 239.844op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~9922250541, baseline=1.62.0-SNAPSHOT~42f154d2f6
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.255 ms) : 1243, 1267
.   : milestone, 1255,
iast (3.494 ms) : 3444, 3544
.   : milestone, 3494,
iast_FULL (6.049 ms) : 5987, 6110
.   : milestone, 6049,
iast_GLOBAL (3.659 ms) : 3598, 3720
.   : milestone, 3659,
profiling (2.151 ms) : 2131, 2170
.   : milestone, 2151,
tracing (1.928 ms) : 1911, 1945
.   : milestone, 1928,
section candidate
no_agent (1.234 ms) : 1222, 1246
.   : milestone, 1234,
iast (3.315 ms) : 3272, 3359
.   : milestone, 3315,
iast_FULL (5.931 ms) : 5871, 5992
.   : milestone, 5931,
iast_GLOBAL (3.738 ms) : 3681, 3794
.   : milestone, 3738,
profiling (2.359 ms) : 2335, 2383
.   : milestone, 2359,
tracing (1.864 ms) : 1848, 1880
.   : milestone, 1864,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.255 ms [1.243 ms, 1.267 ms] -
iast 3.494 ms [3.444 ms, 3.544 ms] 2.239 ms (178.4%)
iast_FULL 6.049 ms [5.987 ms, 6.11 ms] 4.793 ms (381.9%)
iast_GLOBAL 3.659 ms [3.598 ms, 3.72 ms] 2.404 ms (191.5%)
profiling 2.151 ms [2.131 ms, 2.17 ms] 895.51 µs (71.3%)
tracing 1.928 ms [1.911 ms, 1.945 ms] 673.042 µs (53.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.234 ms [1.222 ms, 1.246 ms] -
iast 3.315 ms [3.272 ms, 3.359 ms] 2.081 ms (168.7%)
iast_FULL 5.931 ms [5.871 ms, 5.992 ms] 4.697 ms (380.7%)
iast_GLOBAL 3.738 ms [3.681 ms, 3.794 ms] 2.504 ms (202.9%)
profiling 2.359 ms [2.335 ms, 2.383 ms] 1.125 ms (91.2%)
tracing 1.864 ms [1.848 ms, 1.88 ms] 629.67 µs (51.0%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~9922250541, baseline=1.62.0-SNAPSHOT~42f154d2f6
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.854 ms) : 17680, 18029
.   : milestone, 17854,
appsec (19.466 ms) : 19271, 19660
.   : milestone, 19466,
code_origins (18.762 ms) : 18572, 18952
.   : milestone, 18762,
iast (18.248 ms) : 18065, 18432
.   : milestone, 18248,
profiling (19.746 ms) : 19541, 19952
.   : milestone, 19746,
tracing (17.687 ms) : 17512, 17862
.   : milestone, 17687,
section candidate
no_agent (19.514 ms) : 19311, 19717
.   : milestone, 19514,
appsec (18.55 ms) : 18361, 18738
.   : milestone, 18550,
code_origins (19.172 ms) : 18981, 19363
.   : milestone, 19172,
iast (18.108 ms) : 17925, 18291
.   : milestone, 18108,
profiling (18.481 ms) : 18301, 18661
.   : milestone, 18481,
tracing (17.858 ms) : 17683, 18033
.   : milestone, 17858,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.854 ms [17.68 ms, 18.029 ms] -
appsec 19.466 ms [19.271 ms, 19.66 ms] 1.611 ms (9.0%)
code_origins 18.762 ms [18.572 ms, 18.952 ms] 907.633 µs (5.1%)
iast 18.248 ms [18.065 ms, 18.432 ms] 394.093 µs (2.2%)
profiling 19.746 ms [19.541 ms, 19.952 ms] 1.892 ms (10.6%)
tracing 17.687 ms [17.512 ms, 17.862 ms] -167.524 µs (-0.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.514 ms [19.311 ms, 19.717 ms] -
appsec 18.55 ms [18.361 ms, 18.738 ms] -963.952 µs (-4.9%)
code_origins 19.172 ms [18.981 ms, 19.363 ms] -341.792 µs (-1.8%)
iast 18.108 ms [17.925 ms, 18.291 ms] -1.406 ms (-7.2%)
profiling 18.481 ms [18.301 ms, 18.661 ms] -1.033 ms (-5.3%)
tracing 17.858 ms [17.683 ms, 18.033 ms] -1.656 ms (-8.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/line-coverage-improvements
git_commit_date 1776286005 1776333319
git_commit_sha 42f154d 9922250
release_version 1.62.0-SNAPSHOT~42f154d2f6 1.62.0-SNAPSHOT~9922250541
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1776335547 1776335547
ci_job_id 1600732973 1600732973
ci_pipeline_id 107968524 107968524
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-y20ugyid 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-y20ugyid 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~9922250541, baseline=1.62.0-SNAPSHOT~42f154d2f6
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.948 s) : 14948000, 14948000
.   : milestone, 14948000,
appsec (14.84 s) : 14840000, 14840000
.   : milestone, 14840000,
iast (18.245 s) : 18245000, 18245000
.   : milestone, 18245000,
iast_GLOBAL (18.221 s) : 18221000, 18221000
.   : milestone, 18221000,
profiling (14.884 s) : 14884000, 14884000
.   : milestone, 14884000,
tracing (14.935 s) : 14935000, 14935000
.   : milestone, 14935000,
section candidate
no_agent (14.919 s) : 14919000, 14919000
.   : milestone, 14919000,
appsec (14.923 s) : 14923000, 14923000
.   : milestone, 14923000,
iast (18.27 s) : 18270000, 18270000
.   : milestone, 18270000,
iast_GLOBAL (18.266 s) : 18266000, 18266000
.   : milestone, 18266000,
profiling (14.505 s) : 14505000, 14505000
.   : milestone, 14505000,
tracing (14.782 s) : 14782000, 14782000
.   : milestone, 14782000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.948 s [14.948 s, 14.948 s] -
appsec 14.84 s [14.84 s, 14.84 s] -108.0 ms (-0.7%)
iast 18.245 s [18.245 s, 18.245 s] 3.297 s (22.1%)
iast_GLOBAL 18.221 s [18.221 s, 18.221 s] 3.273 s (21.9%)
profiling 14.884 s [14.884 s, 14.884 s] -64.0 ms (-0.4%)
tracing 14.935 s [14.935 s, 14.935 s] -13.0 ms (-0.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.919 s [14.919 s, 14.919 s] -
appsec 14.923 s [14.923 s, 14.923 s] 4.0 ms (0.0%)
iast 18.27 s [18.27 s, 18.27 s] 3.351 s (22.5%)
iast_GLOBAL 18.266 s [18.266 s, 18.266 s] 3.347 s (22.4%)
profiling 14.505 s [14.505 s, 14.505 s] -414.0 ms (-2.8%)
tracing 14.782 s [14.782 s, 14.782 s] -137.0 ms (-0.9%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~9922250541, baseline=1.62.0-SNAPSHOT~42f154d2f6
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.487 ms) : 1476, 1499
.   : milestone, 1487,
appsec (3.842 ms) : 3620, 4063
.   : milestone, 3842,
iast (2.268 ms) : 2199, 2337
.   : milestone, 2268,
iast_GLOBAL (2.314 ms) : 2245, 2383
.   : milestone, 2314,
profiling (2.103 ms) : 2048, 2157
.   : milestone, 2103,
tracing (2.086 ms) : 2032, 2140
.   : milestone, 2086,
section candidate
no_agent (1.49 ms) : 1478, 1501
.   : milestone, 1490,
appsec (3.847 ms) : 3626, 4069
.   : milestone, 3847,
iast (2.276 ms) : 2207, 2345
.   : milestone, 2276,
iast_GLOBAL (2.315 ms) : 2246, 2385
.   : milestone, 2315,
profiling (2.106 ms) : 2051, 2161
.   : milestone, 2106,
tracing (2.084 ms) : 2031, 2138
.   : milestone, 2084,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.487 ms [1.476 ms, 1.499 ms] -
appsec 3.842 ms [3.62 ms, 4.063 ms] 2.355 ms (158.3%)
iast 2.268 ms [2.199 ms, 2.337 ms] 781.03 µs (52.5%)
iast_GLOBAL 2.314 ms [2.245 ms, 2.383 ms] 827.037 µs (55.6%)
profiling 2.103 ms [2.048 ms, 2.157 ms] 615.41 µs (41.4%)
tracing 2.086 ms [2.032 ms, 2.14 ms] 598.869 µs (40.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.49 ms [1.478 ms, 1.501 ms] -
appsec 3.847 ms [3.626 ms, 4.069 ms] 2.358 ms (158.3%)
iast 2.276 ms [2.207 ms, 2.345 ms] 786.653 µs (52.8%)
iast_GLOBAL 2.315 ms [2.246 ms, 2.385 ms] 825.924 µs (55.4%)
profiling 2.106 ms [2.051 ms, 2.161 ms] 616.781 µs (41.4%)
tracing 2.084 ms [2.031 ms, 2.138 ms] 594.774 µs (39.9%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

comp: ci visibility Continuous Integration Visibility type: enhancement Enhancements and improvements

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@daniel-mohedano