Skip to content

Conversation

@jbachorik
Copy link
Contributor

Backport #10097 to release/v1.56.x

(cherry picked from commit 2f7fcec)
@jbachorik jbachorik requested a review from a team as a code owner December 10, 2025 11:36
@jbachorik jbachorik requested a review from ygree December 10, 2025 11:36
@jbachorik jbachorik added type: enhancement Enhancements and improvements comp: profiling Profiling labels Dec 10, 2025
@datadog-datadog-prod-us1
Copy link
Contributor

datadog-datadog-prod-us1 bot commented Dec 10, 2025

🎯 Code Coverage
Patch Coverage: 100.00%
Total Coverage: 59.65% (+0.00%)

View detailed report

This comment will be updated automatically if new data arrives.
* Fix with Cursor requires Datadog plugin ≥v2.17.0
🔗 Commit SHA: 16d122d | Docs | Datadog PR Page | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Dec 10, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jaroslav.bachorik/backport-pr-10097
git_commit_date 1763637994 1765444742
git_commit_sha c05874d 16d122d
release_version 1.56.0~c05874d84e 1.57.0-SNAPSHOT~16d122dfb1
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765446680 1765446680
ci_job_id 1286568391 1286568391
ci_pipeline_id 86160995 86160995
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-hnp6sx7f 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-hnp6sx7f 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 13 performance improvements and 6 performance regressions! Performance is the same for 33 metrics, 13 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent.start better
[-73.307ms; -28.967ms] or [-5.858%; -2.315%]
1.200s 1.251s
scenario:startup:insecure-bank:iast:Debugger better
[-55.160ms; -53.111ms] or [-91.589%; -88.188%]
6.089ms 60.225ms
scenario:startup:insecure-bank:tracing:Agent better
[-404.424ms; -188.601ms] or [-4.505%; -2.101%]
8.681s 8.977s
scenario:startup:insecure-bank:tracing:Agent.start better
[-72.781ms; -31.504ms] or [-6.539%; -2.830%]
1.061s 1.113s
scenario:startup:insecure-bank:tracing:Debugger better
[-58.214ms; -56.897ms] or [-90.913%; -88.856%]
6.477ms 64.033ms
scenario:startup:petclinic:appsec:Agent.start better
[-61.932ms; -50.782ms] or [-4.813%; -3.946%]
1.231s 1.287s
scenario:startup:petclinic:appsec:Debugger better
[-57.373ms; -55.055ms] or [-91.798%; -88.089%]
6.285ms 62.499ms
scenario:startup:petclinic:iast:Agent.start better
[-73.198ms; -39.911ms] or [-5.853%; -3.191%]
1.194s 1.251s
scenario:startup:petclinic:iast:Debugger better
[-55.536ms; -54.247ms] or [-91.011%; -88.899%]
6.129ms 61.021ms
scenario:startup:petclinic:iast:Telemetry worse
[+339.093µs; +912.471µs] or [+4.454%; +11.984%]
8.240ms 7.614ms
scenario:startup:petclinic:iast:Flare Poller worse
[+7.190ms; +7.510ms] or [+205.050%; +214.179%]
10.857ms 3.507ms
scenario:startup:petclinic:profiling:Agent.start better
[-42.451ms; -33.806ms] or [-3.429%; -2.731%]
1.200s 1.238s
scenario:startup:petclinic:profiling:ProfilingAgent worse
[+12.841ms; +14.660ms] or [+13.150%; +15.013%]
111.400ms 97.650ms
scenario:startup:petclinic:profiling:Debugger better
[-57.171ms; -56.293ms] or [-89.990%; -88.608%]
6.798ms 63.530ms
scenario:startup:petclinic:profiling:Telemetry worse
[+8.335ms; +8.898ms] or [+103.706%; +110.701%]
16.654ms 8.038ms
scenario:startup:petclinic:profiling:Flare Poller worse
[+168.942µs; +418.782µs] or [+4.443%; +11.014%]
4.096ms 3.802ms
scenario:startup:petclinic:profiling:Profiling worse
[+12.895ms; +14.690ms] or [+13.125%; +14.952%]
112.039ms 98.247ms
scenario:startup:petclinic:tracing:Agent.start better
[-67.534ms; -44.692ms] or [-6.081%; -4.024%]
1.055s 1.111s
scenario:startup:petclinic:tracing:Debugger better
[-58.613ms; -57.136ms] or [-91.230%; -88.931%]
6.373ms 64.248ms
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~16d122dfb1, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.111 s) : 0, 1110659
Total [baseline] (10.845 s) : 0, 10845163
Agent [candidate] (1.055 s) : 0, 1054546
Total [candidate] (10.857 s) : 0, 10857268
section appsec
Agent [baseline] (1.287 s) : 0, 1286895
Total [baseline] (11.118 s) : 0, 11117747
Agent [candidate] (1.231 s) : 0, 1230538
Total [candidate] (10.976 s) : 0, 10976359
section iast
Agent [baseline] (1.251 s) : 0, 1250615
Total [baseline] (11.321 s) : 0, 11321012
Agent [candidate] (1.194 s) : 0, 1194061
Total [candidate] (11.254 s) : 0, 11253565
section profiling
Agent [baseline] (1.238 s) : 0, 1237811
Total [baseline] (11.088 s) : 0, 11087982
Agent [candidate] (1.2 s) : 0, 1199683
Total [candidate] (10.903 s) : 0, 10903325
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.111 s -
Agent appsec 1.287 s 176.235 ms (15.9%)
Agent iast 1.251 s 139.956 ms (12.6%)
Agent profiling 1.238 s 127.152 ms (11.4%)
Total tracing 10.845 s -
Total appsec 11.118 s 272.584 ms (2.5%)
Total iast 11.321 s 475.849 ms (4.4%)
Total profiling 11.088 s 242.819 ms (2.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent appsec 1.231 s 175.991 ms (16.7%)
Agent iast 1.194 s 139.514 ms (13.2%)
Agent profiling 1.2 s 145.137 ms (13.8%)
Total tracing 10.857 s -
Total appsec 10.976 s 119.09 ms (1.1%)
Total iast 11.254 s 396.297 ms (3.7%)
Total profiling 10.903 s 46.057 ms (0.4%)
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~16d122dfb1, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.467 ms) : 0, 1467
crashtracking [candidate] (1.454 ms) : 0, 1454
BytebuddyAgent [baseline] (713.197 ms) : 0, 713197
BytebuddyAgent [candidate] (708.734 ms) : 0, 708734
GlobalTracer [baseline] (251.521 ms) : 0, 251521
GlobalTracer [candidate] (250.073 ms) : 0, 250073
AppSec [baseline] (32.399 ms) : 0, 32399
AppSec [candidate] (32.143 ms) : 0, 32143
Debugger [baseline] (64.248 ms) : 0, 64248
Debugger [candidate] (6.373 ms) : 0, 6373
Remote Config [baseline] (630.281 µs) : 0, 630
Remote Config [candidate] (691.835 µs) : 0, 692
Telemetry [baseline] (8.32 ms) : 0, 8320
Telemetry [candidate] (13.836 ms) : 0, 13836
Flare Poller [baseline] (3.675 ms) : 0, 3675
Flare Poller [candidate] (6.348 ms) : 0, 6348
section appsec
crashtracking [baseline] (1.461 ms) : 0, 1461
crashtracking [candidate] (1.451 ms) : 0, 1451
BytebuddyAgent [baseline] (733.127 ms) : 0, 733127
BytebuddyAgent [candidate] (732.829 ms) : 0, 732829
GlobalTracer [baseline] (241.4 ms) : 0, 241400
GlobalTracer [candidate] (241.583 ms) : 0, 241583
AppSec [baseline] (175.384 ms) : 0, 175384
AppSec [candidate] (175.425 ms) : 0, 175425
Debugger [baseline] (62.499 ms) : 0, 62499
Debugger [candidate] (6.285 ms) : 0, 6285
Remote Config [baseline] (675.03 µs) : 0, 675
Remote Config [candidate] (681.798 µs) : 0, 682
Telemetry [baseline] (8.212 ms) : 0, 8212
Telemetry [candidate] (8.202 ms) : 0, 8202
Flare Poller [baseline] (3.999 ms) : 0, 3999
Flare Poller [candidate] (4.006 ms) : 0, 4006
IAST [baseline] (25.0 ms) : 0, 25000
IAST [candidate] (24.975 ms) : 0, 24975
section iast
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.461 ms) : 0, 1461
BytebuddyAgent [baseline] (839.864 ms) : 0, 839864
BytebuddyAgent [candidate] (832.839 ms) : 0, 832839
GlobalTracer [baseline] (239.345 ms) : 0, 239345
GlobalTracer [candidate] (237.268 ms) : 0, 237268
AppSec [baseline] (34.976 ms) : 0, 34976
AppSec [candidate] (33.322 ms) : 0, 33322
Debugger [baseline] (61.021 ms) : 0, 61021
Debugger [candidate] (6.129 ms) : 0, 6129
Remote Config [baseline] (546.7 µs) : 0, 547
Remote Config [candidate] (631.299 µs) : 0, 631
Telemetry [baseline] (7.614 ms) : 0, 7614
Telemetry [candidate] (8.24 ms) : 0, 8240
Flare Poller [baseline] (3.507 ms) : 0, 3507
Flare Poller [candidate] (10.857 ms) : 0, 10857
IAST [baseline] (27.003 ms) : 0, 27003
IAST [candidate] (28.313 ms) : 0, 28313
section profiling
ProfilingAgent [baseline] (97.65 ms) : 0, 97650
ProfilingAgent [candidate] (111.4 ms) : 0, 111400
crashtracking [baseline] (1.443 ms) : 0, 1443
crashtracking [candidate] (1.441 ms) : 0, 1441
BytebuddyAgent [baseline] (737.075 ms) : 0, 737075
BytebuddyAgent [candidate] (733.885 ms) : 0, 733885
GlobalTracer [baseline] (223.402 ms) : 0, 223402
GlobalTracer [candidate] (222.948 ms) : 0, 222948
AppSec [baseline] (32.286 ms) : 0, 32286
AppSec [candidate] (32.014 ms) : 0, 32014
Debugger [baseline] (63.53 ms) : 0, 63530
Debugger [candidate] (6.798 ms) : 0, 6798
Remote Config [baseline] (674.046 µs) : 0, 674
Remote Config [candidate] (680.295 µs) : 0, 680
Telemetry [baseline] (8.038 ms) : 0, 8038
Telemetry [candidate] (16.654 ms) : 0, 16654
Flare Poller [baseline] (3.802 ms) : 0, 3802
Flare Poller [candidate] (4.096 ms) : 0, 4096
Profiling [baseline] (98.247 ms) : 0, 98247
Profiling [candidate] (112.039 ms) : 0, 112039
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~16d122dfb1, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.113 s) : 0, 1113073
Total [baseline] (8.977 s) : 0, 8977361
Agent [candidate] (1.061 s) : 0, 1060930
Total [candidate] (8.681 s) : 0, 8680848
section iast
Agent [baseline] (1.251 s) : 0, 1251465
Total [baseline] (9.632 s) : 0, 9631736
Agent [candidate] (1.2 s) : 0, 1200328
Total [candidate] (9.39 s) : 0, 9389521
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.113 s -
Agent iast 1.251 s 138.392 ms (12.4%)
Total tracing 8.977 s -
Total iast 9.632 s 654.375 ms (7.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.2 s 139.398 ms (13.1%)
Total tracing 8.681 s -
Total iast 9.39 s 708.673 ms (8.2%)
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~16d122dfb1, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.479 ms) : 0, 1479
crashtracking [candidate] (1.47 ms) : 0, 1470
BytebuddyAgent [baseline] (715.535 ms) : 0, 715535
BytebuddyAgent [candidate] (712.839 ms) : 0, 712839
GlobalTracer [baseline] (251.719 ms) : 0, 251719
GlobalTracer [candidate] (251.533 ms) : 0, 251533
AppSec [baseline] (32.389 ms) : 0, 32389
AppSec [candidate] (32.36 ms) : 0, 32360
Debugger [baseline] (64.033 ms) : 0, 64033
Debugger [candidate] (6.477 ms) : 0, 6477
Remote Config [baseline] (646.122 µs) : 0, 646
Remote Config [candidate] (679.625 µs) : 0, 680
Telemetry [baseline] (8.294 ms) : 0, 8294
Telemetry [candidate] (13.348 ms) : 0, 13348
Flare Poller [baseline] (3.717 ms) : 0, 3717
Flare Poller [candidate] (6.356 ms) : 0, 6356
section iast
crashtracking [baseline] (1.471 ms) : 0, 1471
crashtracking [candidate] (1.492 ms) : 0, 1492
BytebuddyAgent [baseline] (840.665 ms) : 0, 840665
BytebuddyAgent [candidate] (837.768 ms) : 0, 837768
GlobalTracer [baseline] (239.654 ms) : 0, 239654
GlobalTracer [candidate] (238.742 ms) : 0, 238742
IAST [baseline] (29.827 ms) : 0, 29827
IAST [candidate] (30.151 ms) : 0, 30151
AppSec [baseline] (32.558 ms) : 0, 32558
AppSec [candidate] (31.478 ms) : 0, 31478
Debugger [baseline] (60.225 ms) : 0, 60225
Debugger [candidate] (6.089 ms) : 0, 6089
Remote Config [baseline] (549.467 µs) : 0, 549
Remote Config [candidate] (623.726 µs) : 0, 624
Telemetry [baseline] (7.737 ms) : 0, 7737
Telemetry [candidate] (7.96 ms) : 0, 7960
Flare Poller [baseline] (3.548 ms) : 0, 3548
Flare Poller [candidate] (10.909 ms) : 0, 10909
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jaroslav.bachorik/backport-pr-10097
git_commit_date 1763637994 1765444742
git_commit_sha c05874d 16d122d
release_version 1.56.0~c05874d84e 1.57.0-SNAPSHOT~16d122dfb1
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765447166 1765447166
ci_job_id 1286568393 1286568393
ci_pipeline_id 86160995 86160995
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-se6n1u73 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-se6n1u73 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 18 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:tracing:high_load worse
[+522.651µs; +1306.338µs] or [+3.043%; +7.605%]
unsure
[+0.547ms; +1.617ms] or [+1.931%; +5.702%]
unstable
[-38.078op/s; +14.515op/s] or [-14.382%; +5.483%]
18.093ms 29.437ms 252.969op/s 17.178ms 28.354ms 264.750op/s
scenario:load:petclinic:code_origins:high_load worse
[+0.663ms; +1.553ms] or [+3.806%; +8.917%]
unsure
[+0.422ms; +1.869ms] or [+1.482%; +6.570%]
unstable
[-39.326op/s; +12.826op/s] or [-14.985%; +4.887%]
18.525ms 29.594ms 249.188op/s 17.417ms 28.449ms 262.438op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~16d122dfb1, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.959 ms) : 17775, 18142
.   : milestone, 17959,
appsec (18.634 ms) : 18447, 18821
.   : milestone, 18634,
code_origins (17.779 ms) : 17603, 17955
.   : milestone, 17779,
iast (17.452 ms) : 17279, 17625
.   : milestone, 17452,
profiling (18.878 ms) : 18686, 19071
.   : milestone, 18878,
tracing (17.621 ms) : 17447, 17796
.   : milestone, 17621,
section candidate
no_agent (18.2 ms) : 18014, 18386
.   : milestone, 18200,
appsec (18.465 ms) : 18276, 18654
.   : milestone, 18465,
code_origins (18.725 ms) : 18540, 18911
.   : milestone, 18725,
iast (17.656 ms) : 17477, 17835
.   : milestone, 17656,
profiling (18.678 ms) : 18495, 18861
.   : milestone, 18678,
tracing (18.445 ms) : 18260, 18631
.   : milestone, 18445,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.959 ms [17.775 ms, 18.142 ms] -
appsec 18.634 ms [18.447 ms, 18.821 ms] 675.354 µs (3.8%)
code_origins 17.779 ms [17.603 ms, 17.955 ms] -179.495 µs (-1.0%)
iast 17.452 ms [17.279 ms, 17.625 ms] -506.311 µs (-2.8%)
profiling 18.878 ms [18.686 ms, 19.071 ms] 919.876 µs (5.1%)
tracing 17.621 ms [17.447 ms, 17.796 ms] -337.187 µs (-1.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.2 ms [18.014 ms, 18.386 ms] -
appsec 18.465 ms [18.276 ms, 18.654 ms] 265.221 µs (1.5%)
code_origins 18.725 ms [18.54 ms, 18.911 ms] 525.242 µs (2.9%)
iast 17.656 ms [17.477 ms, 17.835 ms] -544.143 µs (-3.0%)
profiling 18.678 ms [18.495 ms, 18.861 ms] 478.019 µs (2.6%)
tracing 18.445 ms [18.26 ms, 18.631 ms] 245.297 µs (1.3%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~16d122dfb1, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.286 ms) : 1271, 1301
.   : milestone, 1286,
iast (3.169 ms) : 3125, 3213
.   : milestone, 3169,
iast_FULL (5.859 ms) : 5801, 5917
.   : milestone, 5859,
iast_GLOBAL (3.535 ms) : 3481, 3589
.   : milestone, 3535,
profiling (2.195 ms) : 2174, 2216
.   : milestone, 2195,
tracing (1.799 ms) : 1784, 1814
.   : milestone, 1799,
section candidate
no_agent (1.204 ms) : 1193, 1216
.   : milestone, 1204,
iast (3.23 ms) : 3190, 3271
.   : milestone, 3230,
iast_FULL (5.904 ms) : 5844, 5964
.   : milestone, 5904,
iast_GLOBAL (3.625 ms) : 3570, 3680
.   : milestone, 3625,
profiling (2.03 ms) : 2013, 2048
.   : milestone, 2030,
tracing (1.817 ms) : 1802, 1832
.   : milestone, 1817,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.286 ms [1.271 ms, 1.301 ms] -
iast 3.169 ms [3.125 ms, 3.213 ms] 1.883 ms (146.4%)
iast_FULL 5.859 ms [5.801 ms, 5.917 ms] 4.573 ms (355.6%)
iast_GLOBAL 3.535 ms [3.481 ms, 3.589 ms] 2.249 ms (174.8%)
profiling 2.195 ms [2.174 ms, 2.216 ms] 908.905 µs (70.7%)
tracing 1.799 ms [1.784 ms, 1.814 ms] 512.871 µs (39.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.204 ms [1.193 ms, 1.216 ms] -
iast 3.23 ms [3.19 ms, 3.271 ms] 2.026 ms (168.2%)
iast_FULL 5.904 ms [5.844 ms, 5.964 ms] 4.699 ms (390.2%)
iast_GLOBAL 3.625 ms [3.57 ms, 3.68 ms] 2.42 ms (200.9%)
profiling 2.03 ms [2.013 ms, 2.048 ms] 826.03 µs (68.6%)
tracing 1.817 ms [1.802 ms, 1.832 ms] 612.719 µs (50.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jaroslav.bachorik/backport-pr-10097
git_commit_date 1763637994 1765444742
git_commit_sha c05874d 16d122d
release_version 1.56.0~c05874d84e 1.57.0-SNAPSHOT~16d122dfb1
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1765446889 1765446889
ci_job_id 1286568395 1286568395
ci_pipeline_id 86160995 86160995
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-p79cj5xu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-p79cj5xu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~16d122dfb1, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.377 s) : 15377000, 15377000
.   : milestone, 15377000,
appsec (14.682 s) : 14682000, 14682000
.   : milestone, 14682000,
iast (18.37 s) : 18370000, 18370000
.   : milestone, 18370000,
iast_GLOBAL (18.239 s) : 18239000, 18239000
.   : milestone, 18239000,
profiling (14.711 s) : 14711000, 14711000
.   : milestone, 14711000,
tracing (14.91 s) : 14910000, 14910000
.   : milestone, 14910000,
section candidate
no_agent (15.296 s) : 15296000, 15296000
.   : milestone, 15296000,
appsec (14.798 s) : 14798000, 14798000
.   : milestone, 14798000,
iast (18.247 s) : 18247000, 18247000
.   : milestone, 18247000,
iast_GLOBAL (17.81 s) : 17810000, 17810000
.   : milestone, 17810000,
profiling (14.557 s) : 14557000, 14557000
.   : milestone, 14557000,
tracing (14.923 s) : 14923000, 14923000
.   : milestone, 14923000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.377 s [15.377 s, 15.377 s] -
appsec 14.682 s [14.682 s, 14.682 s] -695.0 ms (-4.5%)
iast 18.37 s [18.37 s, 18.37 s] 2.993 s (19.5%)
iast_GLOBAL 18.239 s [18.239 s, 18.239 s] 2.862 s (18.6%)
profiling 14.711 s [14.711 s, 14.711 s] -666.0 ms (-4.3%)
tracing 14.91 s [14.91 s, 14.91 s] -467.0 ms (-3.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.296 s [15.296 s, 15.296 s] -
appsec 14.798 s [14.798 s, 14.798 s] -498.0 ms (-3.3%)
iast 18.247 s [18.247 s, 18.247 s] 2.951 s (19.3%)
iast_GLOBAL 17.81 s [17.81 s, 17.81 s] 2.514 s (16.4%)
profiling 14.557 s [14.557 s, 14.557 s] -739.0 ms (-4.8%)
tracing 14.923 s [14.923 s, 14.923 s] -373.0 ms (-2.4%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~16d122dfb1, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (3.676 ms) : 3461, 3891
.   : milestone, 3676,
iast (2.211 ms) : 2147, 2276
.   : milestone, 2211,
iast_GLOBAL (2.248 ms) : 2183, 2312
.   : milestone, 2248,
profiling (2.08 ms) : 2026, 2133
.   : milestone, 2080,
tracing (2.056 ms) : 2005, 2107
.   : milestone, 2056,
section candidate
no_agent (1.48 ms) : 1469, 1492
.   : milestone, 1480,
appsec (3.712 ms) : 3494, 3929
.   : milestone, 3712,
iast (2.203 ms) : 2139, 2267
.   : milestone, 2203,
iast_GLOBAL (2.264 ms) : 2199, 2330
.   : milestone, 2264,
profiling (2.483 ms) : 2318, 2648
.   : milestone, 2483,
tracing (2.048 ms) : 1997, 2099
.   : milestone, 2048,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 3.676 ms [3.461 ms, 3.891 ms] 2.201 ms (149.3%)
iast 2.211 ms [2.147 ms, 2.276 ms] 736.956 µs (50.0%)
iast_GLOBAL 2.248 ms [2.183 ms, 2.312 ms] 773.165 µs (52.4%)
profiling 2.08 ms [2.026 ms, 2.133 ms] 605.146 µs (41.0%)
tracing 2.056 ms [2.005 ms, 2.107 ms] 581.533 µs (39.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.469 ms, 1.492 ms] -
appsec 3.712 ms [3.494 ms, 3.929 ms] 2.231 ms (150.8%)
iast 2.203 ms [2.139 ms, 2.267 ms] 722.835 µs (48.8%)
iast_GLOBAL 2.264 ms [2.199 ms, 2.33 ms] 784.277 µs (53.0%)
profiling 2.483 ms [2.318 ms, 2.648 ms] 1.003 ms (67.8%)
tracing 2.048 ms [1.997 ms, 2.099 ms] 567.703 µs (38.4%)

@pr-commenter
Copy link

pr-commenter bot commented Dec 11, 2025

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch release/v1.56.x jaroslav.bachorik/backport-pr-10097
git_commit_date 1765401438 1765444742
git_commit_sha 0e5412e 16d122d
See matching parameters
Baseline Candidate
ci_job_date 1765445885 1765445885
ci_job_id 1286568397 1286568397
ci_pipeline_id 86160995 86160995
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Dec 11, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch release/v1.56.x jaroslav.bachorik/backport-pr-10097
git_commit_date 1765401438 1765444742
git_commit_sha 0e5412e 16d122d
See matching parameters
Baseline Candidate
ci_job_date 1765445925 1765445925
ci_job_id 1286568398 1286568398
ci_pipeline_id 86160995 86160995
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@jbachorik jbachorik merged commit caf0522 into release/v1.56.x Dec 11, 2025
539 checks passed
@jbachorik jbachorik deleted the jaroslav.bachorik/backport-pr-10097 branch December 11, 2025 10:34
@PerfectSlayer PerfectSlayer added this to the 1.56.3 milestone Dec 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: profiling Profiling type: enhancement Enhancements and improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants