Skip to content

Experiment with load benchmarks #9704

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 3 commits into
base: master
Choose a base branch
from
Draft

Experiment with load benchmarks #9704

wants to merge 3 commits into from

Conversation

sarahchen6
Copy link
Contributor

What Does This Do

Motivation

Experiment with load benchmarks to improve precision

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@datadog-official Datadog Official
Copy link

datadog-official bot commented Oct 8, 2025 •
edited
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.68% (+0.00%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: dfeae3d | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Oct 8, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/adjust-load-benchmarks
git_commit_date 1760040282 1760045154
git_commit_sha 295f7bf dfeae3d
release_version 1.55.0-SNAPSHOT~295f7bf5b4 1.55.0-SNAPSHOT~dfeae3d72d
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1760047071 1760047071
ci_job_id 1173009927 1173009927
ci_pipeline_id 78913447 78913447
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-ck5kj2aw 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-ck5kj2aw 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 3 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.55.0-SNAPSHOT~dfeae3d72d, baseline=1.55.0-SNAPSHOT~295f7bf5b4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.018 s) : 0, 1017571
Total [baseline] (8.676 s) : 0, 8676430
Agent [candidate] (1.018 s) : 0, 1017561
Total [candidate] (8.685 s) : 0, 8685422
section iast
Agent [baseline] (1.157 s) : 0, 1156616
Total [baseline] (9.31 s) : 0, 9309680
Agent [candidate] (1.149 s) : 0, 1148832
Total [candidate] (9.262 s) : 0, 9261544
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.018 s -
Agent iast 1.157 s 139.044 ms (13.7%)
Total tracing 8.676 s -
Total iast 9.31 s 633.25 ms (7.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.018 s -
Agent iast 1.149 s 131.272 ms (12.9%)
Total tracing 8.685 s -
Total iast 9.262 s 576.122 ms (6.6%) 
gantt
    title insecure-bank - break down per module: candidate=1.55.0-SNAPSHOT~dfeae3d72d, baseline=1.55.0-SNAPSHOT~295f7bf5b4

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.469 ms) : 0, 1469
crashtracking [candidate] (1.661 ms) : 0, 1661
BytebuddyAgent [baseline] (693.33 ms) : 0, 693330
BytebuddyAgent [candidate] (692.949 ms) : 0, 692949
GlobalTracer [baseline] (241.329 ms) : 0, 241329
GlobalTracer [candidate] (241.829 ms) : 0, 241829
AppSec [baseline] (32.15 ms) : 0, 32150
AppSec [candidate] (32.471 ms) : 0, 32471
Debugger [baseline] (6.433 ms) : 0, 6433
Debugger [candidate] (6.404 ms) : 0, 6404
Remote Config [baseline] (695.855 µs) : 0, 696
Remote Config [candidate] (699.329 µs) : 0, 699
Telemetry [baseline] (9.354 ms) : 0, 9354
Telemetry [candidate] (9.263 ms) : 0, 9263
Flare Poller [baseline] (11.646 ms) : 0, 11646
Flare Poller [candidate] (11.137 ms) : 0, 11137
section iast
crashtracking [baseline] (1.486 ms) : 0, 1486
crashtracking [candidate] (1.452 ms) : 0, 1452
BytebuddyAgent [baseline] (819.703 ms) : 0, 819703
BytebuddyAgent [candidate] (814.168 ms) : 0, 814168
GlobalTracer [baseline] (232.395 ms) : 0, 232395
GlobalTracer [candidate] (231.261 ms) : 0, 231261
AppSec [baseline] (35.669 ms) : 0, 35669
AppSec [candidate] (34.97 ms) : 0, 34970
Debugger [baseline] (6.068 ms) : 0, 6068
Debugger [candidate] (6.104 ms) : 0, 6104
Remote Config [baseline] (600.018 µs) : 0, 600
Remote Config [candidate] (599.593 µs) : 0, 600
Telemetry [baseline] (8.527 ms) : 0, 8527
Telemetry [candidate] (8.531 ms) : 0, 8531
Flare Poller [baseline] (4.221 ms) : 0, 4221
Flare Poller [candidate] (4.239 ms) : 0, 4239
IAST [baseline] (26.588 ms) : 0, 26588
IAST [candidate] (26.261 ms) : 0, 26261
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.55.0-SNAPSHOT~dfeae3d72d, baseline=1.55.0-SNAPSHOT~295f7bf5b4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.017 s) : 0, 1016837
Total [baseline] (10.694 s) : 0, 10694423
Agent [candidate] (1.017 s) : 0, 1017215
Total [candidate] (10.675 s) : 0, 10674731
section appsec
Agent [baseline] (1.194 s) : 0, 1194432
Total [baseline] (11.117 s) : 0, 11116815
Agent [candidate] (1.201 s) : 0, 1201221
Total [candidate] (11.122 s) : 0, 11122151
section iast
Agent [baseline] (1.152 s) : 0, 1152278
Total [baseline] (10.952 s) : 0, 10952072
Agent [candidate] (1.16 s) : 0, 1159587
Total [candidate] (11.006 s) : 0, 11005521
section profiling
Agent [baseline] (1.171 s) : 0, 1170950
Total [baseline] (11.194 s) : 0, 11193517
Agent [candidate] (1.169 s) : 0, 1169477
Total [candidate] (11.061 s) : 0, 11060710
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.017 s -
Agent appsec 1.194 s 177.595 ms (17.5%)
Agent iast 1.152 s 135.441 ms (13.3%)
Agent profiling 1.171 s 154.113 ms (15.2%)
Total tracing 10.694 s -
Total appsec 11.117 s 422.393 ms (3.9%)
Total iast 10.952 s 257.649 ms (2.4%)
Total profiling 11.194 s 499.094 ms (4.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.017 s -
Agent appsec 1.201 s 184.006 ms (18.1%)
Agent iast 1.16 s 142.372 ms (14.0%)
Agent profiling 1.169 s 152.262 ms (15.0%)
Total tracing 10.675 s -
Total appsec 11.122 s 447.42 ms (4.2%)
Total iast 11.006 s 330.79 ms (3.1%)
Total profiling 11.061 s 385.979 ms (3.6%) 
gantt
    title petclinic - break down per module: candidate=1.55.0-SNAPSHOT~dfeae3d72d, baseline=1.55.0-SNAPSHOT~295f7bf5b4

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.466 ms) : 0, 1466
crashtracking [candidate] (1.464 ms) : 0, 1464
BytebuddyAgent [baseline] (692.214 ms) : 0, 692214
BytebuddyAgent [candidate] (694.077 ms) : 0, 694077
GlobalTracer [baseline] (241.418 ms) : 0, 241418
GlobalTracer [candidate] (242.288 ms) : 0, 242288
AppSec [baseline] (32.268 ms) : 0, 32268
AppSec [candidate] (32.401 ms) : 0, 32401
Debugger [baseline] (6.384 ms) : 0, 6384
Debugger [candidate] (6.432 ms) : 0, 6432
Remote Config [baseline] (706.337 µs) : 0, 706
Remote Config [candidate] (699.572 µs) : 0, 700
Telemetry [baseline] (9.28 ms) : 0, 9280
Telemetry [candidate] (9.297 ms) : 0, 9297
Flare Poller [baseline] (11.853 ms) : 0, 11853
Flare Poller [candidate] (9.378 ms) : 0, 9378
section appsec
crashtracking [baseline] (1.45 ms) : 0, 1450
crashtracking [candidate] (1.467 ms) : 0, 1467
BytebuddyAgent [baseline] (718.016 ms) : 0, 718016
BytebuddyAgent [candidate] (723.281 ms) : 0, 723281
GlobalTracer [baseline] (234.354 ms) : 0, 234354
GlobalTracer [candidate] (235.615 ms) : 0, 235615
AppSec [baseline] (175.567 ms) : 0, 175567
AppSec [candidate] (175.596 ms) : 0, 175596
Debugger [baseline] (6.165 ms) : 0, 6165
Debugger [candidate] (6.149 ms) : 0, 6149
Remote Config [baseline] (635.071 µs) : 0, 635
Remote Config [candidate] (614.46 µs) : 0, 614
Telemetry [baseline] (8.472 ms) : 0, 8472
Telemetry [candidate] (8.439 ms) : 0, 8439
Flare Poller [baseline] (3.921 ms) : 0, 3921
Flare Poller [candidate] (3.924 ms) : 0, 3924
IAST [baseline] (24.735 ms) : 0, 24735
IAST [candidate] (24.906 ms) : 0, 24906
section iast
crashtracking [baseline] (1.467 ms) : 0, 1467
crashtracking [candidate] (1.482 ms) : 0, 1482
BytebuddyAgent [baseline] (816.25 ms) : 0, 816250
BytebuddyAgent [candidate] (821.671 ms) : 0, 821671
GlobalTracer [baseline] (232.112 ms) : 0, 232112
GlobalTracer [candidate] (233.19 ms) : 0, 233190
AppSec [baseline] (35.318 ms) : 0, 35318
AppSec [candidate] (35.23 ms) : 0, 35230
Debugger [baseline] (6.107 ms) : 0, 6107
Debugger [candidate] (6.139 ms) : 0, 6139
Remote Config [baseline] (600.325 µs) : 0, 600
Remote Config [candidate] (614.457 µs) : 0, 614
Telemetry [baseline] (8.55 ms) : 0, 8550
Telemetry [candidate] (8.724 ms) : 0, 8724
Flare Poller [baseline] (4.164 ms) : 0, 4164
Flare Poller [candidate] (4.33 ms) : 0, 4330
IAST [baseline] (26.297 ms) : 0, 26297
IAST [candidate] (26.719 ms) : 0, 26719
section profiling
crashtracking [baseline] (1.453 ms) : 0, 1453
crashtracking [candidate] (1.439 ms) : 0, 1439
BytebuddyAgent [baseline] (727.327 ms) : 0, 727327
BytebuddyAgent [candidate] (726.538 ms) : 0, 726538
GlobalTracer [baseline] (218.88 ms) : 0, 218880
GlobalTracer [candidate] (219.161 ms) : 0, 219161
AppSec [baseline] (33.098 ms) : 0, 33098
AppSec [candidate] (32.962 ms) : 0, 32962
Debugger [baseline] (6.533 ms) : 0, 6533
Debugger [candidate] (6.536 ms) : 0, 6536
Remote Config [baseline] (711.344 µs) : 0, 711
Remote Config [candidate] (710.195 µs) : 0, 710
Telemetry [baseline] (16.675 ms) : 0, 16675
Telemetry [candidate] (16.779 ms) : 0, 16779
Flare Poller [baseline] (4.285 ms) : 0, 4285
Flare Poller [candidate] (4.22 ms) : 0, 4220
ProfilingAgent [baseline] (107.732 ms) : 0, 107732
ProfilingAgent [candidate] (107.713 ms) : 0, 107713
Profiling [baseline] (109.608 ms) : 0, 109608
Profiling [candidate] (108.695 ms) : 0, 108695
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/adjust-load-benchmarks
git_commit_date 1760040282 1760045154
git_commit_sha 295f7bf dfeae3d
release_version 1.55.0-SNAPSHOT~295f7bf5b4 1.55.0-SNAPSHOT~dfeae3d72d
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1760049207 1760049207
ci_job_id 1173009928 1173009928
ci_pipeline_id 78913447 78913447
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-g47u11iu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-g47u11iu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 2 performance regressions! Performance is the same for 18 metrics, 0 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-164.395µs; -138.204µs] or [-4.543%; -3.819%]		 same
[-1.548op/s; +116.868op/s] or [-0.115%; +8.687%]		 3.468ms 1402.942op/s 3.619ms 1345.282op/s
scenario:load:petclinic:code_origins:high_load better
[-1.806ms; -1.701ms] or [-8.423%; -7.934%]		 better
[+16.662op/s; +24.348op/s] or [+7.205%; +10.528%]		 19.684ms 251.776op/s 21.438ms 231.271op/s
scenario:load:petclinic:tracing:high_load worse
[+862.770µs; +967.136µs] or [+4.344%; +4.870%]		 worse
[-14.985op/s; -6.913op/s] or [-6.004%; -2.770%]		 20.774ms 238.618op/s 19.859ms 249.567op/s
scenario:load:petclinic:appsec:high_load better
[-617.638µs; -500.385µs] or [-2.747%; -2.225%]		 unsure
[+1.878op/s; +9.317op/s] or [+0.852%; +4.225%]		 21.929ms 226.113op/s 22.488ms 220.516op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~dfeae3d72d, baseline=1.55.0-SNAPSHOT~295f7bf5b4
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.335 ms) : 18295, 18376
.   : milestone, 18335,
appsec (22.488 ms) : 22432, 22543
.   : milestone, 22488,
code_origins (21.438 ms) : 21387, 21489
.   : milestone, 21438,
iast (20.692 ms) : 20643, 20742
.   : milestone, 20692,
profiling (22.233 ms) : 22178, 22287
.   : milestone, 22233,
tracing (19.859 ms) : 19813, 19906
.   : milestone, 19859,
section candidate
no_agent (18.603 ms) : 18562, 18645
.   : milestone, 18603,
appsec (21.929 ms) : 21875, 21982
.   : milestone, 21929,
code_origins (19.684 ms) : 19638, 19731
.   : milestone, 19684,
iast (21.012 ms) : 20961, 21062
.   : milestone, 21012,
profiling (22.335 ms) : 22279, 22390
.   : milestone, 22335,
tracing (20.774 ms) : 20724, 20825
.   : milestone, 20774,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.335 ms [18.295 ms, 18.376 ms] -
appsec 22.488 ms [22.432 ms, 22.543 ms] 4.152 ms (22.6%)
code_origins 21.438 ms [21.387 ms, 21.489 ms] 3.102 ms (16.9%)
iast 20.692 ms [20.643 ms, 20.742 ms] 2.357 ms (12.9%)
profiling 22.233 ms [22.178 ms, 22.287 ms] 3.897 ms (21.3%)
tracing 19.859 ms [19.813 ms, 19.906 ms] 1.524 ms (8.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.603 ms [18.562 ms, 18.645 ms] -
appsec 21.929 ms [21.875 ms, 21.982 ms] 3.325 ms (17.9%)
code_origins 19.684 ms [19.638 ms, 19.731 ms] 1.081 ms (5.8%)
iast 21.012 ms [20.961 ms, 21.062 ms] 2.409 ms (12.9%)
profiling 22.335 ms [22.279 ms, 22.39 ms] 3.731 ms (20.1%)
tracing 20.774 ms [20.724 ms, 20.825 ms] 2.171 ms (11.7%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~dfeae3d72d, baseline=1.55.0-SNAPSHOT~295f7bf5b4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.305 ms) : 1302, 1309
.   : milestone, 1305,
iast (3.149 ms) : 3139, 3158
.   : milestone, 3149,
iast_FULL (5.861 ms) : 5843, 5880
.   : milestone, 5861,
iast_GLOBAL (3.619 ms) : 3606, 3632
.   : milestone, 3619,
profiling (2.357 ms) : 2350, 2363
.   : milestone, 2357,
tracing (2.169 ms) : 2164, 2175
.   : milestone, 2169,
section candidate
no_agent (1.313 ms) : 1309, 1316
.   : milestone, 1313,
iast (3.173 ms) : 3164, 3183
.   : milestone, 3173,
iast_FULL (5.781 ms) : 5763, 5799
.   : milestone, 5781,
iast_GLOBAL (3.468 ms) : 3456, 3479
.   : milestone, 3468,
profiling (2.356 ms) : 2350, 2362
.   : milestone, 2356,
tracing (2.13 ms) : 2124, 2135
.   : milestone, 2130,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.305 ms [1.302 ms, 1.309 ms] -
iast 3.149 ms [3.139 ms, 3.158 ms] 1.844 ms (141.3%)
iast_FULL 5.861 ms [5.843 ms, 5.88 ms] 4.556 ms (349.1%)
iast_GLOBAL 3.619 ms [3.606 ms, 3.632 ms] 2.314 ms (177.3%)
profiling 2.357 ms [2.35 ms, 2.363 ms] 1.052 ms (80.6%)
tracing 2.169 ms [2.164 ms, 2.175 ms] 864.258 µs (66.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.313 ms [1.309 ms, 1.316 ms] -
iast 3.173 ms [3.164 ms, 3.183 ms] 1.86 ms (141.7%)
iast_FULL 5.781 ms [5.763 ms, 5.799 ms] 4.468 ms (340.4%)
iast_GLOBAL 3.468 ms [3.456 ms, 3.479 ms] 2.155 ms (164.1%)
profiling 2.356 ms [2.35 ms, 2.362 ms] 1.043 ms (79.5%)
tracing 2.13 ms [2.124 ms, 2.135 ms] 817.117 µs (62.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/adjust-load-benchmarks
git_commit_date 1760040282 1760045154
git_commit_sha 295f7bf dfeae3d
release_version 1.55.0-SNAPSHOT~295f7bf5b4 1.55.0-SNAPSHOT~dfeae3d72d
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1760047221 1760047221
ci_job_id 1173009929 1173009929
ci_pipeline_id 78913447 78913447
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-izosgvra 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-izosgvra 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~dfeae3d72d, baseline=1.55.0-SNAPSHOT~295f7bf5b4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (2.445 ms) : 2394, 2495
.   : milestone, 2445,
iast (2.203 ms) : 2139, 2266
.   : milestone, 2203,
iast_GLOBAL (2.239 ms) : 2175, 2302
.   : milestone, 2239,
profiling (2.045 ms) : 1994, 2096
.   : milestone, 2045,
tracing (2.014 ms) : 1964, 2063
.   : milestone, 2014,
section candidate
no_agent (1.476 ms) : 1464, 1487
.   : milestone, 1476,
appsec (2.458 ms) : 2408, 2509
.   : milestone, 2458,
iast (2.205 ms) : 2142, 2268
.   : milestone, 2205,
iast_GLOBAL (2.241 ms) : 2178, 2305
.   : milestone, 2241,
profiling (2.478 ms) : 2262, 2694
.   : milestone, 2478,
tracing (2.022 ms) : 1972, 2071
.   : milestone, 2022,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.483 ms] -
appsec 2.445 ms [2.394 ms, 2.495 ms] 973.123 µs (66.1%)
iast 2.203 ms [2.139 ms, 2.266 ms] 731.127 µs (49.7%)
iast_GLOBAL 2.239 ms [2.175 ms, 2.302 ms] 767.273 µs (52.1%)
profiling 2.045 ms [1.994 ms, 2.096 ms] 573.178 µs (39.0%)
tracing 2.014 ms [1.964 ms, 2.063 ms] 542.197 µs (36.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.487 ms] -
appsec 2.458 ms [2.408 ms, 2.509 ms] 982.56 µs (66.6%)
iast 2.205 ms [2.142 ms, 2.268 ms] 729.503 µs (49.4%)
iast_GLOBAL 2.241 ms [2.178 ms, 2.305 ms] 765.54 µs (51.9%)
profiling 2.478 ms [2.262 ms, 2.694 ms] 1.002 ms (67.9%)
tracing 2.022 ms [1.972 ms, 2.071 ms] 545.843 µs (37.0%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~dfeae3d72d, baseline=1.55.0-SNAPSHOT~295f7bf5b4
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.525 s) : 15525000, 15525000
.   : milestone, 15525000,
appsec (15.012 s) : 15012000, 15012000
.   : milestone, 15012000,
iast (18.551 s) : 18551000, 18551000
.   : milestone, 18551000,
iast_GLOBAL (18.056 s) : 18056000, 18056000
.   : milestone, 18056000,
profiling (14.666 s) : 14666000, 14666000
.   : milestone, 14666000,
tracing (15.094 s) : 15094000, 15094000
.   : milestone, 15094000,
section candidate
no_agent (14.874 s) : 14874000, 14874000
.   : milestone, 14874000,
appsec (15.155 s) : 15155000, 15155000
.   : milestone, 15155000,
iast (18.815 s) : 18815000, 18815000
.   : milestone, 18815000,
iast_GLOBAL (18.232 s) : 18232000, 18232000
.   : milestone, 18232000,
profiling (15.104 s) : 15104000, 15104000
.   : milestone, 15104000,
tracing (15.052 s) : 15052000, 15052000
.   : milestone, 15052000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.525 s [15.525 s, 15.525 s] -
appsec 15.012 s [15.012 s, 15.012 s] -513.0 ms (-3.3%)
iast 18.551 s [18.551 s, 18.551 s] 3.026 s (19.5%)
iast_GLOBAL 18.056 s [18.056 s, 18.056 s] 2.531 s (16.3%)
profiling 14.666 s [14.666 s, 14.666 s] -859.0 ms (-5.5%)
tracing 15.094 s [15.094 s, 15.094 s] -431.0 ms (-2.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.874 s [14.874 s, 14.874 s] -
appsec 15.155 s [15.155 s, 15.155 s] 281.0 ms (1.9%)
iast 18.815 s [18.815 s, 18.815 s] 3.941 s (26.5%)
iast_GLOBAL 18.232 s [18.232 s, 18.232 s] 3.358 s (22.6%)
profiling 15.104 s [15.104 s, 15.104 s] 230.0 ms (1.5%)
tracing 15.052 s [15.052 s, 15.052 s] 178.0 ms (1.2%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@sarahchen6