Skip to content

Conversation

@jbachorik
Copy link
Contributor

@jbachorik jbachorik commented Dec 9, 2025

What does this PR do?

Improves the stability of TempLocationManagerTest by fixing timing-related test flakiness. The changes ensure proper timeout handling in the cleanup hook interface and improve test synchronization using phaser coordination with timeouts.

Motivation

The test was previously marked as @Flaky due to intermittent failures related to race conditions and timing issues in the cleanup process. This PR addresses those issues by:

  1. Enhanced CleanupHook interface: Added a timeout parameter to all callback methods to explicitly signal when cleanup operations are timing out, allowing hooks to handle timeouts gracefully
  2. Better test synchronization: Replaced indefinite waits with timeout-aware phaser coordination to prevent tests from hanging
  3. Removed flaky test annotation: The test is now stable and no longer requires the @Flaky annotation

Changes

TempLocationManager.java:

  • Modified CleanupHook interface methods to accept a timeout boolean parameter
  • Updated cleanup visitor to pass timeout state to all hook callback methods
  • Ensured hooks are notified when cleanup terminates due to timeout

TempLocationManagerTest.java:

  • Removed @Flaky annotation from timeout test
  • Added timeout handling to phaser coordination (arriveOrAwaitAdvance with 5-second timeout)
  • Improved timeout test to verify that the timeout flag is correctly set
  • Replaced LockSupport.parkNanos with more robust waitFor helper method
  • Added assertions to validate timeout behavior

Contributor Checklist

Jira ticket: PROF-13219

@jbachorik jbachorik added comp: testing Testing type: refactoring tag: no release notes Changes to exclude from release notes labels Dec 9, 2025
@jbachorik jbachorik marked this pull request as ready for review December 9, 2025 11:58
@jbachorik jbachorik requested a review from a team as a code owner December 9, 2025 11:58
@pr-commenter
Copy link

pr-commenter bot commented Dec 9, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/tlm_test_stability
git_commit_date 1765286973 1765288209
git_commit_sha 0d1a541 739ec92
release_version 1.57.0-SNAPSHOT~0d1a541243 1.57.0-SNAPSHOT~739ec923e5
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765290018 1765290018
ci_job_id 1279485410 1279485410
ci_pipeline_id 85580388 85580388
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-q4k2wn76 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-q4k2wn76 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 7 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~739ec923e5, baseline=1.57.0-SNAPSHOT~0d1a541243

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.081 s) : 0, 1081003
Total [baseline] (10.912 s) : 0, 10912272
Agent [candidate] (1.082 s) : 0, 1081973
Total [candidate] (10.837 s) : 0, 10836894
section appsec
Agent [baseline] (1.273 s) : 0, 1273373
Total [baseline] (11.22 s) : 0, 11220268
Agent [candidate] (1.27 s) : 0, 1270219
Total [candidate] (11.122 s) : 0, 11121580
section iast
Agent [baseline] (1.232 s) : 0, 1231612
Total [baseline] (11.102 s) : 0, 11101639
Agent [candidate] (1.232 s) : 0, 1232165
Total [candidate] (11.211 s) : 0, 11210950
section profiling
Agent [baseline] (1.221 s) : 0, 1220821
Total [baseline] (11.227 s) : 0, 11226581
Agent [candidate] (1.213 s) : 0, 1213034
Total [candidate] (11.075 s) : 0, 11074604
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.081 s -
Agent appsec 1.273 s 192.37 ms (17.8%)
Agent iast 1.232 s 150.609 ms (13.9%)
Agent profiling 1.221 s 139.818 ms (12.9%)
Total tracing 10.912 s -
Total appsec 11.22 s 307.996 ms (2.8%)
Total iast 11.102 s 189.367 ms (1.7%)
Total profiling 11.227 s 314.31 ms (2.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.082 s -
Agent appsec 1.27 s 188.246 ms (17.4%)
Agent iast 1.232 s 150.192 ms (13.9%)
Agent profiling 1.213 s 131.061 ms (12.1%)
Total tracing 10.837 s -
Total appsec 11.122 s 284.687 ms (2.6%)
Total iast 11.211 s 374.056 ms (3.5%)
Total profiling 11.075 s 237.71 ms (2.2%)
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~739ec923e5, baseline=1.57.0-SNAPSHOT~0d1a541243

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.201 ms) : 0, 1201
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (648.539 ms) : 0, 648539
BytebuddyAgent [candidate] (648.412 ms) : 0, 648412
GlobalTracer [baseline] (281.823 ms) : 0, 281823
GlobalTracer [candidate] (282.379 ms) : 0, 282379
AppSec [baseline] (32.416 ms) : 0, 32416
AppSec [candidate] (32.451 ms) : 0, 32451
Debugger [baseline] (68.106 ms) : 0, 68106
Debugger [candidate] (68.45 ms) : 0, 68450
Remote Config [baseline] (673.397 µs) : 0, 673
Remote Config [candidate] (645.844 µs) : 0, 646
Telemetry [baseline] (8.95 ms) : 0, 8950
Telemetry [candidate] (9.105 ms) : 0, 9105
Flare Poller [baseline] (3.706 ms) : 0, 3706
Flare Poller [candidate] (3.776 ms) : 0, 3776
section appsec
crashtracking [baseline] (1.217 ms) : 0, 1217
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (693.452 ms) : 0, 693452
BytebuddyAgent [candidate] (691.977 ms) : 0, 691977
GlobalTracer [baseline] (262.171 ms) : 0, 262171
GlobalTracer [candidate] (260.269 ms) : 0, 260269
IAST [baseline] (25.134 ms) : 0, 25134
IAST [candidate] (24.812 ms) : 0, 24812
AppSec [baseline] (175.434 ms) : 0, 175434
AppSec [candidate] (174.636 ms) : 0, 174636
Debugger [baseline] (66.722 ms) : 0, 66722
Debugger [candidate] (68.108 ms) : 0, 68108
Remote Config [baseline] (712.708 µs) : 0, 713
Remote Config [candidate] (704.261 µs) : 0, 704
Telemetry [baseline] (9.124 ms) : 0, 9124
Telemetry [candidate] (9.093 ms) : 0, 9093
Flare Poller [baseline] (3.886 ms) : 0, 3886
Flare Poller [candidate] (3.915 ms) : 0, 3915
section iast
crashtracking [baseline] (1.203 ms) : 0, 1203
crashtracking [candidate] (1.204 ms) : 0, 1204
BytebuddyAgent [baseline] (796.828 ms) : 0, 796828
BytebuddyAgent [candidate] (797.686 ms) : 0, 797686
GlobalTracer [baseline] (257.833 ms) : 0, 257833
GlobalTracer [candidate] (257.021 ms) : 0, 257021
IAST [baseline] (26.794 ms) : 0, 26794
IAST [candidate] (27.013 ms) : 0, 27013
AppSec [baseline] (35.498 ms) : 0, 35498
AppSec [candidate] (35.465 ms) : 0, 35465
Debugger [baseline] (65.568 ms) : 0, 65568
Debugger [candidate] (65.53 ms) : 0, 65530
Remote Config [baseline] (551.714 µs) : 0, 552
Remote Config [candidate] (608.558 µs) : 0, 609
Telemetry [baseline] (8.344 ms) : 0, 8344
Telemetry [candidate] (8.501 ms) : 0, 8501
Flare Poller [baseline] (3.446 ms) : 0, 3446
Flare Poller [candidate] (3.496 ms) : 0, 3496
section profiling
crashtracking [baseline] (1.217 ms) : 0, 1217
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (710.71 ms) : 0, 710710
BytebuddyAgent [candidate] (706.79 ms) : 0, 706790
GlobalTracer [baseline] (223.431 ms) : 0, 223431
GlobalTracer [candidate] (222.542 ms) : 0, 222542
AppSec [baseline] (32.758 ms) : 0, 32758
AppSec [candidate] (32.569 ms) : 0, 32569
Debugger [baseline] (68.824 ms) : 0, 68824
Debugger [candidate] (68.365 ms) : 0, 68365
Remote Config [baseline] (665.616 µs) : 0, 666
Remote Config [candidate] (644.483 µs) : 0, 644
Telemetry [baseline] (9.164 ms) : 0, 9164
Telemetry [candidate] (9.071 ms) : 0, 9071
Flare Poller [baseline] (3.835 ms) : 0, 3835
Flare Poller [candidate] (3.86 ms) : 0, 3860
ProfilingAgent [baseline] (99.73 ms) : 0, 99730
ProfilingAgent [candidate] (98.011 ms) : 0, 98011
Profiling [baseline] (100.329 ms) : 0, 100329
Profiling [candidate] (98.592 ms) : 0, 98592
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~739ec923e5, baseline=1.57.0-SNAPSHOT~0d1a541243

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.08 s) : 0, 1079839
Total [baseline] (8.725 s) : 0, 8725281
Agent [candidate] (1.088 s) : 0, 1088343
Total [candidate] (8.769 s) : 0, 8769333
section iast
Agent [baseline] (1.222 s) : 0, 1221809
Total [baseline] (9.468 s) : 0, 9468191
Agent [candidate] (1.223 s) : 0, 1222634
Total [candidate] (9.46 s) : 0, 9459558
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.08 s -
Agent iast 1.222 s 141.97 ms (13.1%)
Total tracing 8.725 s -
Total iast 9.468 s 742.91 ms (8.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.088 s -
Agent iast 1.223 s 134.291 ms (12.3%)
Total tracing 8.769 s -
Total iast 9.46 s 690.225 ms (7.9%)
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~739ec923e5, baseline=1.57.0-SNAPSHOT~0d1a541243

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (648.133 ms) : 0, 648133
BytebuddyAgent [candidate] (653.393 ms) : 0, 653393
GlobalTracer [baseline] (281.381 ms) : 0, 281381
GlobalTracer [candidate] (284.01 ms) : 0, 284010
AppSec [baseline] (32.449 ms) : 0, 32449
AppSec [candidate] (32.663 ms) : 0, 32663
Debugger [baseline] (67.648 ms) : 0, 67648
Debugger [candidate] (67.765 ms) : 0, 67765
Remote Config [baseline] (661.05 µs) : 0, 661
Remote Config [candidate] (632.972 µs) : 0, 633
Telemetry [baseline] (8.999 ms) : 0, 8999
Telemetry [candidate] (9.087 ms) : 0, 9087
Flare Poller [baseline] (3.761 ms) : 0, 3761
Flare Poller [candidate] (3.736 ms) : 0, 3736
section iast
crashtracking [baseline] (1.18 ms) : 0, 1180
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (790.927 ms) : 0, 790927
BytebuddyAgent [candidate] (790.724 ms) : 0, 790724
GlobalTracer [baseline] (255.721 ms) : 0, 255721
GlobalTracer [candidate] (255.619 ms) : 0, 255619
IAST [baseline] (26.753 ms) : 0, 26753
IAST [candidate] (26.899 ms) : 0, 26899
AppSec [baseline] (35.432 ms) : 0, 35432
AppSec [candidate] (34.679 ms) : 0, 34679
Debugger [baseline] (63.996 ms) : 0, 63996
Debugger [candidate] (65.733 ms) : 0, 65733
Remote Config [baseline] (543.696 µs) : 0, 544
Remote Config [candidate] (561.485 µs) : 0, 561
Telemetry [baseline] (8.411 ms) : 0, 8411
Telemetry [candidate] (8.424 ms) : 0, 8424
Flare Poller [baseline] (3.433 ms) : 0, 3433
Flare Poller [candidate] (3.423 ms) : 0, 3423
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/tlm_test_stability
git_commit_date 1765286973 1765288209
git_commit_sha 0d1a541 739ec92
release_version 1.57.0-SNAPSHOT~0d1a541243 1.57.0-SNAPSHOT~739ec923e5
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765290496 1765290496
ci_job_id 1279485412 1279485412
ci_pipeline_id 85580388 85580388
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-aey161np 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-aey161np 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 1 performance regressions! Performance is the same for 16 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:code_origins:high_load better
[-958.287µs; -427.807µs] or [-5.326%; -2.378%]
better
[-2.032ms; -0.779ms] or [-6.847%; -2.625%]
unstable
[-14.996op/s; +37.934op/s] or [-5.927%; +14.992%]
17.298ms 28.268ms 264.500op/s 17.991ms 29.673ms 253.031op/s
scenario:load:petclinic:profiling:high_load unstable
[+1.229ms; +3.401ms] or [+6.783%; +18.775%]
worse
[+1.687ms; +3.651ms] or [+5.747%; +12.437%]
unstable
[-56.167op/s; -0.478op/s] or [-22.231%; -0.189%]
20.432ms 32.029ms 224.333op/s 18.117ms 29.359ms 252.656op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~739ec923e5, baseline=1.57.0-SNAPSHOT~0d1a541243
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.209 ms) : 1197, 1221
.   : milestone, 1209,
iast (3.152 ms) : 3113, 3192
.   : milestone, 3152,
iast_FULL (5.693 ms) : 5636, 5750
.   : milestone, 5693,
iast_GLOBAL (3.465 ms) : 3415, 3514
.   : milestone, 3465,
profiling (2.249 ms) : 2228, 2269
.   : milestone, 2249,
tracing (1.819 ms) : 1804, 1835
.   : milestone, 1819,
section candidate
no_agent (1.212 ms) : 1200, 1224
.   : milestone, 1212,
iast (3.256 ms) : 3216, 3296
.   : milestone, 3256,
iast_FULL (5.659 ms) : 5604, 5714
.   : milestone, 5659,
iast_GLOBAL (3.563 ms) : 3512, 3615
.   : milestone, 3563,
profiling (2.057 ms) : 2040, 2075
.   : milestone, 2057,
tracing (1.785 ms) : 1771, 1799
.   : milestone, 1785,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.209 ms [1.197 ms, 1.221 ms] -
iast 3.152 ms [3.113 ms, 3.192 ms] 1.943 ms (160.7%)
iast_FULL 5.693 ms [5.636 ms, 5.75 ms] 4.483 ms (370.7%)
iast_GLOBAL 3.465 ms [3.415 ms, 3.514 ms] 2.256 ms (186.5%)
profiling 2.249 ms [2.228 ms, 2.269 ms] 1.039 ms (85.9%)
tracing 1.819 ms [1.804 ms, 1.835 ms] 610.046 µs (50.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.212 ms [1.2 ms, 1.224 ms] -
iast 3.256 ms [3.216 ms, 3.296 ms] 2.044 ms (168.6%)
iast_FULL 5.659 ms [5.604 ms, 5.714 ms] 4.447 ms (366.9%)
iast_GLOBAL 3.563 ms [3.512 ms, 3.615 ms] 2.351 ms (194.0%)
profiling 2.057 ms [2.04 ms, 2.075 ms] 845.145 µs (69.7%)
tracing 1.785 ms [1.771 ms, 1.799 ms] 572.826 µs (47.3%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~739ec923e5, baseline=1.57.0-SNAPSHOT~0d1a541243
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.891 ms) : 17711, 18070
.   : milestone, 17891,
appsec (18.611 ms) : 18420, 18802
.   : milestone, 18611,
code_origins (18.442 ms) : 18258, 18626
.   : milestone, 18442,
iast (17.69 ms) : 17517, 17863
.   : milestone, 17690,
profiling (18.47 ms) : 18289, 18651
.   : milestone, 18470,
tracing (18.036 ms) : 17850, 18223
.   : milestone, 18036,
section candidate
no_agent (17.802 ms) : 17623, 17981
.   : milestone, 17802,
appsec (18.488 ms) : 18297, 18678
.   : milestone, 18488,
code_origins (17.635 ms) : 17460, 17810
.   : milestone, 17635,
iast (17.606 ms) : 17433, 17780
.   : milestone, 17606,
profiling (20.194 ms) : 19981, 20408
.   : milestone, 20194,
tracing (17.98 ms) : 17800, 18159
.   : milestone, 17980,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.891 ms [17.711 ms, 18.07 ms] -
appsec 18.611 ms [18.42 ms, 18.802 ms] 719.686 µs (4.0%)
code_origins 18.442 ms [18.258 ms, 18.626 ms] 551.345 µs (3.1%)
iast 17.69 ms [17.517 ms, 17.863 ms] -200.65 µs (-1.1%)
profiling 18.47 ms [18.289 ms, 18.651 ms] 579.518 µs (3.2%)
tracing 18.036 ms [17.85 ms, 18.223 ms] 145.508 µs (0.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.802 ms [17.623 ms, 17.981 ms] -
appsec 18.488 ms [18.297 ms, 18.678 ms] 685.656 µs (3.9%)
code_origins 17.635 ms [17.46 ms, 17.81 ms] -166.491 µs (-0.9%)
iast 17.606 ms [17.433 ms, 17.78 ms] -195.608 µs (-1.1%)
profiling 20.194 ms [19.981 ms, 20.408 ms] 2.392 ms (13.4%)
tracing 17.98 ms [17.8 ms, 18.159 ms] 177.673 µs (1.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/tlm_test_stability
git_commit_date 1765286973 1765288209
git_commit_sha 0d1a541 739ec92
release_version 1.57.0-SNAPSHOT~0d1a541243 1.57.0-SNAPSHOT~739ec923e5
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1765290212 1765290212
ci_job_id 1279485415 1279485415
ci_pipeline_id 85580388 85580388
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-tocvtcxi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-tocvtcxi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~739ec923e5, baseline=1.57.0-SNAPSHOT~0d1a541243
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (3.629 ms) : 3413, 3845
.   : milestone, 3629,
iast (2.207 ms) : 2142, 2271
.   : milestone, 2207,
iast_GLOBAL (2.245 ms) : 2181, 2310
.   : milestone, 2245,
profiling (2.063 ms) : 2011, 2116
.   : milestone, 2063,
tracing (2.036 ms) : 1985, 2087
.   : milestone, 2036,
section candidate
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (3.688 ms) : 3468, 3907
.   : milestone, 3688,
iast (2.196 ms) : 2132, 2260
.   : milestone, 2196,
iast_GLOBAL (2.243 ms) : 2178, 2308
.   : milestone, 2243,
profiling (2.08 ms) : 2026, 2134
.   : milestone, 2080,
tracing (2.036 ms) : 1985, 2087
.   : milestone, 2036,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 3.629 ms [3.413 ms, 3.845 ms] 2.159 ms (146.8%)
iast 2.207 ms [2.142 ms, 2.271 ms] 736.077 µs (50.1%)
iast_GLOBAL 2.245 ms [2.181 ms, 2.31 ms] 774.646 µs (52.7%)
profiling 2.063 ms [2.011 ms, 2.116 ms] 592.831 µs (40.3%)
tracing 2.036 ms [1.985 ms, 2.087 ms] 565.709 µs (38.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 3.688 ms [3.468 ms, 3.907 ms] 2.217 ms (150.8%)
iast 2.196 ms [2.132 ms, 2.26 ms] 725.342 µs (49.3%)
iast_GLOBAL 2.243 ms [2.178 ms, 2.308 ms] 772.677 µs (52.6%)
profiling 2.08 ms [2.026 ms, 2.134 ms] 609.335 µs (41.4%)
tracing 2.036 ms [1.985 ms, 2.087 ms] 565.838 µs (38.5%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~739ec923e5, baseline=1.57.0-SNAPSHOT~0d1a541243
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.694 s) : 14694000, 14694000
.   : milestone, 14694000,
appsec (14.544 s) : 14544000, 14544000
.   : milestone, 14544000,
iast (18.134 s) : 18134000, 18134000
.   : milestone, 18134000,
iast_GLOBAL (17.972 s) : 17972000, 17972000
.   : milestone, 17972000,
profiling (14.47 s) : 14470000, 14470000
.   : milestone, 14470000,
tracing (14.723 s) : 14723000, 14723000
.   : milestone, 14723000,
section candidate
no_agent (15.33 s) : 15330000, 15330000
.   : milestone, 15330000,
appsec (14.801 s) : 14801000, 14801000
.   : milestone, 14801000,
iast (18.442 s) : 18442000, 18442000
.   : milestone, 18442000,
iast_GLOBAL (17.946 s) : 17946000, 17946000
.   : milestone, 17946000,
profiling (14.54 s) : 14540000, 14540000
.   : milestone, 14540000,
tracing (14.605 s) : 14605000, 14605000
.   : milestone, 14605000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.694 s [14.694 s, 14.694 s] -
appsec 14.544 s [14.544 s, 14.544 s] -150.0 ms (-1.0%)
iast 18.134 s [18.134 s, 18.134 s] 3.44 s (23.4%)
iast_GLOBAL 17.972 s [17.972 s, 17.972 s] 3.278 s (22.3%)
profiling 14.47 s [14.47 s, 14.47 s] -224.0 ms (-1.5%)
tracing 14.723 s [14.723 s, 14.723 s] 29.0 ms (0.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.33 s [15.33 s, 15.33 s] -
appsec 14.801 s [14.801 s, 14.801 s] -529.0 ms (-3.5%)
iast 18.442 s [18.442 s, 18.442 s] 3.112 s (20.3%)
iast_GLOBAL 17.946 s [17.946 s, 17.946 s] 2.616 s (17.1%)
profiling 14.54 s [14.54 s, 14.54 s] -790.0 ms (-5.2%)
tracing 14.605 s [14.605 s, 14.605 s] -725.0 ms (-4.7%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes type: refactoring

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants