Skip to content

Conversation

jandro996
Copy link
Member

@jandro996 jandro996 commented Oct 9, 2025

What Does This Do

  1. Adding remote configuration capabilities:

    • CAPABILITY_ASM_PROCESSOR_OVERRIDES (16)
    • CAPABILITY_ASM_CUSTOM_DATA_SCANNERS (17)

    These capabilities inform remote config that this tracer version supports processor overrides and custom data scanners, allowing remote config to send these configurations.

  2. Upgrading libddwaf from 17.1.0 to 17.2.0

    This version of libddwaf can process the processor_overrides and scanners configuration keys. The existing configuration forwarding mechanism (already present in the codebase) passes these keys to libddwaf without modification.

  3. Updated tests to verify new capabilities are properly registered and removed

  4. Added smoke test (ProcessorOverridesSmokeTest) that verifies end-to-end functionality:
    - Creates a custom configuration with a custom scanner and processor overrides
    - Verifies that both processor_overrides and scanners keys are forwarded to libddwaf without alteration
    - Confirms libddwaf 18.0.0 correctly processes the custom configuration
    - Tests positive case (pattern detected) and negative case (pattern not detected)

Motivation

RFC establish that:

  • Tracers MUST be upgraded to include libddwaf v1.29.0, which will contain support for the new definition of processor overrides and custom scanners.
  • Tracers MUST ensure that the processor_overrides and scanners key provided through an ASM configuration is forwarded to libddwaf without alteration.
  • Tracers MUST provide the ASM_PROCESSOR_OVERRIDES (16) and ASM_CUSTOM_DATA_SCANNERS (17) capabilities through remote configuration.

Additional Notes

The tracer already forwards all ASM configuration to libddwaf via wafBuilder.addOrUpdateConfig(). This PR enables the complete flow by:

  • Announcing support via capabilities → Remote config sends the new configuration keys → Existing forwarding passes them to libddwaf 17.2.0 → libddwaf processes them

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@datadog-datadog-prod-us1
Copy link
Contributor

datadog-datadog-prod-us1 bot commented Oct 9, 2025

🎯 Code Coverage
Patch Coverage: 100.00%
Total Coverage: 54.46% (-5.23%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: e9130db | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Oct 9, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alejandro.gonzalez/API-Security-Custom-Data-Classification
git_commit_date 1759995296 1760017431
git_commit_sha 24adc9a e9130db
release_version 1.55.0-SNAPSHOT~24adc9a61e 1.55.0-SNAPSHOT~e9130db8b9
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1760019169 1760019169
ci_job_id 1171770470 1171770470
ci_pipeline_id 78850283 78850283
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-uwvgmpl8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-uwvgmpl8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 5 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.55.0-SNAPSHOT~e9130db8b9, baseline=1.55.0-SNAPSHOT~24adc9a61e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.021 s) : 0, 1021059
Total [baseline] (10.751 s) : 0, 10750922
Agent [candidate] (1.017 s) : 0, 1016946
Total [candidate] (10.821 s) : 0, 10820753
section appsec
Agent [baseline] (1.204 s) : 0, 1204105
Total [baseline] (11.069 s) : 0, 11069362
Agent [candidate] (1.207 s) : 0, 1207372
Total [candidate] (11.188 s) : 0, 11187887
section iast
Agent [baseline] (1.161 s) : 0, 1161048
Total [baseline] (10.984 s) : 0, 10983681
Agent [candidate] (1.151 s) : 0, 1150522
Total [candidate] (10.955 s) : 0, 10955322
section profiling
Agent [baseline] (1.161 s) : 0, 1160718
Total [baseline] (11.045 s) : 0, 11044625
Agent [candidate] (1.167 s) : 0, 1166722
Total [candidate] (11.018 s) : 0, 11018326
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.021 s -
Agent appsec 1.204 s 183.046 ms (17.9%)
Agent iast 1.161 s 139.989 ms (13.7%)
Agent profiling 1.161 s 139.658 ms (13.7%)
Total tracing 10.751 s -
Total appsec 11.069 s 318.44 ms (3.0%)
Total iast 10.984 s 232.759 ms (2.2%)
Total profiling 11.045 s 293.704 ms (2.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.017 s -
Agent appsec 1.207 s 190.426 ms (18.7%)
Agent iast 1.151 s 133.575 ms (13.1%)
Agent profiling 1.167 s 149.776 ms (14.7%)
Total tracing 10.821 s -
Total appsec 11.188 s 367.134 ms (3.4%)
Total iast 10.955 s 134.569 ms (1.2%)
Total profiling 11.018 s 197.573 ms (1.8%)
gantt
    title petclinic - break down per module: candidate=1.55.0-SNAPSHOT~e9130db8b9, baseline=1.55.0-SNAPSHOT~24adc9a61e

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.467 ms) : 0, 1467
crashtracking [candidate] (1.467 ms) : 0, 1467
BytebuddyAgent [baseline] (693.913 ms) : 0, 693913
BytebuddyAgent [candidate] (693.105 ms) : 0, 693105
GlobalTracer [baseline] (243.525 ms) : 0, 243525
GlobalTracer [candidate] (241.934 ms) : 0, 241934
AppSec [baseline] (32.679 ms) : 0, 32679
AppSec [candidate] (32.479 ms) : 0, 32479
Debugger [baseline] (6.455 ms) : 0, 6455
Debugger [candidate] (6.441 ms) : 0, 6441
Remote Config [baseline] (709.608 µs) : 0, 710
Remote Config [candidate] (705.907 µs) : 0, 706
Telemetry [baseline] (9.331 ms) : 0, 9331
Telemetry [candidate] (9.336 ms) : 0, 9336
Flare Poller [baseline] (11.723 ms) : 0, 11723
Flare Poller [candidate] (10.231 ms) : 0, 10231
section appsec
crashtracking [baseline] (1.486 ms) : 0, 1486
crashtracking [candidate] (1.48 ms) : 0, 1480
BytebuddyAgent [baseline] (724.566 ms) : 0, 724566
BytebuddyAgent [candidate] (727.043 ms) : 0, 727043
GlobalTracer [baseline] (235.603 ms) : 0, 235603
GlobalTracer [candidate] (237.429 ms) : 0, 237429
AppSec [baseline] (176.753 ms) : 0, 176753
AppSec [candidate] (175.856 ms) : 0, 175856
Debugger [baseline] (6.184 ms) : 0, 6184
Debugger [candidate] (6.095 ms) : 0, 6095
Remote Config [baseline] (631.116 µs) : 0, 631
Remote Config [candidate] (629.369 µs) : 0, 629
Telemetry [baseline] (8.51 ms) : 0, 8510
Telemetry [candidate] (8.391 ms) : 0, 8391
Flare Poller [baseline] (3.993 ms) : 0, 3993
Flare Poller [candidate] (3.992 ms) : 0, 3992
IAST [baseline] (25.031 ms) : 0, 25031
IAST [candidate] (25.099 ms) : 0, 25099
section iast
crashtracking [baseline] (1.479 ms) : 0, 1479
crashtracking [candidate] (1.459 ms) : 0, 1459
BytebuddyAgent [baseline] (823.024 ms) : 0, 823024
BytebuddyAgent [candidate] (814.618 ms) : 0, 814618
GlobalTracer [baseline] (233.486 ms) : 0, 233486
GlobalTracer [candidate] (231.746 ms) : 0, 231746
AppSec [baseline] (35.273 ms) : 0, 35273
AppSec [candidate] (35.2 ms) : 0, 35200
Debugger [baseline] (6.17 ms) : 0, 6170
Debugger [candidate] (6.126 ms) : 0, 6126
Remote Config [baseline] (610.725 µs) : 0, 611
Remote Config [candidate] (635.493 µs) : 0, 635
Telemetry [baseline] (8.612 ms) : 0, 8612
Telemetry [candidate] (8.54 ms) : 0, 8540
Flare Poller [baseline] (4.258 ms) : 0, 4258
Flare Poller [candidate] (4.308 ms) : 0, 4308
IAST [baseline] (26.668 ms) : 0, 26668
IAST [candidate] (26.475 ms) : 0, 26475
section profiling
ProfilingAgent [baseline] (106.571 ms) : 0, 106571
ProfilingAgent [candidate] (106.679 ms) : 0, 106679
crashtracking [baseline] (1.428 ms) : 0, 1428
crashtracking [candidate] (1.456 ms) : 0, 1456
BytebuddyAgent [baseline] (721.321 ms) : 0, 721321
BytebuddyAgent [candidate] (725.448 ms) : 0, 725448
GlobalTracer [baseline] (217.18 ms) : 0, 217180
GlobalTracer [candidate] (218.484 ms) : 0, 218484
AppSec [baseline] (32.663 ms) : 0, 32663
AppSec [candidate] (32.968 ms) : 0, 32968
Debugger [baseline] (6.442 ms) : 0, 6442
Debugger [candidate] (8.061 ms) : 0, 8061
Remote Config [baseline] (704.829 µs) : 0, 705
Remote Config [candidate] (705.927 µs) : 0, 706
Telemetry [baseline] (16.864 ms) : 0, 16864
Telemetry [candidate] (15.019 ms) : 0, 15019
Flare Poller [baseline] (4.216 ms) : 0, 4216
Flare Poller [candidate] (4.204 ms) : 0, 4204
Profiling [baseline] (107.934 ms) : 0, 107934
Profiling [candidate] (108.158 ms) : 0, 108158
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.55.0-SNAPSHOT~e9130db8b9, baseline=1.55.0-SNAPSHOT~24adc9a61e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.017 s) : 0, 1017323
Total [baseline] (8.736 s) : 0, 8735941
Agent [candidate] (1.02 s) : 0, 1019776
Total [candidate] (8.669 s) : 0, 8669266
section iast
Agent [baseline] (1.15 s) : 0, 1150064
Total [baseline] (9.304 s) : 0, 9303887
Agent [candidate] (1.151 s) : 0, 1150997
Total [candidate] (9.344 s) : 0, 9344155
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.017 s -
Agent iast 1.15 s 132.741 ms (13.0%)
Total tracing 8.736 s -
Total iast 9.304 s 567.946 ms (6.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.02 s -
Agent iast 1.151 s 131.221 ms (12.9%)
Total tracing 8.669 s -
Total iast 9.344 s 674.889 ms (7.8%)
gantt
    title insecure-bank - break down per module: candidate=1.55.0-SNAPSHOT~e9130db8b9, baseline=1.55.0-SNAPSHOT~24adc9a61e

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.47 ms) : 0, 1470
crashtracking [candidate] (1.478 ms) : 0, 1478
BytebuddyAgent [baseline] (693.896 ms) : 0, 693896
BytebuddyAgent [candidate] (696.283 ms) : 0, 696283
GlobalTracer [baseline] (242.108 ms) : 0, 242108
GlobalTracer [candidate] (241.657 ms) : 0, 241657
AppSec [baseline] (32.492 ms) : 0, 32492
AppSec [candidate] (32.158 ms) : 0, 32158
Debugger [baseline] (6.389 ms) : 0, 6389
Debugger [candidate] (6.376 ms) : 0, 6376
Remote Config [baseline] (723.379 µs) : 0, 723
Remote Config [candidate] (698.194 µs) : 0, 698
Telemetry [baseline] (9.395 ms) : 0, 9395
Telemetry [candidate] (9.331 ms) : 0, 9331
Flare Poller [baseline] (9.582 ms) : 0, 9582
Flare Poller [candidate] (10.622 ms) : 0, 10622
section iast
crashtracking [baseline] (1.464 ms) : 0, 1464
crashtracking [candidate] (1.474 ms) : 0, 1474
BytebuddyAgent [baseline] (814.277 ms) : 0, 814277
BytebuddyAgent [candidate] (815.548 ms) : 0, 815548
GlobalTracer [baseline] (231.999 ms) : 0, 231999
GlobalTracer [candidate] (231.694 ms) : 0, 231694
AppSec [baseline] (35.075 ms) : 0, 35075
AppSec [candidate] (34.956 ms) : 0, 34956
Debugger [baseline] (6.082 ms) : 0, 6082
Debugger [candidate] (6.145 ms) : 0, 6145
Remote Config [baseline] (607.13 µs) : 0, 607
Remote Config [candidate] (609.975 µs) : 0, 610
Telemetry [baseline] (8.559 ms) : 0, 8559
Telemetry [candidate] (8.621 ms) : 0, 8621
Flare Poller [baseline] (4.275 ms) : 0, 4275
Flare Poller [candidate] (4.243 ms) : 0, 4243
IAST [baseline] (26.478 ms) : 0, 26478
IAST [candidate] (26.329 ms) : 0, 26329
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alejandro.gonzalez/API-Security-Custom-Data-Classification
git_commit_date 1759995296 1760017431
git_commit_sha 24adc9a e9130db
release_version 1.55.0-SNAPSHOT~24adc9a61e 1.55.0-SNAPSHOT~e9130db8b9
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1760018834 1760018834
ci_job_id 1171770472 1171770472
ci_pipeline_id 78850283 78850283
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-83m5rias 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-83m5rias 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 3 performance regressions! Performance is the same for 5 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:tracing:high_load better
[-396.472µs; -161.160µs] or [-5.134%; -2.087%]
unstable
[-58.195op/s; +102.445op/s] or [-9.701%; +17.077%]
7.444ms 622.031op/s 7.723ms 599.906op/s
scenario:load:insecure-bank:iast:high_load worse
[+365.950µs; +721.045µs] or [+3.869%; +7.623%]
unstable
[-84.330op/s; +31.080op/s] or [-17.170%; +6.328%]
10.002ms 464.531op/s 9.459ms 491.156op/s
scenario:load:petclinic:no_agent:high_load better
[-2.365ms; -1.712ms] or [-6.197%; -4.486%]
unstable
[-2.428op/s; +16.178op/s] or [-1.981%; +13.202%]
36.122ms 129.412op/s 38.161ms 122.537op/s
scenario:load:petclinic:appsec:high_load better
[-4.214ms; -3.228ms] or [-8.141%; -6.237%]
unstable
[-1.014op/s; +12.649op/s] or [-1.107%; +13.812%]
48.046ms 97.400op/s 51.767ms 91.582op/s
scenario:load:petclinic:code_origins:high_load worse
[+0.980ms; +1.827ms] or [+2.258%; +4.208%]
unstable
[-11.423op/s; +4.723op/s] or [-10.605%; +4.385%]
44.831ms 104.362op/s 43.427ms 107.713op/s
scenario:load:petclinic:tracing:high_load worse
[+1.097ms; +1.936ms] or [+2.476%; +4.371%]
unstable
[-12.028op/s; +2.303op/s] or [-11.241%; +2.152%]
45.811ms 102.138op/s 44.294ms 107.000op/s
scenario:load:petclinic:profiling:high_load better
[-2.661ms; -1.641ms] or [-5.183%; -3.197%]
unstable
[-3.825op/s; +9.441op/s] or [-4.142%; +10.224%]
49.186ms 95.150op/s 51.337ms 92.342op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~e9130db8b9, baseline=1.55.0-SNAPSHOT~24adc9a61e
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.266 ms) : 4209, 4323
.   : milestone, 4266,
iast (9.459 ms) : 9295, 9623
.   : milestone, 9459,
iast_FULL (14.119 ms) : 13832, 14406
.   : milestone, 14119,
iast_GLOBAL (10.318 ms) : 10127, 10508
.   : milestone, 10318,
profiling (9.171 ms) : 9003, 9340
.   : milestone, 9171,
tracing (7.723 ms) : 7609, 7836
.   : milestone, 7723,
section candidate
no_agent (4.347 ms) : 4297, 4397
.   : milestone, 4347,
iast (10.002 ms) : 9836, 10168
.   : milestone, 10002,
iast_FULL (14.195 ms) : 13917, 14473
.   : milestone, 14195,
iast_GLOBAL (10.462 ms) : 10275, 10650
.   : milestone, 10462,
profiling (9.287 ms) : 9134, 9441
.   : milestone, 9287,
tracing (7.444 ms) : 7338, 7549
.   : milestone, 7444,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.266 ms [4.209 ms, 4.323 ms] -
iast 9.459 ms [9.295 ms, 9.623 ms] 5.193 ms (121.7%)
iast_FULL 14.119 ms [13.832 ms, 14.406 ms] 9.853 ms (231.0%)
iast_GLOBAL 10.318 ms [10.127 ms, 10.508 ms] 6.052 ms (141.9%)
profiling 9.171 ms [9.003 ms, 9.34 ms] 4.905 ms (115.0%)
tracing 7.723 ms [7.609 ms, 7.836 ms] 3.457 ms (81.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.347 ms [4.297 ms, 4.397 ms] -
iast 10.002 ms [9.836 ms, 10.168 ms] 5.655 ms (130.1%)
iast_FULL 14.195 ms [13.917 ms, 14.473 ms] 9.848 ms (226.5%)
iast_GLOBAL 10.462 ms [10.275 ms, 10.65 ms] 6.115 ms (140.7%)
profiling 9.287 ms [9.134 ms, 9.441 ms] 4.94 ms (113.6%)
tracing 7.444 ms [7.338 ms, 7.549 ms] 3.097 ms (71.2%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~e9130db8b9, baseline=1.55.0-SNAPSHOT~24adc9a61e
    dateFormat X
    axisFormat %s
section baseline
no_agent (38.161 ms) : 37853, 38469
.   : milestone, 38161,
appsec (51.767 ms) : 51280, 52254
.   : milestone, 51767,
code_origins (43.427 ms) : 43044, 43810
.   : milestone, 43427,
iast (45.609 ms) : 45238, 45981
.   : milestone, 45609,
profiling (51.337 ms) : 50827, 51846
.   : milestone, 51337,
tracing (44.294 ms) : 43913, 44675
.   : milestone, 44294,
section candidate
no_agent (36.122 ms) : 35823, 36421
.   : milestone, 36122,
appsec (48.046 ms) : 47619, 48472
.   : milestone, 48046,
code_origins (44.831 ms) : 44427, 45235
.   : milestone, 44831,
iast (45.938 ms) : 45534, 46343
.   : milestone, 45938,
profiling (49.186 ms) : 48751, 49621
.   : milestone, 49186,
tracing (45.811 ms) : 45412, 46210
.   : milestone, 45811,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 38.161 ms [37.853 ms, 38.469 ms] -
appsec 51.767 ms [51.28 ms, 52.254 ms] 13.606 ms (35.7%)
code_origins 43.427 ms [43.044 ms, 43.81 ms] 5.266 ms (13.8%)
iast 45.609 ms [45.238 ms, 45.981 ms] 7.449 ms (19.5%)
profiling 51.337 ms [50.827 ms, 51.846 ms] 13.176 ms (34.5%)
tracing 44.294 ms [43.913 ms, 44.675 ms] 6.134 ms (16.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.122 ms [35.823 ms, 36.421 ms] -
appsec 48.046 ms [47.619 ms, 48.472 ms] 11.923 ms (33.0%)
code_origins 44.831 ms [44.427 ms, 45.235 ms] 8.708 ms (24.1%)
iast 45.938 ms [45.534 ms, 46.343 ms] 9.816 ms (27.2%)
profiling 49.186 ms [48.751 ms, 49.621 ms] 13.063 ms (36.2%)
tracing 45.811 ms [45.412 ms, 46.21 ms] 9.688 ms (26.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alejandro.gonzalez/API-Security-Custom-Data-Classification
git_commit_date 1759995296 1760017431
git_commit_sha 24adc9a e9130db
release_version 1.55.0-SNAPSHOT~24adc9a61e 1.55.0-SNAPSHOT~e9130db8b9
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1760019310 1760019310
ci_job_id 1171770474 1171770474
ci_pipeline_id 78850283 78850283
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-dmq81prg 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-dmq81prg 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.356ms; -1.021ms] or [-37.166%; -27.997%]
2.459ms 3.648ms
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~e9130db8b9, baseline=1.55.0-SNAPSHOT~24adc9a61e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (3.648 ms) : 3434, 3862
.   : milestone, 3648,
iast (2.209 ms) : 2145, 2273
.   : milestone, 2209,
iast_GLOBAL (2.255 ms) : 2191, 2319
.   : milestone, 2255,
profiling (2.042 ms) : 1992, 2093
.   : milestone, 2042,
tracing (2.035 ms) : 1985, 2085
.   : milestone, 2035,
section candidate
no_agent (1.472 ms) : 1460, 1483
.   : milestone, 1472,
appsec (2.459 ms) : 2408, 2510
.   : milestone, 2459,
iast (2.202 ms) : 2138, 2266
.   : milestone, 2202,
iast_GLOBAL (2.251 ms) : 2187, 2316
.   : milestone, 2251,
profiling (2.044 ms) : 1993, 2095
.   : milestone, 2044,
tracing (2.028 ms) : 1979, 2078
.   : milestone, 2028,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.485 ms] -
appsec 3.648 ms [3.434 ms, 3.862 ms] 2.174 ms (147.5%)
iast 2.209 ms [2.145 ms, 2.273 ms] 735.443 µs (49.9%)
iast_GLOBAL 2.255 ms [2.191 ms, 2.319 ms] 781.401 µs (53.0%)
profiling 2.042 ms [1.992 ms, 2.093 ms] 568.671 µs (38.6%)
tracing 2.035 ms [1.985 ms, 2.085 ms] 561.473 µs (38.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.46 ms, 1.483 ms] -
appsec 2.459 ms [2.408 ms, 2.51 ms] 987.554 µs (67.1%)
iast 2.202 ms [2.138 ms, 2.266 ms] 729.87 µs (49.6%)
iast_GLOBAL 2.251 ms [2.187 ms, 2.316 ms] 779.715 µs (53.0%)
profiling 2.044 ms [1.993 ms, 2.095 ms] 572.431 µs (38.9%)
tracing 2.028 ms [1.979 ms, 2.078 ms] 556.772 µs (37.8%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~e9130db8b9, baseline=1.55.0-SNAPSHOT~24adc9a61e
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.393 s) : 15393000, 15393000
.   : milestone, 15393000,
appsec (15.054 s) : 15054000, 15054000
.   : milestone, 15054000,
iast (18.687 s) : 18687000, 18687000
.   : milestone, 18687000,
iast_GLOBAL (17.882 s) : 17882000, 17882000
.   : milestone, 17882000,
profiling (15.429 s) : 15429000, 15429000
.   : milestone, 15429000,
tracing (15.039 s) : 15039000, 15039000
.   : milestone, 15039000,
section candidate
no_agent (15.274 s) : 15274000, 15274000
.   : milestone, 15274000,
appsec (15.033 s) : 15033000, 15033000
.   : milestone, 15033000,
iast (18.47 s) : 18470000, 18470000
.   : milestone, 18470000,
iast_GLOBAL (17.727 s) : 17727000, 17727000
.   : milestone, 17727000,
profiling (15.776 s) : 15776000, 15776000
.   : milestone, 15776000,
tracing (15.177 s) : 15177000, 15177000
.   : milestone, 15177000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.393 s [15.393 s, 15.393 s] -
appsec 15.054 s [15.054 s, 15.054 s] -339.0 ms (-2.2%)
iast 18.687 s [18.687 s, 18.687 s] 3.294 s (21.4%)
iast_GLOBAL 17.882 s [17.882 s, 17.882 s] 2.489 s (16.2%)
profiling 15.429 s [15.429 s, 15.429 s] 36.0 ms (0.2%)
tracing 15.039 s [15.039 s, 15.039 s] -354.0 ms (-2.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.274 s [15.274 s, 15.274 s] -
appsec 15.033 s [15.033 s, 15.033 s] -241.0 ms (-1.6%)
iast 18.47 s [18.47 s, 18.47 s] 3.196 s (20.9%)
iast_GLOBAL 17.727 s [17.727 s, 17.727 s] 2.453 s (16.1%)
profiling 15.776 s [15.776 s, 15.776 s] 502.0 ms (3.3%)
tracing 15.177 s [15.177 s, 15.177 s] -97.0 ms (-0.6%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant