Testing CI #10105

piochelepiotr · 2025-12-08T21:44:25Z

This reverts commit 8c64d26.

What Does This Do

Opening this PR just to verify how this bug could have been introduced. Testing if CI can detect the issue.

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

This reverts commit 8c64d26.

github-actions · 2025-12-08T21:44:38Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

pr-commenter · 2025-12-08T22:20:19Z

Kafka / producer-benchmark

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	piotr.wolski/test-ci-revert
git_commit_date	1765222535	1765230222
git_commit_sha	`94e770c`	`70ab1d7`

See matching parameters

	Baseline	Candidate
ci_job_date	1765231324	1765231324
ci_job_id	1277609605	1277609605
ci_pipeline_id	85423830	85423830
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion	11.0.25	11.0.25
jmhVersion	1.36	1.36
jvm	/usr/lib/jvm/java-11-openjdk-amd64/bin/java	/usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName	OpenJDK 64-Bit Server VM	OpenJDK 64-Bit Server VM
vmVersion	11.0.25+9-post-Ubuntu-1ubuntu122.04	11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results

scenario	Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce	same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce	same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce	same

pr-commenter · 2025-12-08T22:31:48Z

Benchmarks

⚠️ Warning: Baseline build not found for merge-base commit. Comparing against the latest commit on master instead.

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	piotr.wolski/test-ci-revert
git_commit_date	1765222535	1765230222
git_commit_sha	`94e770c`	`70ab1d7`
release_version	1.57.0-SNAPSHOT~94e770cd67	1.57.0-SNAPSHOT~70ab1d7bc1

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1765231969	1765231969
ci_job_id	1277609598	1277609598
ci_pipeline_id	85423830	85423830
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-v7rlek6c 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-v7rlek6c 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 8 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~70ab1d7bc1, baseline=1.57.0-SNAPSHOT~94e770cd67

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.08 s) : 0, 1079865
Total [baseline] (10.758 s) : 0, 10757991
Agent [candidate] (1.088 s) : 0, 1087782
Total [candidate] (10.836 s) : 0, 10836114
section appsec
Agent [baseline] (1.263 s) : 0, 1262628
Total [baseline] (11.053 s) : 0, 11053310
Agent [candidate] (1.261 s) : 0, 1261024
Total [candidate] (11.054 s) : 0, 11053704
section iast
Agent [baseline] (1.22 s) : 0, 1219748
Total [baseline] (11.117 s) : 0, 11116836
Agent [candidate] (1.234 s) : 0, 1234041
Total [candidate] (11.22 s) : 0, 11220296
section profiling
Agent [baseline] (1.208 s) : 0, 1208492
Total [baseline] (11.16 s) : 0, 11160172
Agent [candidate] (1.205 s) : 0, 1204504
Total [candidate] (11.082 s) : 0, 11081914

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.08 s	-
Agent	appsec	1.263 s	182.763 ms (16.9%)
Agent	iast	1.22 s	139.883 ms (13.0%)
Agent	profiling	1.208 s	128.627 ms (11.9%)
Total	tracing	10.758 s	-
Total	appsec	11.053 s	295.32 ms (2.7%)
Total	iast	11.117 s	358.845 ms (3.3%)
Total	profiling	11.16 s	402.182 ms (3.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.088 s	-
Agent	appsec	1.261 s	173.242 ms (15.9%)
Agent	iast	1.234 s	146.259 ms (13.4%)
Agent	profiling	1.205 s	116.722 ms (10.7%)
Total	tracing	10.836 s	-
Total	appsec	11.054 s	217.59 ms (2.0%)
Total	iast	11.22 s	384.182 ms (3.5%)
Total	profiling	11.082 s	245.801 ms (2.3%)

gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~70ab1d7bc1, baseline=1.57.0-SNAPSHOT~94e770cd67

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.215 ms) : 0, 1215
BytebuddyAgent [baseline] (647.098 ms) : 0, 647098
BytebuddyAgent [candidate] (653.141 ms) : 0, 653141
GlobalTracer [baseline] (281.266 ms) : 0, 281266
GlobalTracer [candidate] (283.466 ms) : 0, 283466
AppSec [baseline] (32.488 ms) : 0, 32488
AppSec [candidate] (32.508 ms) : 0, 32508
Debugger [baseline] (68.855 ms) : 0, 68855
Debugger [candidate] (68.336 ms) : 0, 68336
Remote Config [baseline] (666.08 µs) : 0, 666
Remote Config [candidate] (629.467 µs) : 0, 629
Telemetry [baseline] (9.048 ms) : 0, 9048
Telemetry [candidate] (9.113 ms) : 0, 9113
Flare Poller [baseline] (3.834 ms) : 0, 3834
Flare Poller [candidate] (3.808 ms) : 0, 3808
section appsec
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (688.421 ms) : 0, 688421
BytebuddyAgent [candidate] (687.289 ms) : 0, 687289
GlobalTracer [baseline] (258.459 ms) : 0, 258459
GlobalTracer [candidate] (258.644 ms) : 0, 258644
IAST [baseline] (24.595 ms) : 0, 24595
IAST [candidate] (24.494 ms) : 0, 24494
AppSec [baseline] (173.601 ms) : 0, 173601
AppSec [candidate] (174.494 ms) : 0, 174494
Debugger [baseline] (67.093 ms) : 0, 67093
Debugger [candidate] (65.992 ms) : 0, 65992
Remote Config [baseline] (736.884 µs) : 0, 737
Remote Config [candidate] (687.525 µs) : 0, 688
Telemetry [baseline] (9.033 ms) : 0, 9033
Telemetry [candidate] (9.034 ms) : 0, 9034
Flare Poller [baseline] (4.018 ms) : 0, 4018
Flare Poller [candidate] (3.869 ms) : 0, 3869
section iast
crashtracking [baseline] (1.2 ms) : 0, 1200
crashtracking [candidate] (1.22 ms) : 0, 1220
BytebuddyAgent [baseline] (787.933 ms) : 0, 787933
BytebuddyAgent [candidate] (797.572 ms) : 0, 797572
GlobalTracer [baseline] (254.79 ms) : 0, 254790
GlobalTracer [candidate] (257.998 ms) : 0, 257998
IAST [baseline] (26.896 ms) : 0, 26896
IAST [candidate] (27.445 ms) : 0, 27445
AppSec [baseline] (34.37 ms) : 0, 34370
AppSec [candidate] (34.824 ms) : 0, 34824
Debugger [baseline] (66.707 ms) : 0, 66707
Debugger [candidate] (66.974 ms) : 0, 66974
Remote Config [baseline] (563.458 µs) : 0, 563
Remote Config [candidate] (557.49 µs) : 0, 557
Telemetry [baseline] (8.465 ms) : 0, 8465
Telemetry [candidate] (8.454 ms) : 0, 8454
Flare Poller [baseline] (3.433 ms) : 0, 3433
Flare Poller [candidate] (3.48 ms) : 0, 3480
section profiling
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (703.101 ms) : 0, 703101
BytebuddyAgent [candidate] (702.553 ms) : 0, 702553
GlobalTracer [baseline] (221.439 ms) : 0, 221439
GlobalTracer [candidate] (220.983 ms) : 0, 220983
AppSec [baseline] (32.429 ms) : 0, 32429
AppSec [candidate] (32.149 ms) : 0, 32149
Debugger [baseline] (68.415 ms) : 0, 68415
Debugger [candidate] (67.884 ms) : 0, 67884
Remote Config [baseline] (637.045 µs) : 0, 637
Remote Config [candidate] (649.935 µs) : 0, 650
Telemetry [baseline] (9.124 ms) : 0, 9124
Telemetry [candidate] (9.07 ms) : 0, 9070
Flare Poller [baseline] (3.873 ms) : 0, 3873
Flare Poller [candidate] (3.861 ms) : 0, 3861
ProfilingAgent [baseline] (98.777 ms) : 0, 98777
ProfilingAgent [candidate] (96.641 ms) : 0, 96641
Profiling [baseline] (99.382 ms) : 0, 99382
Profiling [candidate] (97.236 ms) : 0, 97236

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~70ab1d7bc1, baseline=1.57.0-SNAPSHOT~94e770cd67

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.079 s) : 0, 1078946
Total [baseline] (8.773 s) : 0, 8772628
Agent [candidate] (1.079 s) : 0, 1078762
Total [candidate] (8.745 s) : 0, 8745474
section iast
Agent [baseline] (1.225 s) : 0, 1225350
Total [baseline] (9.442 s) : 0, 9441754
Agent [candidate] (1.226 s) : 0, 1225802
Total [candidate] (9.418 s) : 0, 9417736

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.079 s	-
Agent	iast	1.225 s	146.404 ms (13.6%)
Total	tracing	8.773 s	-
Total	iast	9.442 s	669.125 ms (7.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.079 s	-
Agent	iast	1.226 s	147.04 ms (13.6%)
Total	tracing	8.745 s	-
Total	iast	9.418 s	672.262 ms (7.7%)

gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~70ab1d7bc1, baseline=1.57.0-SNAPSHOT~94e770cd67

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.201 ms) : 0, 1201
BytebuddyAgent [baseline] (648.113 ms) : 0, 648113
BytebuddyAgent [candidate] (648.309 ms) : 0, 648309
GlobalTracer [baseline] (281.133 ms) : 0, 281133
GlobalTracer [candidate] (280.998 ms) : 0, 280998
AppSec [baseline] (32.336 ms) : 0, 32336
AppSec [candidate] (32.13 ms) : 0, 32130
Debugger [baseline] (67.346 ms) : 0, 67346
Debugger [candidate] (67.265 ms) : 0, 67265
Remote Config [baseline] (665.484 µs) : 0, 665
Remote Config [candidate] (645.739 µs) : 0, 646
Telemetry [baseline] (8.93 ms) : 0, 8930
Telemetry [candidate] (8.89 ms) : 0, 8890
Flare Poller [baseline] (3.733 ms) : 0, 3733
Flare Poller [candidate] (3.701 ms) : 0, 3701
section iast
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.212 ms) : 0, 1212
BytebuddyAgent [baseline] (793.876 ms) : 0, 793876
BytebuddyAgent [candidate] (795.574 ms) : 0, 795574
GlobalTracer [baseline] (255.889 ms) : 0, 255889
GlobalTracer [candidate] (255.036 ms) : 0, 255036
AppSec [baseline] (35.412 ms) : 0, 35412
AppSec [candidate] (35.144 ms) : 0, 35144
Debugger [baseline] (63.978 ms) : 0, 63978
Debugger [candidate] (64.171 ms) : 0, 64171
Remote Config [baseline] (557.274 µs) : 0, 557
Remote Config [candidate] (581.889 µs) : 0, 582
Telemetry [baseline] (8.347 ms) : 0, 8347
Telemetry [candidate] (8.331 ms) : 0, 8331
Flare Poller [baseline] (3.45 ms) : 0, 3450
Flare Poller [candidate] (3.461 ms) : 0, 3461
IAST [baseline] (27.115 ms) : 0, 27115
IAST [candidate] (26.812 ms) : 0, 26812

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	piotr.wolski/test-ci-revert
git_commit_date	1765222535	1765230222
git_commit_sha	`94e770c`	`70ab1d7`
release_version	1.57.0-SNAPSHOT~94e770cd67	1.57.0-SNAPSHOT~70ab1d7bc1

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1765232606	1765232606
ci_job_id	1277609600	1277609600
ci_pipeline_id	85423830	85423830
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-yd8tbpw5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-yd8tbpw5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 1 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load	worse [+165.760µs; +381.802µs] or [+3.204%; +7.381%]	unsure [+28.952µs; +724.621µs] or [+0.232%; +5.802%]	unstable [-110.561op/s; +52.061op/s] or [-14.020%; +6.602%]	5.447ms	12.866ms	759.375op/s	5.173ms	12.489ms	788.625op/s
scenario:load:petclinic:iast:high_load	better [-1.577ms; -0.601ms] or [-8.545%; -3.255%]	unsure [-1.815ms; -0.297ms] or [-6.067%; -0.992%]	unstable [-11.691op/s; +38.191op/s] or [-4.685%; +15.303%]	17.363ms	28.862ms	262.812op/s	18.452ms	29.918ms	249.562op/s
scenario:load:petclinic:appsec:high_load	better [-1.800ms; -1.006ms] or [-9.250%; -5.168%]	better [-2.680ms; -0.949ms] or [-8.452%; -2.993%]	unstable [-7.376op/s; +39.751op/s] or [-3.122%; +16.826%]	18.056ms	29.889ms	252.438op/s	19.459ms	31.703ms	236.250op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~70ab1d7bc1, baseline=1.57.0-SNAPSHOT~94e770cd67
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.305 ms) : 18114, 18496
.   : milestone, 18305,
appsec (19.755 ms) : 19551, 19960
.   : milestone, 19755,
code_origins (17.949 ms) : 17773, 18124
.   : milestone, 17949,
iast (18.697 ms) : 18508, 18886
.   : milestone, 18697,
profiling (18.577 ms) : 18391, 18764
.   : milestone, 18577,
tracing (17.697 ms) : 17524, 17870
.   : milestone, 17697,
section candidate
no_agent (17.377 ms) : 17203, 17551
.   : milestone, 17377,
appsec (18.49 ms) : 18301, 18679
.   : milestone, 18490,
code_origins (17.866 ms) : 17685, 18047
.   : milestone, 17866,
iast (17.755 ms) : 17578, 17932
.   : milestone, 17755,
profiling (18.587 ms) : 18400, 18774
.   : milestone, 18587,
tracing (17.752 ms) : 17573, 17930
.   : milestone, 17752,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.305 ms [18.114 ms, 18.496 ms]	-
appsec	19.755 ms [19.551 ms, 19.96 ms]	1.451 ms (7.9%)
code_origins	17.949 ms [17.773 ms, 18.124 ms]	-356.256 µs (-1.9%)
iast	18.697 ms [18.508 ms, 18.886 ms]	392.267 µs (2.1%)
profiling	18.577 ms [18.391 ms, 18.764 ms]	272.567 µs (1.5%)
tracing	17.697 ms [17.524 ms, 17.87 ms]	-607.655 µs (-3.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.377 ms [17.203 ms, 17.551 ms]	-
appsec	18.49 ms [18.301 ms, 18.679 ms]	1.113 ms (6.4%)
code_origins	17.866 ms [17.685 ms, 18.047 ms]	488.62 µs (2.8%)
iast	17.755 ms [17.578 ms, 17.932 ms]	377.865 µs (2.2%)
profiling	18.587 ms [18.4 ms, 18.774 ms]	1.21 ms (7.0%)
tracing	17.752 ms [17.573 ms, 17.93 ms]	374.581 µs (2.2%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~70ab1d7bc1, baseline=1.57.0-SNAPSHOT~94e770cd67
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.207 ms) : 1196, 1219
.   : milestone, 1207,
iast (3.211 ms) : 3170, 3252
.   : milestone, 3211,
iast_FULL (5.863 ms) : 5804, 5922
.   : milestone, 5863,
iast_GLOBAL (3.564 ms) : 3512, 3617
.   : milestone, 3564,
profiling (2.101 ms) : 2082, 2119
.   : milestone, 2101,
tracing (1.793 ms) : 1778, 1807
.   : milestone, 1793,
section candidate
no_agent (1.204 ms) : 1193, 1216
.   : milestone, 1204,
iast (3.345 ms) : 3298, 3392
.   : milestone, 3345,
iast_FULL (6.09 ms) : 6029, 6152
.   : milestone, 6090,
iast_GLOBAL (3.566 ms) : 3508, 3625
.   : milestone, 3566,
profiling (2.007 ms) : 1991, 2024
.   : milestone, 2007,
tracing (1.801 ms) : 1786, 1815
.   : milestone, 1801,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.207 ms [1.196 ms, 1.219 ms]	-
iast	3.211 ms [3.17 ms, 3.252 ms]	2.004 ms (166.0%)
iast_FULL	5.863 ms [5.804 ms, 5.922 ms]	4.656 ms (385.6%)
iast_GLOBAL	3.564 ms [3.512 ms, 3.617 ms]	2.357 ms (195.2%)
profiling	2.101 ms [2.082 ms, 2.119 ms]	893.403 µs (74.0%)
tracing	1.793 ms [1.778 ms, 1.807 ms]	585.506 µs (48.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.204 ms [1.193 ms, 1.216 ms]	-
iast	3.345 ms [3.298 ms, 3.392 ms]	2.141 ms (177.8%)
iast_FULL	6.09 ms [6.029 ms, 6.152 ms]	4.886 ms (405.7%)
iast_GLOBAL	3.566 ms [3.508 ms, 3.625 ms]	2.362 ms (196.1%)
profiling	2.007 ms [1.991 ms, 2.024 ms]	803.137 µs (66.7%)
tracing	1.801 ms [1.786 ms, 1.815 ms]	596.205 µs (49.5%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	piotr.wolski/test-ci-revert
git_commit_date	1765222535	1765230222
git_commit_sha	`94e770c`	`70ab1d7`
release_version	1.57.0-SNAPSHOT~94e770cd67	1.57.0-SNAPSHOT~70ab1d7bc1

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1765232317	1765232317
ci_job_id	1277609601	1277609601
ci_pipeline_id	85423830	85423830
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-sggzuj17 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-sggzuj17 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~70ab1d7bc1, baseline=1.57.0-SNAPSHOT~94e770cd67
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.477 ms) : 1466, 1489
.   : milestone, 1477,
appsec (3.751 ms) : 3530, 3972
.   : milestone, 3751,
iast (2.223 ms) : 2158, 2288
.   : milestone, 2223,
iast_GLOBAL (2.269 ms) : 2204, 2334
.   : milestone, 2269,
profiling (2.085 ms) : 2031, 2139
.   : milestone, 2085,
tracing (2.054 ms) : 2003, 2105
.   : milestone, 2054,
section candidate
no_agent (1.486 ms) : 1475, 1498
.   : milestone, 1486,
appsec (3.738 ms) : 3517, 3959
.   : milestone, 3738,
iast (2.233 ms) : 2168, 2298
.   : milestone, 2233,
iast_GLOBAL (2.277 ms) : 2212, 2342
.   : milestone, 2277,
profiling (2.077 ms) : 2024, 2129
.   : milestone, 2077,
tracing (2.061 ms) : 2010, 2112
.   : milestone, 2061,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.477 ms [1.466 ms, 1.489 ms]	-
appsec	3.751 ms [3.53 ms, 3.972 ms]	2.274 ms (153.9%)
iast	2.223 ms [2.158 ms, 2.288 ms]	745.737 µs (50.5%)
iast_GLOBAL	2.269 ms [2.204 ms, 2.334 ms]	791.518 µs (53.6%)
profiling	2.085 ms [2.031 ms, 2.139 ms]	607.689 µs (41.1%)
tracing	2.054 ms [2.003 ms, 2.105 ms]	577.037 µs (39.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.486 ms [1.475 ms, 1.498 ms]	-
appsec	3.738 ms [3.517 ms, 3.959 ms]	2.252 ms (151.5%)
iast	2.233 ms [2.168 ms, 2.298 ms]	746.884 µs (50.3%)
iast_GLOBAL	2.277 ms [2.212 ms, 2.342 ms]	791.114 µs (53.2%)
profiling	2.077 ms [2.024 ms, 2.129 ms]	590.743 µs (39.8%)
tracing	2.061 ms [2.01 ms, 2.112 ms]	575.029 µs (38.7%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~70ab1d7bc1, baseline=1.57.0-SNAPSHOT~94e770cd67
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.28 s) : 15280000, 15280000
.   : milestone, 15280000,
appsec (14.679 s) : 14679000, 14679000
.   : milestone, 14679000,
iast (18.545 s) : 18545000, 18545000
.   : milestone, 18545000,
iast_GLOBAL (18.01 s) : 18010000, 18010000
.   : milestone, 18010000,
profiling (14.617 s) : 14617000, 14617000
.   : milestone, 14617000,
tracing (14.801 s) : 14801000, 14801000
.   : milestone, 14801000,
section candidate
no_agent (14.898 s) : 14898000, 14898000
.   : milestone, 14898000,
appsec (14.651 s) : 14651000, 14651000
.   : milestone, 14651000,
iast (18.11 s) : 18110000, 18110000
.   : milestone, 18110000,
iast_GLOBAL (18.059 s) : 18059000, 18059000
.   : milestone, 18059000,
profiling (14.516 s) : 14516000, 14516000
.   : milestone, 14516000,
tracing (14.589 s) : 14589000, 14589000
.   : milestone, 14589000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.28 s [15.28 s, 15.28 s]	-
appsec	14.679 s [14.679 s, 14.679 s]	-601.0 ms (-3.9%)
iast	18.545 s [18.545 s, 18.545 s]	3.265 s (21.4%)
iast_GLOBAL	18.01 s [18.01 s, 18.01 s]	2.73 s (17.9%)
profiling	14.617 s [14.617 s, 14.617 s]	-663.0 ms (-4.3%)
tracing	14.801 s [14.801 s, 14.801 s]	-479.0 ms (-3.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.898 s [14.898 s, 14.898 s]	-
appsec	14.651 s [14.651 s, 14.651 s]	-247.0 ms (-1.7%)
iast	18.11 s [18.11 s, 18.11 s]	3.212 s (21.6%)
iast_GLOBAL	18.059 s [18.059 s, 18.059 s]	3.161 s (21.2%)
profiling	14.516 s [14.516 s, 14.516 s]	-382.0 ms (-2.6%)
tracing	14.589 s [14.589 s, 14.589 s]	-309.0 ms (-2.1%)

pr-commenter · 2025-12-08T22:33:03Z

Kafka / consumer-benchmark

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	piotr.wolski/test-ci-revert
git_commit_date	1765222535	1765230222
git_commit_sha	`94e770c`	`70ab1d7`

See matching parameters

	Baseline	Candidate
ci_job_date	1765231365	1765231365
ci_job_id	1277609606	1277609606
ci_pipeline_id	85423830	85423830
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion	11.0.25	11.0.25
jmhVersion	1.36	1.36
jvm	/usr/lib/jvm/java-11-openjdk-amd64/bin/java	/usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName	OpenJDK 64-Bit Server VM	OpenJDK 64-Bit Server VM
vmVersion	11.0.25+9-post-Ubuntu-1ubuntu122.04	11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results

scenario	Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume	same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume	unsure [-15011.021op/s; -242.313op/s] or [-4.857%; -0.078%]
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume	same

Revert "fix Kafka consumer instrumentation"

70ab1d7

This reverts commit 8c64d26.

piochelepiotr requested a review from a team as a code owner December 8, 2025 21:44

piochelepiotr temporarily deployed to ci-build December 8, 2025 21:44 — with GitHub Actions Inactive

piochelepiotr marked this pull request as draft December 8, 2025 21:44

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Testing CI #10105

Testing CI #10105

Uh oh!

piochelepiotr commented Dec 8, 2025

Uh oh!

github-actions bot commented Dec 8, 2025

Uh oh!

pr-commenter bot commented Dec 8, 2025

Uh oh!

pr-commenter bot commented Dec 8, 2025

Uh oh!

pr-commenter bot commented Dec 8, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Testing CI #10105

Are you sure you want to change the base?

Testing CI #10105

Uh oh!

Conversation

piochelepiotr commented Dec 8, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

github-actions bot commented Dec 8, 2025

Uh oh!

pr-commenter bot commented Dec 8, 2025

Kafka / producer-benchmark

Parameters

Summary

Uh oh!

pr-commenter bot commented Dec 8, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

pr-commenter bot commented Dec 8, 2025

Kafka / consumer-benchmark

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants