Skip to content

build v18 again #1058

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 1 commit into from
Closed

build v18 again #1058

wants to merge 1 commit into from

Conversation

ganeshnj
Copy link
Contributor

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@pr-commenter
Copy link

pr-commenter bot commented May 14, 2025 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2025-05-14 09:11:17

Comparing candidate commit 324fd63 in PR branch ganeshnj/build/v1-again with baseline commit 2901823 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 324fd63 1747213182 ganeshnj/build/v1-again
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.207µs 3.152µs ± 1.420µs 2.992µs ± 0.025µs 3.014µs 3.130µs 13.869µs 14.962µs 400.04% 7.519 56.986 44.95% 0.100µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.955µs; 3.349µs] or [-6.245%; +6.245%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 324fd63 1747213182 ganeshnj/build/v1-again
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.895µs 3.911µs ± 0.003µs 3.911µs ± 0.002µs 3.914µs 3.917µs 3.919µs 3.921µs 0.25% -0.180 2.709 0.08% 0.000µs 1 200
credit_card/is_card_number/ throughput 255043060.086op/s 255660260.668op/s ± 213970.325op/s 255689414.460op/s ± 134877.773op/s 255808718.708op/s 255932239.314op/s 256033182.901op/s 256765370.877op/s 0.42% 0.192 2.757 0.08% 15129.987op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 82.203µs 82.498µs ± 0.208µs 82.446µs ± 0.134µs 82.600µs 82.933µs 83.081µs 83.245µs 0.97% 0.963 0.560 0.25% 0.015µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12012693.281op/s 12121540.778op/s ± 30500.251op/s 12129188.010op/s ± 19701.166op/s 12145163.736op/s 12157174.833op/s 12163690.060op/s 12164952.771op/s 0.29% -0.951 0.523 0.25% 2156.693op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 76.076µs 76.620µs ± 0.313µs 76.569µs ± 0.180µs 76.774µs 77.135µs 77.735µs 77.981µs 1.84% 1.255 2.598 0.41% 0.022µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 12823654.101op/s 13051554.256op/s ± 52997.625op/s 13060142.408op/s ± 30729.715op/s 13088829.995op/s 13121419.473op/s 13134857.284op/s 13144747.349op/s 0.65% -1.219 2.447 0.41% 3747.498op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.891µs 3.911µs ± 0.003µs 3.911µs ± 0.002µs 3.914µs 3.917µs 3.919µs 3.920µs 0.24% -0.668 6.047 0.09% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255079290.056op/s 255658449.527op/s ± 218747.968op/s 255694809.399op/s ± 128868.554op/s 255795865.903op/s 255918865.775op/s 256029727.377op/s 257003960.997op/s 0.51% 0.688 6.165 0.09% 15467.817op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 72.998µs 73.795µs ± 0.313µs 73.766µs ± 0.221µs 74.011µs 74.296µs 74.492µs 75.161µs 1.89% 0.627 0.848 0.42% 0.022µs 1 200
credit_card/is_card_number/378282246310005 throughput 13304850.518op/s 13551337.981op/s ± 57334.417op/s 13556311.397op/s ± 40593.323op/s 13591547.417op/s 13632987.471op/s 13652631.425op/s 13698948.878op/s 1.05% -0.596 0.754 0.42% 4054.155op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 51.883µs 52.280µs ± 0.393µs 52.117µs ± 0.080µs 52.277µs 52.966µs 53.491µs 54.684µs 4.92% 2.375 7.641 0.75% 0.028µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 18287041.402op/s 19128765.389op/s ± 141499.968op/s 19187466.783op/s ± 29471.029op/s 19209887.345op/s 19231752.397op/s 19255569.483op/s 19274091.535op/s 0.45% -2.290 6.922 0.74% 10005.559op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.468µs 6.627µs ± 0.072µs 6.627µs ± 0.046µs 6.675µs 6.746µs 6.782µs 6.835µs 3.14% 0.065 -0.392 1.08% 0.005µs 1 200
credit_card/is_card_number/x371413321323331 throughput 146307848.294op/s 150906738.210op/s ± 1632194.319op/s 150895618.308op/s ± 1054425.168op/s 151943186.219op/s 153670220.477op/s 154305185.424op/s 154618214.129op/s 2.47% -0.013 -0.409 1.08% 115413.567op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.895µs 3.912µs ± 0.004µs 3.912µs ± 0.002µs 3.914µs 3.918µs 3.920µs 3.929µs 0.42% 0.154 4.287 0.09% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254538287.257op/s 255609657.509op/s ± 229604.698op/s 255619071.036op/s ± 140329.091op/s 255750817.693op/s 255927629.716op/s 255974307.958op/s 256767614.063op/s 0.45% -0.137 4.304 0.09% 16235.504op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 63.529µs 63.798µs ± 0.119µs 63.781µs ± 0.054µs 63.842µs 63.968µs 64.202µs 64.638µs 1.34% 2.299 12.490 0.19% 0.008µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15470816.866op/s 15674567.412op/s ± 29151.120op/s 15678770.165op/s ± 13232.943op/s 15691123.139op/s 15711207.433op/s 15736603.891op/s 15740812.779op/s 0.40% -2.249 12.079 0.19% 2061.295op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 57.578µs 57.729µs ± 0.085µs 57.710µs ± 0.051µs 57.779µs 57.882µs 57.963µs 57.976µs 0.46% 0.742 0.165 0.15% 0.006µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17248533.726op/s 17322448.824op/s ± 25330.201op/s 17328034.939op/s ± 15462.548op/s 17339720.633op/s 17354897.398op/s 17365195.443op/s 17367895.445op/s 0.23% -0.735 0.152 0.15% 1791.116op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.893µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.918µs 3.920µs 3.926µs 0.37% -0.044 4.664 0.09% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254688589.931op/s 255628793.545op/s ± 226498.916op/s 255635536.878op/s ± 146980.392op/s 255781935.405op/s 255916654.490op/s 255979108.582op/s 256848197.494op/s 0.47% 0.062 4.709 0.09% 16015.892op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.537µs 54.645µs ± 0.110µs 54.620µs ± 0.031µs 54.656µs 54.753µs 55.162µs 55.262µs 1.18% 3.531 13.801 0.20% 0.008µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 18095733.550op/s 18300147.549op/s ± 36689.523op/s 18308462.173op/s ± 10299.647op/s 18318003.850op/s 18328624.638op/s 18331823.975op/s 18336291.188op/s 0.15% -3.511 13.661 0.20% 2594.341op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 51.932µs 52.315µs ± 0.357µs 52.145µs ± 0.099µs 52.603µs 52.894µs 53.416µs 53.882µs 3.33% 1.560 2.399 0.68% 0.025µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 18559173.993op/s 19115827.294op/s ± 128952.724op/s 19177147.560op/s ± 36163.997op/s 19203535.372op/s 19230259.776op/s 19243944.735op/s 19255901.809op/s 0.41% -1.521 2.192 0.67% 9118.335op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.437µs 6.642µs ± 0.071µs 6.645µs ± 0.055µs 6.701µs 6.744µs 6.795µs 6.804µs 2.39% -0.322 -0.382 1.07% 0.005µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 146968445.787op/s 150585454.729op/s ± 1616438.257op/s 150478330.124op/s ± 1239381.490op/s 151702547.079op/s 153438717.885op/s 154529281.941op/s 155339813.853op/s 3.23% 0.370 -0.337 1.07% 114299.445op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.911µs; 3.912µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/ throughput [255630606.439op/s; 255689914.898op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [82.469µs; 82.527µs] or [-0.035%; +0.035%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12117313.736op/s; 12125767.819op/s] or [-0.035%; +0.035%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [76.577µs; 76.664µs] or [-0.057%; +0.057%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13044209.294op/s; 13058899.217op/s] or [-0.056%; +0.056%] None None None
credit_card/is_card_number/37828224631 execution_time [3.911µs; 3.912µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/37828224631 throughput [255628133.163op/s; 255688765.892op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/378282246310005 execution_time [73.751µs; 73.838µs] or [-0.059%; +0.059%] None None None
credit_card/is_card_number/378282246310005 throughput [13543391.982op/s; 13559283.980op/s] or [-0.059%; +0.059%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.226µs; 52.335µs] or [-0.104%; +0.104%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19109154.854op/s; 19148375.923op/s] or [-0.103%; +0.103%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.617µs; 6.637µs] or [-0.150%; +0.150%] None None None
credit_card/is_card_number/x371413321323331 throughput [150680531.775op/s; 151132944.645op/s] or [-0.150%; +0.150%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.913µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/ throughput [255577836.506op/s; 255641478.512op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [63.781µs; 63.814µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15670527.348op/s; 15678607.477op/s] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [57.717µs; 57.740µs] or [-0.020%; +0.020%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17318938.302op/s; 17325959.346op/s] or [-0.020%; +0.020%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.911µs; 3.912µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255597402.974op/s; 255660184.117op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.629µs; 54.660µs] or [-0.028%; +0.028%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18295062.734op/s; 18305232.365op/s] or [-0.028%; +0.028%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.266µs; 52.364µs] or [-0.094%; +0.094%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19097955.687op/s; 19133698.902op/s] or [-0.093%; +0.093%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.632µs; 6.651µs] or [-0.148%; +0.148%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [150361431.933op/s; 150809477.525op/s] or [-0.149%; +0.149%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 324fd63 1747213182 ganeshnj/build/v1-again
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.389µs 2.423µs ± 0.021µs 2.418µs ± 0.008µs 2.426µs 2.473µs 2.488µs 2.499µs 3.33% 1.694 2.831 0.86% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.420µs; 2.426µs] or [-0.119%; +0.119%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 324fd63 1747213182 ganeshnj/build/v1-again
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 67.357µs 67.732µs ± 0.280µs 67.653µs ± 0.134µs 67.849µs 68.108µs 68.615µs 70.079µs 3.59% 3.660 24.685 0.41% 0.020µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [67.693µs; 67.771µs] or [-0.057%; +0.057%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 324fd63 1747213182 ganeshnj/build/v1-again
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 32.594µs 33.442µs ± 1.177µs 32.705µs ± 0.064µs 35.026µs 35.347µs 35.391µs 35.698µs 9.15% 0.910 -1.134 3.51% 0.083µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.278µs; 33.605µs] or [-0.488%; +0.488%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 324fd63 1747213182 ganeshnj/build/v1-again
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 149.254µs 149.852µs ± 0.342µs 149.807µs ± 0.147µs 149.952µs 150.425µs 151.390µs 151.803µs 1.33% 2.507 10.360 0.23% 0.024µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [149.804µs; 149.899µs] or [-0.032%; +0.032%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 324fd63 1747213182 ganeshnj/build/v1-again
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 5.969ms 5.986ms ± 0.007ms 5.986ms ± 0.004ms 5.990ms 5.996ms 6.001ms 6.033ms 0.80% 1.772 10.423 0.11% 0.000ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [5.985ms; 5.987ms] or [-0.016%; +0.016%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 324fd63 1747213182 ganeshnj/build/v1-again
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.536µs 25.297µs ± 10.955µs 17.777µs ± 0.145µs 34.972µs 44.521µs 47.635µs 94.752µs 433.02% 1.903 7.055 43.20% 0.775µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [23.779µs; 26.815µs] or [-6.002%; +6.002%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 324fd63 1747213182 ganeshnj/build/v1-again
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 252.688ns 261.737ns ± 11.008ns 256.510ns ± 2.748ns 265.547ns 290.379ns 292.670ns 292.893ns 14.18% 1.587 1.441 4.20% 0.778ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [260.212ns; 263.263ns] or [-0.583%; +0.583%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 324fd63 1747213182 ganeshnj/build/v1-again
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 215.413µs 215.893µs ± 0.249µs 215.871µs ± 0.164µs 216.036µs 216.305µs 216.622µs 217.027µs 0.54% 1.011 1.983 0.12% 0.018µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4607711.594op/s 4631927.223op/s ± 5343.965op/s 4632400.075op/s ± 3512.418op/s 4635868.766op/s 4639090.039op/s 4640626.890op/s 4642250.150op/s 0.21% -1.000 1.944 0.12% 377.875op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 19.597µs 19.782µs ± 0.048µs 19.784µs ± 0.036µs 19.820µs 19.850µs 19.866µs 19.960µs 0.89% -0.079 0.734 0.24% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 50098999.048op/s 50550223.528op/s ± 122178.112op/s 50544902.131op/s ± 90630.400op/s 50637403.731op/s 50724443.687op/s 50745822.132op/s 51028218.605op/s 0.96% 0.099 0.737 0.24% 8639.297op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 11.841µs 12.421µs ± 0.172µs 12.432µs ± 0.111µs 12.551µs 12.648µs 12.677µs 12.682µs 2.01% -0.717 0.415 1.38% 0.012µs 1 200
normalization/normalize_name/normalize_name/good throughput 78853907.735op/s 80527142.901op/s ± 1127447.945op/s 80436755.918op/s ± 724741.195op/s 81099612.967op/s 82434635.191op/s 83845501.022op/s 84449095.009op/s 4.99% 0.798 0.625 1.40% 79722.609op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [215.859µs; 215.928µs] or [-0.016%; +0.016%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4631186.601op/s; 4632667.845op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [19.776µs; 19.789µs] or [-0.033%; +0.033%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [50533290.817op/s; 50567156.239op/s] or [-0.033%; +0.033%] None None None
normalization/normalize_name/normalize_name/good execution_time [12.397µs; 12.444µs] or [-0.192%; +0.192%] None None None
normalization/normalize_name/normalize_name/good throughput [80370889.460op/s; 80683396.343op/s] or [-0.194%; +0.194%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 324fd63 1747213182 ganeshnj/build/v1-again
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 534.977µs 535.717µs ± 0.581µs 535.644µs ± 0.295µs 535.973µs 536.438µs 536.706µs 541.627µs 1.12% 5.385 51.809 0.11% 0.041µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1846288.450op/s 1866658.246op/s ± 2011.277op/s 1866912.733op/s ± 1026.946op/s 1867800.128op/s 1868820.148op/s 1869119.392op/s 1869239.649op/s 0.12% -5.305 50.725 0.11% 142.219op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 456.024µs 456.805µs ± 0.524µs 456.715µs ± 0.275µs 457.046µs 457.586µs 457.864µs 461.443µs 1.04% 3.701 29.062 0.11% 0.037µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2167113.724op/s 2189120.217op/s ± 2500.791op/s 2189548.083op/s ± 1319.657op/s 2190581.044op/s 2191926.114op/s 2192543.604op/s 2192867.283op/s 0.15% -3.642 28.368 0.11% 176.833op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 185.182µs 185.725µs ± 0.240µs 185.717µs ± 0.159µs 185.864µs 186.124µs 186.321µs 186.558µs 0.45% 0.232 0.086 0.13% 0.017µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5360268.324op/s 5384304.310op/s ± 6944.673op/s 5384545.748op/s ± 4620.788op/s 5389209.193op/s 5395584.640op/s 5398587.275op/s 5400100.901op/s 0.29% -0.224 0.075 0.13% 491.063op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 39.890µs 40.055µs ± 0.059µs 40.056µs ± 0.038µs 40.093µs 40.156µs 40.181µs 40.204µs 0.37% -0.029 -0.214 0.15% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 24872974.895op/s 24965496.397op/s ± 37028.639op/s 24964857.163op/s ± 23521.024op/s 24988674.697op/s 25028042.144op/s 25050714.705op/s 25068735.060op/s 0.42% 0.037 -0.212 0.15% 2618.320op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 46.556µs 46.663µs ± 0.060µs 46.656µs ± 0.034µs 46.691µs 46.763µs 46.804µs 47.003µs 0.74% 1.318 4.401 0.13% 0.004µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21275405.583op/s 21430222.423op/s ± 27450.444op/s 21433682.142op/s ± 15607.820op/s 21448854.456op/s 21468264.285op/s 21477615.236op/s 21479560.388op/s 0.21% -1.300 4.293 0.13% 1941.040op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [535.637µs; 535.798µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1866379.503op/s; 1866936.990op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [456.732µs; 456.878µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2188773.632op/s; 2189466.803op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [185.692µs; 185.759µs] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5383341.845op/s; 5385266.775op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [40.047µs; 40.064µs] or [-0.021%; +0.021%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [24960364.583op/s; 24970628.210op/s] or [-0.021%; +0.021%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [46.655µs; 46.671µs] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21426418.055op/s; 21434026.790op/s] or [-0.018%; +0.018%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 324fd63 1747213182 ganeshnj/build/v1-again
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 73.881ms 74.390ms ± 0.188ms 74.362ms ± 0.086ms 74.450ms 74.706ms 75.110ms 75.253ms 1.20% 1.662 4.734 0.25% 0.013ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [74.364ms; 74.416ms] or [-0.035%; +0.035%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 324fd63 1747213182 ganeshnj/build/v1-again
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.946µs 5.020µs ± 0.042µs 5.021µs ± 0.036µs 5.056µs 5.082µs 5.092µs 5.095µs 1.47% -0.144 -1.174 0.84% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.014µs; 5.026µs] or [-0.117%; +0.117%] None None None

Baseline

Omitted due to size.

@r1viollet
Copy link
Contributor

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so.debug 20.31 MB 20.31 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 66.02 MB 66.02 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.03 MB 8.03 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 72.62 MB 72.62 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 8.00 MB 8.00 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so.debug 22.70 MB 22.70 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 16.71 MB 16.71 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 62.31 KB 62.31 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 112.66 MB 112.65 MB --.01% (-16.00 KB) 💪
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 631.94 MB 631.94 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 4.99 MB 4.99 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 62.31 KB 62.31 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 15.88 MB 15.88 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 26.43 MB 26.43 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 14.15 MB 14.15 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 63.26 KB 63.26 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 114.51 MB 114.51 MB -0% (-8.00 KB) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 624.51 MB 624.51 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 3.78 MB 3.78 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 63.26 KB 63.26 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 16.50 MB 16.49 MB --.04% (-8.00 KB) 💪
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 24.34 MB 24.34 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 57.50 MB 57.50 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.43 MB 8.43 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so.debug 18.71 MB 18.71 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 68.60 MB 68.60 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 8.43 MB 8.43 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so.debug 20.90 MB 20.90 MB 0% (0 B) 👌

@ganeshnj ganeshnj closed this Jun 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@ganeshnj @r1viollet