Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: update action versions in workflow files #933

Merged
merged 4 commits into from
Mar 21, 2025

Conversation

ganeshnj
Copy link
Contributor

What does this PR do?

Pins all the action versions to specific commit sha.

Motivation

Tags can be moved and we could end up using action versions which we don't intend to.

Additional Notes

I bumped the action versions to their minor versions.

How to test the change?

🤞 all actions pass

@ganeshnj ganeshnj requested a review from a team as a code owner March 17, 2025 10:30
@pr-commenter
Copy link

pr-commenter bot commented Mar 17, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-03-21 16:38:13

Comparing candidate commit 37794d5 in PR branch ganeshnj/chore/fix-action-version with baseline commit e8053aa in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 37794d5 1742574391 ganeshnj/chore/fix-action-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 246.606ns 254.727ns ± 10.279ns 249.705ns ± 1.674ns 255.420ns 279.098ns 281.701ns 282.258ns 13.04% 1.554 0.861 4.03% 0.727ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [253.303ns; 256.152ns] or [-0.559%; +0.559%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 37794d5 1742574391 ganeshnj/chore/fix-action-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.897µs 3.913µs ± 0.002µs 3.913µs ± 0.001µs 3.914µs 3.916µs 3.917µs 3.919µs 0.15% -2.115 13.579 0.06% 0.000µs 1 200
credit_card/is_card_number/ throughput 255160053.037op/s 255560649.459op/s ± 142071.918op/s 255546258.622op/s ± 57410.127op/s 255619516.551op/s 255790969.702op/s 255925304.992op/s 256596518.238op/s 0.41% 2.134 13.730 0.06% 10046.002op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 81.691µs 83.171µs ± 0.574µs 83.170µs ± 0.396µs 83.556µs 84.074µs 84.283µs 84.456µs 1.55% -0.058 -0.526 0.69% 0.041µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11840502.366op/s 12024054.540op/s ± 83069.547op/s 12023505.858op/s ± 57270.294op/s 12082177.882op/s 12164982.669op/s 12206863.942op/s 12241215.891op/s 1.81% 0.089 -0.514 0.69% 5873.904op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 78.805µs 79.627µs ± 0.342µs 79.611µs ± 0.249µs 79.879µs 80.198µs 80.279µs 80.550µs 1.18% 0.030 -0.502 0.43% 0.024µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 12414659.072op/s 12558833.305op/s ± 54003.612op/s 12561025.087op/s ± 39280.652op/s 12593796.652op/s 12646032.889op/s 12674239.661op/s 12689545.044op/s 1.02% -0.010 -0.502 0.43% 3818.632op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.892µs 3.913µs ± 0.003µs 3.913µs ± 0.001µs 3.914µs 3.916µs 3.918µs 3.920µs 0.17% -2.467 17.539 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255132266.017op/s 255580651.191op/s ± 176305.566op/s 255568743.944op/s ± 85054.498op/s 255644699.501op/s 255841689.821op/s 255941097.068op/s 256967116.453op/s 0.55% 2.494 17.806 0.07% 12466.686op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 75.591µs 76.649µs ± 0.365µs 76.668µs ± 0.255µs 76.915µs 77.216µs 77.365µs 77.427µs 0.99% -0.167 -0.445 0.47% 0.026µs 1 200
credit_card/is_card_number/378282246310005 throughput 12915393.818op/s 13046792.169op/s ± 62153.281op/s 13043278.745op/s ± 43455.888op/s 13089135.698op/s 13148701.863op/s 13188974.024op/s 13229034.681op/s 1.42% 0.189 -0.427 0.48% 4394.901op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 51.375µs 51.438µs ± 0.027µs 51.434µs ± 0.013µs 51.449µs 51.490µs 51.532µs 51.544µs 0.21% 1.006 2.256 0.05% 0.002µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19400915.644op/s 19440935.341op/s ± 10168.870op/s 19442436.777op/s ± 4861.046op/s 19446710.665op/s 19456516.825op/s 19461438.833op/s 19464632.762op/s 0.11% -1.001 2.243 0.05% 719.048op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.028µs 6.038µs ± 0.005µs 6.037µs ± 0.002µs 6.039µs 6.046µs 6.052µs 6.076µs 0.65% 3.338 20.265 0.08% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 164570937.925op/s 165619595.064op/s ± 139685.010op/s 165636879.053op/s ± 57315.374op/s 165692195.281op/s 165780024.735op/s 165827200.678op/s 165882032.632op/s 0.15% -3.309 20.008 0.08% 9877.222op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.898µs 3.914µs ± 0.003µs 3.914µs ± 0.001µs 3.915µs 3.919µs 3.920µs 3.932µs 0.45% 0.212 10.692 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254351566.208op/s 255489875.246op/s ± 189857.189op/s 255495578.962op/s ± 79694.649op/s 255577375.013op/s 255779770.977op/s 255927504.801op/s 256573336.610op/s 0.42% -0.184 10.673 0.07% 13424.931op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.919µs 66.237µs ± 0.160µs 66.211µs ± 0.087µs 66.314µs 66.501µs 66.801µs 66.873µs 1.00% 1.210 2.430 0.24% 0.011µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 14953681.220op/s 15097311.432op/s ± 36384.975op/s 15103163.358op/s ± 19949.296op/s 15121066.670op/s 15143702.987op/s 15156580.212op/s 15170146.759op/s 0.44% -1.189 2.354 0.24% 2572.806op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 59.435µs 59.586µs ± 0.080µs 59.581µs ± 0.055µs 59.638µs 59.741µs 59.774µs 59.796µs 0.36% 0.369 -0.348 0.13% 0.006µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 16723644.855op/s 16782428.195op/s ± 22499.157op/s 16783967.120op/s ± 15598.612op/s 16799463.257op/s 16816802.090op/s 16823675.421op/s 16825017.118op/s 0.24% -0.363 -0.354 0.13% 1590.931op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.891µs 3.914µs ± 0.003µs 3.913µs ± 0.001µs 3.914µs 3.918µs 3.920µs 3.932µs 0.47% -0.910 28.385 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254344555.275op/s 255518219.753op/s ± 181178.222op/s 255531057.721op/s ± 65363.936op/s 255594945.610op/s 255670864.300op/s 255809144.489op/s 256984994.932op/s 0.57% 0.973 28.621 0.07% 12811.235op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 56.210µs 56.597µs ± 0.167µs 56.585µs ± 0.119µs 56.707µs 56.887µs 56.961µs 57.009µs 0.75% 0.264 -0.630 0.29% 0.012µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17541124.771op/s 17668862.962op/s ± 52020.630op/s 17672465.425op/s ± 37119.249op/s 17709011.673op/s 17744811.773op/s 17762212.495op/s 17790298.217op/s 0.67% -0.252 -0.636 0.29% 3678.414op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 51.337µs 51.420µs ± 0.036µs 51.420µs ± 0.019µs 51.437µs 51.472µs 51.496µs 51.657µs 0.46% 1.322 8.084 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19358533.644op/s 19447821.864op/s ± 13672.369op/s 19447615.902op/s ± 7109.404op/s 19455352.398op/s 19468024.646op/s 19476347.224op/s 19478939.371op/s 0.16% -1.304 7.958 0.07% 966.782op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.027µs 6.038µs ± 0.004µs 6.038µs ± 0.002µs 6.040µs 6.044µs 6.048µs 6.062µs 0.40% 1.727 10.575 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 164970582.569op/s 165615235.725op/s ± 110792.231op/s 165622977.035op/s ± 49986.736op/s 165668253.824op/s 165776176.640op/s 165876458.833op/s 165926772.119op/s 0.18% -1.707 10.468 0.07% 7834.194op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.913µs; 3.913µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/ throughput [255540959.657op/s; 255580339.260op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [83.091µs; 83.250µs] or [-0.096%; +0.096%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12012541.900op/s; 12035567.180op/s] or [-0.096%; +0.096%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [79.579µs; 79.674µs] or [-0.060%; +0.060%] None None None
credit_card/is_card_number/ 378282246310005 throughput [12551348.924op/s; 12566317.687op/s] or [-0.060%; +0.060%] None None None
credit_card/is_card_number/37828224631 execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631 throughput [255556216.936op/s; 255605085.447op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/378282246310005 execution_time [76.598µs; 76.699µs] or [-0.066%; +0.066%] None None None
credit_card/is_card_number/378282246310005 throughput [13038178.322op/s; 13055406.016op/s] or [-0.066%; +0.066%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [51.434µs; 51.442µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19439526.034op/s; 19442344.649op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.037µs; 6.039µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/x371413321323331 throughput [165600236.065op/s; 165638954.063op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.914µs; 3.914µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255463562.865op/s; 255516187.626op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [66.215µs; 66.260µs] or [-0.033%; +0.033%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15092268.824op/s; 15102354.040op/s] or [-0.033%; +0.033%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [59.575µs; 59.597µs] or [-0.019%; +0.019%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [16779310.028op/s; 16785546.361op/s] or [-0.019%; +0.019%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.913µs; 3.914µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255493110.194op/s; 255543329.312op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [56.574µs; 56.620µs] or [-0.041%; +0.041%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [17661653.403op/s; 17676072.521op/s] or [-0.041%; +0.041%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [51.415µs; 51.425µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19445927.006op/s; 19449716.723op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.038µs; 6.039µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165599880.988op/s; 165630590.463op/s] or [-0.009%; +0.009%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 37794d5 1742574391 ganeshnj/chore/fix-action-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 68.003µs 68.191µs ± 0.319µs 68.152µs ± 0.048µs 68.209µs 68.322µs 68.604µs 72.424µs 6.27% 11.900 154.385 0.47% 0.023µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [68.147µs; 68.235µs] or [-0.065%; +0.065%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 37794d5 1742574391 ganeshnj/chore/fix-action-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 503.818µs 506.182µs ± 0.982µs 506.132µs ± 0.489µs 506.619µs 507.133µs 508.373µs 514.507µs 1.65% 3.874 28.895 0.19% 0.069µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1943607.943op/s 1975582.444op/s ± 3806.153op/s 1975770.468op/s ± 1909.285op/s 1977651.278op/s 1980053.284op/s 1981074.580op/s 1984842.201op/s 0.46% -3.782 27.964 0.19% 269.136op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 453.977µs 454.966µs ± 0.388µs 454.941µs ± 0.278µs 455.212µs 455.595µs 456.033µs 456.457µs 0.33% 0.354 0.743 0.09% 0.027µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2190784.705op/s 2197967.670op/s ± 1875.042op/s 2198086.137op/s ± 1345.466op/s 2199442.595op/s 2200522.250op/s 2202110.182op/s 2202753.552op/s 0.21% -0.347 0.731 0.09% 132.585op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 175.559µs 176.526µs ± 0.283µs 176.547µs ± 0.167µs 176.721µs 176.905µs 177.038µs 177.103µs 0.31% -0.708 0.375 0.16% 0.020µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5646433.293op/s 5664912.237op/s ± 9096.929op/s 5664203.107op/s ± 5349.605op/s 5669054.365op/s 5683582.684op/s 5687810.121op/s 5696076.529op/s 0.56% 0.717 0.392 0.16% 643.250op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.609µs 37.721µs ± 0.054µs 37.718µs ± 0.036µs 37.755µs 37.817µs 37.871µs 37.925µs 0.55% 0.684 0.685 0.14% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26367568.504op/s 26510327.438op/s ± 37818.809op/s 26512693.685op/s ± 25372.320op/s 26537500.016op/s 26563876.614op/s 26580242.718op/s 26589610.388op/s 0.29% -0.675 0.662 0.14% 2674.194op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.187µs 48.304µs ± 0.053µs 48.294µs ± 0.024µs 48.327µs 48.378µs 48.432µs 48.687µs 0.81% 2.716 15.503 0.11% 0.004µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20539239.049op/s 20702416.122op/s ± 22492.733op/s 20706393.924op/s ± 10387.395op/s 20714740.951op/s 20730101.214op/s 20737050.784op/s 20752382.338op/s 0.22% -2.683 15.215 0.11% 1590.476op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [506.046µs; 506.318µs] or [-0.027%; +0.027%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1975054.948op/s; 1976109.940op/s] or [-0.027%; +0.027%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [454.912µs; 455.020µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2197707.807op/s; 2198227.533op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [176.486µs; 176.565µs] or [-0.022%; +0.022%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5663651.490op/s; 5666172.984op/s] or [-0.022%; +0.022%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.714µs; 37.729µs] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26505086.115op/s; 26515568.761op/s] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [48.296µs; 48.311µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20699298.845op/s; 20705533.398op/s] or [-0.015%; +0.015%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 37794d5 1742574391 ganeshnj/chore/fix-action-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.940µs 5.008µs ± 0.040µs 5.013µs ± 0.038µs 5.038µs 5.068µs 5.071µs 5.072µs 1.17% -0.154 -1.292 0.79% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.003µs; 5.014µs] or [-0.110%; +0.110%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 37794d5 1742574391 ganeshnj/chore/fix-action-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 6.015ms 6.027ms ± 0.015ms 6.025ms ± 0.003ms 6.028ms 6.036ms 6.065ms 6.174ms 2.48% 7.716 67.592 0.25% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [6.025ms; 6.029ms] or [-0.035%; +0.035%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 37794d5 1742574391 ganeshnj/chore/fix-action-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.179µs 3.173µs ± 1.411µs 2.981µs ± 0.028µs 3.007µs 3.623µs 13.815µs 14.826µs 397.42% 7.366 55.323 44.35% 0.100µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.977µs; 3.368µs] or [-6.162%; +6.162%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 37794d5 1742574391 ganeshnj/chore/fix-action-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.714µs 26.105µs ± 11.090µs 17.881µs ± 0.111µs 35.006µs 45.281µs 47.065µs 86.786µs 385.35% 1.594 4.500 42.38% 0.784µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.568µs; 27.642µs] or [-5.888%; +5.888%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 37794d5 1742574391 ganeshnj/chore/fix-action-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 148.875µs 149.683µs ± 0.400µs 149.619µs ± 0.174µs 149.830µs 150.131µs 150.794µs 152.700µs 2.06% 3.809 24.458 0.27% 0.028µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [149.628µs; 149.738µs] or [-0.037%; +0.037%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 37794d5 1742574391 ganeshnj/chore/fix-action-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 54.572ms 54.843ms ± 0.189ms 54.816ms ± 0.079ms 54.883ms 55.177ms 55.658ms 55.986ms 2.14% 2.696 10.404 0.34% 0.013ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [54.817ms; 54.869ms] or [-0.048%; +0.048%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 37794d5 1742574391 ganeshnj/chore/fix-action-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.400µs 2.423µs ± 0.015µs 2.421µs ± 0.011µs 2.431µs 2.453µs 2.456µs 2.457µs 1.49% 0.683 -0.475 0.61% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.421µs; 2.425µs] or [-0.085%; +0.085%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 37794d5 1742574391 ganeshnj/chore/fix-action-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 208.495µs 209.046µs ± 0.179µs 209.024µs ± 0.110µs 209.151µs 209.380µs 209.510µs 209.531µs 0.24% 0.271 0.368 0.09% 0.013µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4772552.731op/s 4783649.566op/s ± 4090.035op/s 4784138.031op/s ± 2511.638op/s 4786413.605op/s 4789847.280op/s 4792202.660op/s 4796274.254op/s 0.25% -0.265 0.366 0.09% 289.209op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.244µs 18.332µs ± 0.029µs 18.329µs ± 0.017µs 18.351µs 18.379µs 18.399µs 18.437µs 0.59% -0.195 1.201 0.16% 0.002µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 54238709.574op/s 54549977.504op/s ± 85847.987op/s 54557087.000op/s ± 50872.592op/s 54588908.818op/s 54695808.686op/s 54790638.598op/s 54811531.241op/s 0.47% 0.210 1.200 0.16% 6070.369op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.656µs 10.716µs ± 0.029µs 10.714µs ± 0.019µs 10.734µs 10.770µs 10.787µs 10.799µs 0.80% 0.326 -0.137 0.27% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 92601364.659op/s 93320743.086op/s ± 256267.350op/s 93340144.815op/s ± 163545.345op/s 93488087.287op/s 93734872.878op/s 93801095.443op/s 93842827.701op/s 0.54% -0.312 -0.151 0.27% 18120.838op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [209.021µs; 209.070µs] or [-0.012%; +0.012%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4783082.726op/s; 4784216.405op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.328µs; 18.336µs] or [-0.022%; +0.022%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54538079.799op/s; 54561875.210op/s] or [-0.022%; +0.022%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.712µs; 10.720µs] or [-0.038%; +0.038%] None None None
normalization/normalize_name/normalize_name/good throughput [93285226.896op/s; 93356259.276op/s] or [-0.038%; +0.038%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 37794d5 1742574391 ganeshnj/chore/fix-action-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.794µs 34.362µs ± 0.686µs 33.981µs ± 0.101µs 34.889µs 35.593µs 35.832µs 36.911µs 8.62% 1.176 0.017 1.99% 0.049µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.267µs; 34.457µs] or [-0.277%; +0.277%] None None None

Baseline

Omitted due to size.

Copy link
Contributor

@gleocadie gleocadie left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@r1viollet
Copy link
Contributor

r1viollet commented Mar 17, 2025

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 77.23 MB 77.23 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so.debug 23.83 MB 23.83 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 7.69 MB 7.69 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 71.53 MB 71.53 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so.debug 22.42 MB 22.42 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 7.62 MB 7.62 MB 0% (0 B) 👌
i686-alpine-linux-musl
Artifact Baseline Commit Change
/i686-alpine-linux-musl/lib/libdatadog_profiling.a 66.56 MB 66.56 MB 0% (0 B) 👌
/i686-alpine-linux-musl/lib/libdatadog_profiling.so 8.18 MB 8.18 MB 0% (0 B) 👌
/i686-alpine-linux-musl/lib/libdatadog_profiling.so.debug 23.01 MB 23.01 MB 0% (0 B) 👌
i686-unknown-linux-gnu
Artifact Baseline Commit Change
/i686-unknown-linux-gnu/lib/libdatadog_profiling.a 67.45 MB 67.45 MB 0% (0 B) 👌
/i686-unknown-linux-gnu/lib/libdatadog_profiling.so 8.07 MB 8.07 MB 0% (0 B) 👌
/i686-unknown-linux-gnu/lib/libdatadog_profiling.so.debug 20.62 MB 20.62 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 16.59 MB 16.59 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 55.10 KB 55.10 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 111.20 MB 111.20 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 625.28 MB 625.28 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 4.99 MB 4.99 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 55.10 KB 55.10 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 15.85 MB 15.85 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 26.38 MB 26.38 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 14.03 MB 14.03 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 55.94 KB 55.94 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 113.16 MB 113.16 MB -0% (-8.00 KB) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 617.99 MB 617.99 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 3.78 MB 3.78 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 55.94 KB 55.94 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 16.51 MB 16.51 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 24.35 MB 24.35 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 66.56 MB 66.56 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.18 MB 8.18 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so.debug 23.01 MB 23.01 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 67.45 MB 67.45 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 8.07 MB 8.07 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so.debug 20.62 MB 20.62 MB 0% (0 B) 👌

@ganeshnj ganeshnj force-pushed the ganeshnj/chore/fix-action-version branch from 5828866 to 0937af2 Compare March 19, 2025 16:04
@ivoanjo ivoanjo enabled auto-merge (squash) March 20, 2025 13:57
@ganeshnj ganeshnj force-pushed the ganeshnj/chore/fix-action-version branch from 3cdb945 to 50d9b22 Compare March 20, 2025 17:12
@morrisonlevi morrisonlevi disabled auto-merge March 21, 2025 16:57
@morrisonlevi morrisonlevi merged commit dd5ca94 into main Mar 21, 2025
14 checks passed
@morrisonlevi morrisonlevi deleted the ganeshnj/chore/fix-action-version branch March 21, 2025 16:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants