Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

crashtracker: use pyo3 to provide Python bindings (WIP) #932

Closed
wants to merge 2 commits into from

Conversation

taegyunkim
Copy link
Contributor

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@pr-commenter
Copy link

pr-commenter bot commented Mar 17, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-03-17 00:08:28

Comparing candidate commit c3d17be in PR branch taegyunkim/prof-11491-pyo3 with baseline commit b39c6ee in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c3d17be 1742169417 taegyunkim/prof-11491-pyo3
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.192µs 3.171µs ± 1.515µs 2.965µs ± 0.023µs 2.988µs 3.634µs 13.820µs 17.010µs 473.69% 7.624 59.625 47.66% 0.107µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.961µs; 3.381µs] or [-6.622%; +6.622%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c3d17be 1742169417 taegyunkim/prof-11491-pyo3
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.958µs 5.039µs ± 0.053µs 5.010µs ± 0.031µs 5.094µs 5.119µs 5.127µs 5.131µs 2.41% 0.286 -1.573 1.04% 0.004µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.032µs; 5.046µs] or [-0.145%; +0.145%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c3d17be 1742169417 taegyunkim/prof-11491-pyo3
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 6.058ms 6.072ms ± 0.011ms 6.070ms ± 0.003ms 6.074ms 6.079ms 6.117ms 6.187ms 1.93% 6.923 64.981 0.18% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [6.070ms; 6.073ms] or [-0.025%; +0.025%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c3d17be 1742169417 taegyunkim/prof-11491-pyo3
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 208.479µs 208.955µs ± 0.139µs 208.965µs ± 0.090µs 209.045µs 209.181µs 209.224µs 209.315µs 0.17% -0.187 0.059 0.07% 0.010µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4777489.742op/s 4785724.830op/s ± 3184.980op/s 4785487.213op/s ± 2055.919op/s 4787792.726op/s 4791098.140op/s 4792624.345op/s 4796640.433op/s 0.23% 0.191 0.063 0.07% 225.212op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.251µs 18.339µs ± 0.046µs 18.349µs ± 0.030µs 18.370µs 18.401µs 18.422µs 18.444µs 0.52% -0.427 -0.743 0.25% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 54219013.834op/s 54529628.563op/s ± 138061.775op/s 54498920.212op/s ± 89953.194op/s 54618630.670op/s 54778856.835op/s 54788231.790op/s 54792123.747op/s 0.54% 0.435 -0.741 0.25% 9762.442op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.656µs 10.719µs ± 0.021µs 10.719µs ± 0.016µs 10.735µs 10.751µs 10.768µs 10.774µs 0.52% -0.012 -0.274 0.20% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 92815243.404op/s 93292854.915op/s ± 185079.313op/s 93294259.812op/s ± 136479.342op/s 93429481.853op/s 93573215.231op/s 93725334.043op/s 93839440.717op/s 0.58% 0.022 -0.272 0.20% 13087.084op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [208.936µs; 208.974µs] or [-0.009%; +0.009%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4785283.423op/s; 4786166.238op/s] or [-0.009%; +0.009%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.332µs; 18.345µs] or [-0.035%; +0.035%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54510494.529op/s; 54548762.597op/s] or [-0.035%; +0.035%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.716µs; 10.722µs] or [-0.027%; +0.027%] None None None
normalization/normalize_name/normalize_name/good throughput [93267204.703op/s; 93318505.128op/s] or [-0.027%; +0.027%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c3d17be 1742169417 taegyunkim/prof-11491-pyo3
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.894µs 3.911µs ± 0.003µs 3.912µs ± 0.002µs 3.913µs 3.916µs 3.918µs 3.920µs 0.21% -0.991 4.956 0.08% 0.000µs 1 200
credit_card/is_card_number/ throughput 255101251.852op/s 255661197.398op/s ± 199084.074op/s 255635720.398op/s ± 116207.494op/s 255770675.839op/s 255980416.309op/s 256047878.984op/s 256828014.322op/s 0.47% 1.005 5.034 0.08% 14077.370op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 82.105µs 83.229µs ± 0.442µs 83.232µs ± 0.331µs 83.567µs 83.873µs 84.044µs 84.311µs 1.30% -0.255 -0.458 0.53% 0.031µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11860849.688op/s 12015421.490op/s ± 63904.906op/s 12014570.427op/s ± 47868.947op/s 12062402.998op/s 12123978.080op/s 12163416.751op/s 12179577.707op/s 1.37% 0.279 -0.442 0.53% 4518.759op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 78.576µs 79.709µs ± 0.422µs 79.747µs ± 0.331µs 80.021µs 80.366µs 80.463µs 80.547µs 1.00% -0.181 -0.649 0.53% 0.030µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 12415094.548op/s 12545966.995op/s ± 66455.557op/s 12539614.860op/s ± 52103.996op/s 12598138.312op/s 12650148.498op/s 12697734.425op/s 12726588.834op/s 1.49% 0.202 -0.631 0.53% 4699.117op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.893µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.915µs 3.918µs 3.920µs 3.921µs 0.21% -1.186 7.213 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255008914.836op/s 255551996.005op/s ± 209263.329op/s 255552020.108op/s ± 112576.556op/s 255658596.951op/s 255889549.262op/s 256023426.182op/s 256877967.890op/s 0.52% 1.205 7.335 0.08% 14797.152op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 75.565µs 76.581µs ± 0.401µs 76.593µs ± 0.303µs 76.892µs 77.223µs 77.399µs 77.496µs 1.18% 0.026 -0.680 0.52% 0.028µs 1 200
credit_card/is_card_number/378282246310005 throughput 12903830.803op/s 13058370.366op/s ± 68373.546op/s 13056011.040op/s ± 51782.861op/s 13108573.992op/s 13169576.614op/s 13192555.237op/s 13233613.175op/s 1.36% -0.005 -0.678 0.52% 4834.740op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 51.345µs 51.420µs ± 0.033µs 51.421µs ± 0.020µs 51.440µs 51.473µs 51.494µs 51.509µs 0.17% -0.068 -0.150 0.06% 0.002µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19414189.283op/s 19447625.461op/s ± 12533.083op/s 19447472.379op/s ± 7380.909op/s 19454846.762op/s 19471423.447op/s 19474382.756op/s 19476250.660op/s 0.15% 0.072 -0.150 0.06% 886.223op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.028µs 6.039µs ± 0.004µs 6.040µs ± 0.003µs 6.042µs 6.046µs 6.048µs 6.049µs 0.15% -0.365 0.170 0.07% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 165319782.968op/s 165584663.025op/s ± 113853.652op/s 165570545.003op/s ± 73284.354op/s 165650987.374op/s 165799810.330op/s 165883746.814op/s 165898467.934op/s 0.20% 0.369 0.174 0.07% 8050.669op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.896µs 3.914µs ± 0.003µs 3.913µs ± 0.002µs 3.915µs 3.918µs 3.922µs 3.928µs 0.37% -0.327 5.351 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254584158.292op/s 255518054.829op/s ± 210517.396op/s 255527570.711op/s ± 112565.034op/s 255622322.222op/s 255842152.132op/s 255973533.221op/s 256661010.953op/s 0.44% 0.345 5.388 0.08% 14885.828op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 66.016µs 66.328µs ± 0.189µs 66.293µs ± 0.109µs 66.426µs 66.667µs 66.892µs 67.079µs 1.18% 0.994 1.127 0.28% 0.013µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 14907883.595op/s 15076696.954op/s ± 42739.363op/s 15084442.663op/s ± 24751.283op/s 15107735.548op/s 15130724.074op/s 15139574.672op/s 15147902.211op/s 0.42% -0.976 1.066 0.28% 3022.129op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 59.393µs 59.551µs ± 0.074µs 59.544µs ± 0.051µs 59.599µs 59.693µs 59.721µs 59.743µs 0.33% 0.367 -0.341 0.12% 0.005µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 16738487.731op/s 16792229.904op/s ± 20845.736op/s 16794217.752op/s ± 14261.406op/s 16807359.523op/s 16823281.151op/s 16828013.173op/s 16836972.307op/s 0.25% -0.361 -0.347 0.12% 1474.016op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.893µs 3.912µs ± 0.004µs 3.912µs ± 0.002µs 3.914µs 3.916µs 3.926µs 3.928µs 0.41% 0.336 6.113 0.10% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254599671.141op/s 255638259.725op/s ± 245250.285op/s 255648550.730op/s ± 124399.753op/s 255754859.429op/s 255993103.150op/s 256140032.952op/s 256894843.607op/s 0.49% -0.313 6.125 0.10% 17341.814op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 56.200µs 56.437µs ± 0.135µs 56.425µs ± 0.088µs 56.512µs 56.684µs 56.864µs 56.906µs 0.85% 0.828 0.791 0.24% 0.010µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17572755.676op/s 17719114.082op/s ± 42248.969op/s 17722748.922op/s ± 27692.921op/s 17751397.901op/s 17774988.142op/s 17786131.357op/s 17793733.831op/s 0.40% -0.813 0.749 0.24% 2987.453op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 51.336µs 51.437µs ± 0.038µs 51.433µs ± 0.022µs 51.459µs 51.499µs 51.535µs 51.603µs 0.33% 0.396 1.612 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19378627.778op/s 19441294.881op/s ± 14390.509op/s 19442811.886op/s ± 8419.016op/s 19450148.297op/s 19465507.524op/s 19475816.394op/s 19479626.259op/s 0.19% -0.389 1.597 0.07% 1017.563op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.029µs 6.040µs ± 0.006µs 6.040µs ± 0.002µs 6.042µs 6.045µs 6.048µs 6.110µs 1.17% 7.617 86.703 0.10% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 163666704.137op/s 165562120.042op/s ± 165040.370op/s 165574010.019op/s ± 55109.488op/s 165620100.835op/s 165730856.023op/s 165847666.978op/s 165868578.735op/s 0.18% -7.525 85.347 0.10% 11670.116op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.911µs; 3.912µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ throughput [255633606.260op/s; 255688788.535op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [83.167µs; 83.290µs] or [-0.074%; +0.074%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12006564.884op/s; 12024278.095op/s] or [-0.074%; +0.074%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [79.651µs; 79.768µs] or [-0.073%; +0.073%] None None None
credit_card/is_card_number/ 378282246310005 throughput [12536756.894op/s; 12555177.096op/s] or [-0.073%; +0.073%] None None None
credit_card/is_card_number/37828224631 execution_time [3.913µs; 3.914µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631 throughput [255522994.120op/s; 255580997.890op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/378282246310005 execution_time [76.526µs; 76.637µs] or [-0.073%; +0.073%] None None None
credit_card/is_card_number/378282246310005 throughput [13048894.450op/s; 13067846.282op/s] or [-0.073%; +0.073%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [51.416µs; 51.425µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19445888.496op/s; 19449362.425op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.039µs; 6.040µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/x371413321323331 throughput [165568884.003op/s; 165600442.046op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.913µs; 3.914µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ throughput [255488879.142op/s; 255547230.515op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [66.302µs; 66.354µs] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15070773.689op/s; 15082620.218op/s] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [59.541µs; 59.562µs] or [-0.017%; +0.017%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [16789340.885op/s; 16795118.922op/s] or [-0.017%; +0.017%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.911µs; 3.912µs] or [-0.013%; +0.013%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255604270.395op/s; 255672249.056op/s] or [-0.013%; +0.013%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [56.418µs; 56.455µs] or [-0.033%; +0.033%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [17713258.782op/s; 17724969.383op/s] or [-0.033%; +0.033%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [51.432µs; 51.442µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19439300.494op/s; 19443289.267op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.039µs; 6.041µs] or [-0.014%; +0.014%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165539247.034op/s; 165584993.050op/s] or [-0.014%; +0.014%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c3d17be 1742169417 taegyunkim/prof-11491-pyo3
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 504.020µs 505.391µs ± 0.858µs 505.370µs ± 0.389µs 505.750µs 506.130µs 506.700µs 514.902µs 1.89% 6.775 73.479 0.17% 0.061µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1942116.722op/s 1978670.864op/s ± 3323.400op/s 1978747.700op/s ± 1523.782op/s 1980327.809op/s 1982196.582op/s 1983548.974op/s 1984048.252op/s 0.27% -6.626 71.336 0.17% 235.000op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 453.021µs 453.719µs ± 0.309µs 453.691µs ± 0.194µs 453.895µs 454.250µs 454.436µs 454.608µs 0.20% 0.272 -0.222 0.07% 0.022µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2199698.773op/s 2204006.381op/s ± 1502.533op/s 2204142.498op/s ± 942.461op/s 2204950.235op/s 2206369.409op/s 2206985.922op/s 2207401.240op/s 0.15% -0.269 -0.225 0.07% 106.245op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 175.405µs 176.489µs ± 0.392µs 176.546µs ± 0.269µs 176.771µs 177.043µs 177.213µs 177.308µs 0.43% -0.529 -0.054 0.22% 0.028µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5639910.427op/s 5666099.629op/s ± 12595.654op/s 5664235.973op/s ± 8612.279op/s 5674360.363op/s 5688543.833op/s 5699353.472op/s 5701102.857op/s 0.65% 0.540 -0.039 0.22% 890.647op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.811µs 37.936µs ± 0.050µs 37.940µs ± 0.033µs 37.970µs 38.017µs 38.055µs 38.056µs 0.31% -0.077 -0.224 0.13% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26277197.855op/s 26359884.778op/s ± 34765.725op/s 26357561.935op/s ± 22934.096op/s 26381953.247op/s 26420909.415op/s 26435018.304op/s 26447448.075op/s 0.34% 0.084 -0.223 0.13% 2458.308op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.102µs 48.312µs ± 0.224µs 48.251µs ± 0.145µs 48.516µs 48.619µs 48.721µs 49.774µs 3.16% 1.564 7.078 0.46% 0.016µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20090899.176op/s 20699197.040op/s ± 95337.916op/s 20725053.530op/s ± 62469.205op/s 20786021.104op/s 20788070.261op/s 20788981.602op/s 20789085.136op/s 0.31% -1.475 6.322 0.46% 6741.409op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [505.272µs; 505.510µs] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1978210.273op/s; 1979131.456op/s] or [-0.023%; +0.023%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [453.677µs; 453.762µs] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2203798.144op/s; 2204214.617op/s] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [176.435µs; 176.543µs] or [-0.031%; +0.031%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5664353.993op/s; 5667845.266op/s] or [-0.031%; +0.031%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.930µs; 37.943µs] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26355066.583op/s; 26364702.974op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [48.281µs; 48.343µs] or [-0.064%; +0.064%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20685984.121op/s; 20712409.958op/s] or [-0.064%; +0.064%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c3d17be 1742169417 taegyunkim/prof-11491-pyo3
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 32.961µs 33.575µs ± 0.696µs 33.186µs ± 0.082µs 34.138µs 34.969µs 35.278µs 36.272µs 9.30% 1.326 0.608 2.07% 0.049µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.478µs; 33.671µs] or [-0.287%; +0.287%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c3d17be 1742169417 taegyunkim/prof-11491-pyo3
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 246.085ns 254.318ns ± 11.382ns 248.353ns ± 1.563ns 257.863ns 281.469ns 283.344ns 286.371ns 15.31% 1.471 0.725 4.46% 0.805ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [252.740ns; 255.895ns] or [-0.620%; +0.620%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c3d17be 1742169417 taegyunkim/prof-11491-pyo3
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 148.391µs 149.335µs ± 0.630µs 149.252µs ± 0.164µs 149.415µs 149.967µs 150.561µs 156.864µs 5.10% 8.746 100.274 0.42% 0.045µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [149.248µs; 149.423µs] or [-0.059%; +0.059%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c3d17be 1742169417 taegyunkim/prof-11491-pyo3
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.379µs 2.421µs ± 0.046µs 2.410µs ± 0.009µs 2.421µs 2.469µs 2.686µs 2.687µs 11.49% 4.789 24.596 1.89% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.415µs; 2.427µs] or [-0.263%; +0.263%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c3d17be 1742169417 taegyunkim/prof-11491-pyo3
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.615µs 25.122µs ± 10.417µs 17.926µs ± 0.234µs 34.525µs 41.172µs 53.951µs 90.294µs 403.71% 1.875 6.723 41.36% 0.737µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [23.678µs; 26.565µs] or [-5.747%; +5.747%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c3d17be 1742169417 taegyunkim/prof-11491-pyo3
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 54.477ms 54.954ms ± 0.264ms 54.877ms ± 0.169ms 55.096ms 55.447ms 55.595ms 55.994ms 2.03% 0.871 0.313 0.48% 0.019ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [54.917ms; 54.991ms] or [-0.067%; +0.067%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c3d17be 1742169417 taegyunkim/prof-11491-pyo3
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 66.156µs 66.377µs ± 0.190µs 66.347µs ± 0.038µs 66.387µs 66.511µs 67.045µs 68.521µs 3.28% 8.084 82.249 0.29% 0.013µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [66.350µs; 66.403µs] or [-0.040%; +0.040%] None None None

Baseline

Omitted due to size.

@taegyunkim taegyunkim changed the title pyo3 feature crashtracker: use pyo3 to provide Python bindings Mar 17, 2025
@taegyunkim taegyunkim changed the title crashtracker: use pyo3 to provide Python bindings crashtracker: use pyo3 to provide Python bindings (WIP) Mar 17, 2025
@taegyunkim taegyunkim closed this Mar 25, 2025
@taegyunkim taegyunkim deleted the taegyunkim/prof-11491-pyo3 branch March 25, 2025 15:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant