Skip to content

feat: JIT revmc - #939

Open
0xOsiris wants to merge 8 commits into
mainfrom
codex/just-in-time
Open

feat: JIT revmc#939
0xOsiris wants to merge 8 commits into
mainfrom
codex/just-in-time

Conversation

@0xOsiris

@0xOsiris 0xOsiris commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

Note

Low Risk
CI and packaging-only changes; no runtime consensus or auth logic. Main risk is longer or flakier builds if LLVM install fails on runners.

Overview
Adds LLVM 22 as a build prerequisite for revmc (llvm-sys / LLVM_SYS_221_PREFIX) so CI, release binaries, and Docker can compile the default JIT-enabled world-chain binary.

Introduces .github/scripts/install_llvm_ubuntu.sh (apt.llvm.org via llvm.sh, versioned tool symlinks, permission safeguards) and wires it into rust-ci (cargo-tests, cargo-clippy), release build-binaries, and the Docker base image. Workflow path filters now include the script and .dockerignore; clippy timeout goes from 20 to 30 minutes.

.dockerignore is adjusted so the install script is not excluded from the Docker build context while the rest of .github/ stays ignored.

Reviewed by Cursor Bugbot for commit 5f8826e. Configure here.

@socket-security

socket-security Bot commented Jul 29, 2026

Copy link
Copy Markdown

Warning

Review the following alerts detected in dependencies.

According to your organization's Security Policy, it is recommended to resolve "Warn" alerts. Learn more about Socket for GitHub.

Action Severity Alert  (click "▶" to expand/collapse)
Warn High
License policy violation: cargo crossbeam-channel under CC-BY-3.0

License: CC-BY-3.0 - The applicable license policy does not permit this license (5) (crossbeam-channel-0.5.16/LICENSE-THIRD-PARTY)

From: Cargo.lockcargo/crossbeam-channel@0.5.16

ℹ Read more on: This package | This alert | What is a license policy violation?

Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at support@socket.dev.

Suggestion: Find a package that does not violate your license policy or adjust your policy to allow this package's license.

Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore cargo/crossbeam-channel@0.5.16. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.

Warn High
License policy violation: cargo libgit2-sys under RSA-MD

License: RSA-MD - The applicable license policy does not permit this license (5) (libgit2-sys-0.18.7+1.9.6/libgit2/COPYING)

License: GPL-2.0-or-later - The applicable license policy does not permit this license (5) (libgit2-sys-0.18.7+1.9.6/libgit2/COPYING)

License: GPL-2.0 - The applicable license policy does not permit this license (5) (libgit2-sys-0.18.7+1.9.6/libgit2/COPYING)

License: LGPL-2.1 WITH PCRE2-exception - The applicable license policy does not permit this license (5) (libgit2-sys-0.18.7+1.9.6/libgit2/COPYING)

License: BSD-3-Clause WITH PCRE2-exception - The applicable license policy does not permit this license (5) (libgit2-sys-0.18.7+1.9.6/libgit2/deps/pcre2/LICENCE.md)

From: ?cargo/vergen-git2@9.1.0cargo/vergen-git2@10.0.1cargo/libgit2-sys@0.18.7%2B1.9.6

ℹ Read more on: This package | This alert | What is a license policy violation?

Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at support@socket.dev.

Suggestion: Find a package that does not violate your license policy or adjust your policy to allow this package's license.

Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore cargo/libgit2-sys@0.18.7%2B1.9.6. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.

Warn High
Obfuscated code: cargo openssl is 90.0% likely obfuscated

Confidence: 0.90

Location: Package overview

From: ?cargo/alloy-transport-http@2.1.1cargo/openssl@0.10.81

ℹ Read more on: This package | This alert | What is obfuscated code?

Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at support@socket.dev.

Suggestion: Packages should not obfuscate their code. Consider not using packages with obfuscated code.

Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore cargo/openssl@0.10.81. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.

Warn High
Obfuscated code: cargo tokio is 90.0% likely obfuscated

Confidence: 0.90

Location: Package overview

From: Cargo.lockcargo/tokio@1.53.1

ℹ Read more on: This package | This alert | What is obfuscated code?

Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at support@socket.dev.

Suggestion: Packages should not obfuscate their code. Consider not using packages with obfuscated code.

Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore cargo/tokio@1.53.1. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.

Warn High
License policy violation: cargo webpki-root-certs under CDLA-Permissive-2.0

License: CDLA-Permissive-2.0 - The applicable license policy does not permit this license (5) (webpki-root-certs-1.0.9/Cargo.toml)

License: CDLA-Permissive-2.0 - The applicable license policy does not permit this license (5) (webpki-root-certs-1.0.9/LICENSE)

From: ?cargo/reqwest@0.13.4cargo/jsonrpsee@0.26.0cargo/webpki-root-certs@1.0.9

ℹ Read more on: This package | This alert | What is a license policy violation?

Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at support@socket.dev.

Suggestion: Find a package that does not violate your license policy or adjust your policy to allow this package's license.

Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore cargo/webpki-root-certs@1.0.9. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.

Warn High
License policy violation: cargo webpki-roots under CDLA-Permissive-2.0

License: CDLA-Permissive-2.0 - The applicable license policy does not permit this license (5) (webpki-roots-1.0.9/Cargo.toml)

License: CDLA-Permissive-2.0 - The applicable license policy does not permit this license (5) (webpki-roots-1.0.9/LICENSE)

From: ?cargo/reqwest@0.12.28cargo/sp1-sdk@6.1.0cargo/testcontainers@0.27.3cargo/reqwest@0.13.4cargo/alloy-rpc-client@2.1.1cargo/alloy-provider@2.1.1cargo/jsonrpsee@0.26.0cargo/webpki-roots@1.0.9

ℹ Read more on: This package | This alert | What is a license policy violation?

Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at support@socket.dev.

Suggestion: Find a package that does not violate your license policy or adjust your policy to allow this package's license.

Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore cargo/webpki-roots@1.0.9. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.

Warn High
License policy violation: cargo yoke under Unicode-3.0

License: Unicode-3.0 - The applicable license policy does not permit this license (5) (yoke-0.8.3/LICENSE)

From: ?cargo/url@2.5.8cargo/yoke@0.8.3

ℹ Read more on: This package | This alert | What is a license policy violation?

Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at support@socket.dev.

Suggestion: Find a package that does not violate your license policy or adjust your policy to allow this package's license.

Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore cargo/yoke@0.8.3. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.

Warn High
Obfuscated code: cargo zerocopy is 90.0% likely obfuscated

Confidence: 0.90

Location: Package overview

From: ?cargo/alloy-trie@0.9.5cargo/proptest@1.11.0cargo/sp1-zkvm@6.1.0cargo/sp1-sdk@6.1.0cargo/sp1-lib@6.1.0cargo/alloy-primitives@1.6.0cargo/revm-precompile@41.0.0cargo/semaphore-rs@0.5.4cargo/semaphore-rs-proof@0.5.4cargo/reth-primitives-traits@0.5.2cargo/alloy-rpc-types-engine@2.1.1cargo/alloy-consensus@2.1.1cargo/alloy-provider@2.1.1cargo/rand@0.9.5cargo/rand@0.8.7cargo/alloy-primitives@1.6.1cargo/secp256k1@0.30.0cargo/ciborium@0.2.2cargo/zerocopy@0.8.55

ℹ Read more on: This package | This alert | What is obfuscated code?

Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at support@socket.dev.

Suggestion: Packages should not obfuscate their code. Consider not using packages with obfuscated code.

Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore cargo/zerocopy@0.8.55. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.

Warn High
License policy violation: cargo zerofrom under Unicode-3.0

License: Unicode-3.0 - The applicable license policy does not permit this license (5) (zerofrom-0.1.8/LICENSE)

From: ?cargo/url@2.5.8cargo/zerofrom@0.1.8

ℹ Read more on: This package | This alert | What is a license policy violation?

Next steps: Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at support@socket.dev.

Suggestion: Find a package that does not violate your license policy or adjust your policy to allow this package's license.

Mark the package as acceptable risk. To ignore this alert only in this pull request, reply with the comment @SocketSecurity ignore cargo/zerofrom@0.1.8. You can also ignore all packages with @SocketSecurity ignore-all. To ignore an alert for all future pull requests, use Socket's Dashboard to change the triage state of this alert.

View full report

@github-actions

github-actions Bot commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

Benchmark Results

All three baselines measured on the same runner in the same workflow run.
Base and PR are the interpreter at each revision; PR + JIT is the PR revision
built with the revmc JIT backend (--features jit).

Benchmark Base PR Change PR + JIT JIT vs PR
flashblock_validation_launch_flashblock_sequence_eth_transfers/stream/4fb_x_125tx 29.6±1.19ms 28.4±0.13ms 🟢 -3.85% 28.6±0.16ms 🟡 +1.00%
flashblock_validation_launch_flashblock_sequence_eth_transfers/stream/4fb_x_250tx 58.0±1.68ms 56.3±0.17ms 🟢 -2.91% 56.4±0.11ms 🟢 +0.00%
flashblock_validation_launch_flashblock_sequence_eth_transfers/stream/4fb_x_50tx 13.8±2.25ms 11.6±0.01ms 🟢 -15.97% 11.7±0.08ms 🟡 +1.00%
flashblock_validation_launch_flashblock_sequence_eth_transfers_with_bal/stream/4fb_x_125tx 40.3±4.19ms 34.9±0.18ms 🟢 -13.04% 36.2±0.32ms 🟡 +4.00%
flashblock_validation_launch_flashblock_sequence_eth_transfers_with_bal/stream/4fb_x_250tx 75.5±0.73ms 74.6±0.36ms 🟢 -0.99% 75.9±0.51ms 🟡 +2.00%
flashblock_validation_launch_flashblock_sequence_eth_transfers_with_bal/stream/4fb_x_50tx 15.1±0.63ms 14.8±0.19ms 🟢 -2.88% 14.6±0.10ms 🟢 -0.99%
flashblock_validation_launch_flashblock_sequence_fib/stream/4fb_x_125tx 27.0±0.04ms 26.9±0.06ms 🟢 -0.99% 26.9±0.04ms 🟢 +0.00%
flashblock_validation_launch_flashblock_sequence_fib/stream/4fb_x_250tx 53.2±0.51ms 53.6±0.96ms 🟡 +1.00% 53.1±0.06ms 🟢 -0.99%
flashblock_validation_launch_flashblock_sequence_fib/stream/4fb_x_50tx 11.3±0.11ms 11.0±0.01ms 🟢 -2.91% 11.1±0.04ms 🟡 +1.00%
flashblock_validation_launch_flashblock_sequence_fib_with_bal/stream/4fb_x_125tx 29.2±0.10ms 30.0±0.31ms 🟡 +3.00% 30.5±1.05ms 🟡 +0.97%
flashblock_validation_launch_flashblock_sequence_fib_with_bal/stream/4fb_x_250tx 57.6±0.60ms 56.5±0.21ms 🟢 -1.96% 56.9±0.20ms 🟡 +1.00%
flashblock_validation_launch_flashblock_sequence_fib_with_bal/stream/4fb_x_50tx 13.8±0.28ms 13.6±0.29ms 🟢 -0.99% 14.1±0.37ms 🟡 +4.00%
flashblock_validation_launch_flashblock_sequence_world_id_like_bn254/stream/4fb_x_10tx 136.1±0.24ms 135.2±0.14ms 🟢 -0.99% 135.0±0.09ms 🟢 +0.00%
flashblock_validation_launch_flashblock_sequence_world_id_like_bn254/stream/4fb_x_12tx 163.4±0.25ms 162.0±0.38ms 🟢 -0.99% 161.9±0.17ms 🟢 +0.00%
flashblock_validation_launch_flashblock_sequence_world_id_like_bn254/stream/4fb_x_5tx 68.7±0.04ms 68.1±0.06ms 🟢 -0.99% 68.1±0.27ms 🟢 +0.00%
flashblock_validation_launch_flashblock_sequence_world_id_like_bn254_with_bal/stream/4fb_x_10tx 22.9±2.02ms 21.1±0.86ms 🟢 -7.41% 23.0±0.98ms 🟡 +9.00%
flashblock_validation_launch_flashblock_sequence_world_id_like_bn254_with_bal/stream/4fb_x_12tx 24.2±1.75ms 22.3±1.21ms 🟢 -7.41% 25.0±1.37ms 🟡 +12.00%
flashblock_validation_launch_flashblock_sequence_world_id_like_bn254_with_bal/stream/4fb_x_5tx 19.0±0.61ms 19.5±1.82ms 🟡 +3.00% 19.3±0.90ms 🟢 -1.94%
flashblock_validation_process_flashblock_eth_transfers/txs/1000 49.5±0.27ms 49.4±0.06ms 🟢 +0.00% 49.6±0.12ms 🟢 +0.00%
flashblock_validation_process_flashblock_eth_transfers/txs/50 2.7±0.02ms 2.6±0.02ms 🟢 -1.96% 2.6±0.02ms 🟢 +0.00%
flashblock_validation_process_flashblock_eth_transfers/txs/500 24.8±0.44ms 24.8±0.03ms 🟢 +0.00% 24.9±0.16ms 🟢 +0.00%
flashblock_validation_process_flashblock_eth_transfers_with_bal/txs/1000 50.5±0.32ms 51.0±0.11ms 🟡 +1.00% 50.7±0.11ms 🟢 -0.99%
flashblock_validation_process_flashblock_eth_transfers_with_bal/txs/50 3.0±0.05ms 3.1±0.07ms 🟡 +3.00% 3.1±0.03ms 🟢 -1.94%
flashblock_validation_process_flashblock_eth_transfers_with_bal/txs/500 25.4±0.09ms 26.0±0.14ms 🟡 +2.00% 25.7±0.11ms 🟢 -0.98%
flashblock_validation_process_flashblock_fib/txs/1000 48.9±0.49ms 48.8±0.14ms 🟢 +0.00% 48.9±0.03ms 🟢 +0.00%
flashblock_validation_process_flashblock_fib/txs/50 2.8±0.29ms 2.5±0.03ms 🟢 -11.50% 2.6±0.04ms 🟡 +3.00%
flashblock_validation_process_flashblock_fib/txs/500 24.4±0.07ms 24.6±0.29ms 🟡 +1.00% 24.6±0.02ms 🟢 +0.00%
flashblock_validation_process_flashblock_fib_with_bal/txs/1000 49.4±1.21ms 49.8±0.22ms 🟡 +1.00% 49.1±0.07ms 🟢 -0.99%
flashblock_validation_process_flashblock_fib_with_bal/txs/50 3.4±0.26ms 3.1±0.09ms 🟢 -6.42% 3.1±0.04ms 🟢 -1.96%
flashblock_validation_process_flashblock_fib_with_bal/txs/500 25.9±2.69ms 25.1±0.08ms 🟢 -2.91% 25.1±0.06ms 🟢 +0.00%
flashblock_validation_process_flashblock_world_id_like_bn254/txs/10 39.2±5.79ms 33.7±0.04ms 🟢 -13.79% 33.8±0.14ms 🟢 +0.00%
flashblock_validation_process_flashblock_world_id_like_bn254/txs/25 85.1±3.00ms 84.0±0.46ms 🟢 -0.99% 84.1±0.09ms 🟢 +0.00%
flashblock_validation_process_flashblock_world_id_like_bn254/txs/50 168.7±1.61ms 167.7±0.07ms 🟢 -0.99% 167.7±0.11ms 🟢 +0.00%
flashblock_validation_process_flashblock_world_id_like_bn254_with_bal/txs/10 6.6±0.11ms 5.3±0.19ms 🟢 -19.35% 5.4±0.41ms 🟡 +3.00%
flashblock_validation_process_flashblock_world_id_like_bn254_with_bal/txs/25 7.7±0.19ms 7.9±0.23ms 🟡 +3.00% 7.8±0.11ms 🟢 -1.94%
flashblock_validation_process_flashblock_world_id_like_bn254_with_bal/txs/50 14.4±0.51ms 11.1±1.33ms 🟢 -22.79% 10.6±0.12ms 🟢 -4.76%

Change (Base → PR): 🔴 regression > 10%  ·  🟡 slower  ·  🟢 faster. A regression > 10% fails the check.

JIT vs PR (interpreter → JIT, same revision): 🟡 slower  ·  🟢 faster. Informational only — never fails the check, since fixtures without heavy bytecode are not expected to gain from JIT.

Raw critcmp output
group                                                                                              base                                   jit                                    pr
-----                                                                                              ----                                   ---                                    --
flashblock_validation_launch_flashblock_sequence_eth_transfers/stream/4fb_x_125tx                  1.04     29.6±1.19ms        ? ?/sec    1.01     28.6±0.16ms        ? ?/sec    1.00     28.4±0.13ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_eth_transfers/stream/4fb_x_250tx                  1.03     58.0±1.68ms        ? ?/sec    1.00     56.4±0.11ms        ? ?/sec    1.00     56.3±0.17ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_eth_transfers/stream/4fb_x_50tx                   1.19     13.8±2.25ms        ? ?/sec    1.01     11.7±0.08ms        ? ?/sec    1.00     11.6±0.01ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_eth_transfers_with_bal/stream/4fb_x_125tx         1.15     40.3±4.19ms        ? ?/sec    1.04     36.2±0.32ms        ? ?/sec    1.00     34.9±0.18ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_eth_transfers_with_bal/stream/4fb_x_250tx         1.01     75.5±0.73ms        ? ?/sec    1.02     75.9±0.51ms        ? ?/sec    1.00     74.6±0.36ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_eth_transfers_with_bal/stream/4fb_x_50tx          1.04     15.1±0.63ms        ? ?/sec    1.00     14.6±0.10ms        ? ?/sec    1.01     14.8±0.19ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_fib/stream/4fb_x_125tx                            1.01     27.0±0.04ms        ? ?/sec    1.00     26.9±0.04ms        ? ?/sec    1.00     26.9±0.06ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_fib/stream/4fb_x_250tx                            1.00     53.2±0.51ms        ? ?/sec    1.00     53.1±0.06ms        ? ?/sec    1.01     53.6±0.96ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_fib/stream/4fb_x_50tx                             1.03     11.3±0.11ms        ? ?/sec    1.01     11.1±0.04ms        ? ?/sec    1.00     11.0±0.01ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_fib_with_bal/stream/4fb_x_125tx                   1.00     29.2±0.10ms        ? ?/sec    1.04     30.5±1.05ms        ? ?/sec    1.03     30.0±0.31ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_fib_with_bal/stream/4fb_x_250tx                   1.02     57.6±0.60ms        ? ?/sec    1.01     56.9±0.20ms        ? ?/sec    1.00     56.5±0.21ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_fib_with_bal/stream/4fb_x_50tx                    1.01     13.8±0.28ms        ? ?/sec    1.04     14.1±0.37ms        ? ?/sec    1.00     13.6±0.29ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_world_id_like_bn254/stream/4fb_x_10tx             1.01    136.1±0.24ms        ? ?/sec    1.00    135.0±0.09ms        ? ?/sec    1.00    135.2±0.14ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_world_id_like_bn254/stream/4fb_x_12tx             1.01    163.4±0.25ms        ? ?/sec    1.00    161.9±0.17ms        ? ?/sec    1.00    162.0±0.38ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_world_id_like_bn254/stream/4fb_x_5tx              1.01     68.7±0.04ms        ? ?/sec    1.00     68.1±0.27ms        ? ?/sec    1.00     68.1±0.06ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_world_id_like_bn254_with_bal/stream/4fb_x_10tx    1.08     22.9±2.02ms        ? ?/sec    1.09     23.0±0.98ms        ? ?/sec    1.00     21.1±0.86ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_world_id_like_bn254_with_bal/stream/4fb_x_12tx    1.08     24.2±1.75ms        ? ?/sec    1.12     25.0±1.37ms        ? ?/sec    1.00     22.3±1.21ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_world_id_like_bn254_with_bal/stream/4fb_x_5tx     1.00     19.0±0.61ms        ? ?/sec    1.01     19.3±0.90ms        ? ?/sec    1.03     19.5±1.82ms        ? ?/sec
flashblock_validation_process_flashblock_eth_transfers/txs/1000                                    1.00     49.5±0.27ms        ? ?/sec    1.00     49.6±0.12ms        ? ?/sec    1.00     49.4±0.06ms        ? ?/sec
flashblock_validation_process_flashblock_eth_transfers/txs/50                                      1.02      2.7±0.02ms        ? ?/sec    1.00      2.6±0.02ms        ? ?/sec    1.00      2.6±0.02ms        ? ?/sec
flashblock_validation_process_flashblock_eth_transfers/txs/500                                     1.00     24.8±0.44ms        ? ?/sec    1.00     24.9±0.16ms        ? ?/sec    1.00     24.8±0.03ms        ? ?/sec
flashblock_validation_process_flashblock_eth_transfers_with_bal/txs/1000                           1.00     50.5±0.32ms        ? ?/sec    1.00     50.7±0.11ms        ? ?/sec    1.01     51.0±0.11ms        ? ?/sec
flashblock_validation_process_flashblock_eth_transfers_with_bal/txs/50                             1.00      3.0±0.05ms        ? ?/sec    1.01      3.1±0.03ms        ? ?/sec    1.03      3.1±0.07ms        ? ?/sec
flashblock_validation_process_flashblock_eth_transfers_with_bal/txs/500                            1.00     25.4±0.09ms        ? ?/sec    1.01     25.7±0.11ms        ? ?/sec    1.02     26.0±0.14ms        ? ?/sec
flashblock_validation_process_flashblock_fib/txs/1000                                              1.00     48.9±0.49ms        ? ?/sec    1.00     48.9±0.03ms        ? ?/sec    1.00     48.8±0.14ms        ? ?/sec
flashblock_validation_process_flashblock_fib/txs/50                                                1.13      2.8±0.29ms        ? ?/sec    1.03      2.6±0.04ms        ? ?/sec    1.00      2.5±0.03ms        ? ?/sec
flashblock_validation_process_flashblock_fib/txs/500                                               1.00     24.4±0.07ms        ? ?/sec    1.01     24.6±0.02ms        ? ?/sec    1.01     24.6±0.29ms        ? ?/sec
flashblock_validation_process_flashblock_fib_with_bal/txs/1000                                     1.00     49.4±1.21ms        ? ?/sec    1.00     49.1±0.07ms        ? ?/sec    1.01     49.8±0.22ms        ? ?/sec
flashblock_validation_process_flashblock_fib_with_bal/txs/50                                       1.09      3.4±0.26ms        ? ?/sec    1.00      3.1±0.04ms        ? ?/sec    1.02      3.1±0.09ms        ? ?/sec
flashblock_validation_process_flashblock_fib_with_bal/txs/500                                      1.03     25.9±2.69ms        ? ?/sec    1.00     25.1±0.06ms        ? ?/sec    1.00     25.1±0.08ms        ? ?/sec
flashblock_validation_process_flashblock_world_id_like_bn254/txs/10                                1.16     39.2±5.79ms        ? ?/sec    1.00     33.8±0.14ms        ? ?/sec    1.00     33.7±0.04ms        ? ?/sec
flashblock_validation_process_flashblock_world_id_like_bn254/txs/25                                1.01     85.1±3.00ms        ? ?/sec    1.00     84.1±0.09ms        ? ?/sec    1.00     84.0±0.46ms        ? ?/sec
flashblock_validation_process_flashblock_world_id_like_bn254/txs/50                                1.01    168.7±1.61ms        ? ?/sec    1.00    167.7±0.11ms        ? ?/sec    1.00    167.7±0.07ms        ? ?/sec
flashblock_validation_process_flashblock_world_id_like_bn254_with_bal/txs/10                       1.24      6.6±0.11ms        ? ?/sec    1.03      5.4±0.41ms        ? ?/sec    1.00      5.3±0.19ms        ? ?/sec
flashblock_validation_process_flashblock_world_id_like_bn254_with_bal/txs/25                       1.00      7.7±0.19ms        ? ?/sec    1.01      7.8±0.11ms        ? ?/sec    1.03      7.9±0.23ms        ? ?/sec
flashblock_validation_process_flashblock_world_id_like_bn254_with_bal/txs/50                       1.36     14.4±0.51ms        ? ?/sec    1.00     10.6±0.12ms        ? ?/sec    1.05     11.1±1.33ms        ? ?/sec

@github-actions

github-actions Bot commented Jul 30, 2026

Copy link
Copy Markdown
Contributor

JIT vs interpreter (flashblock_validation_synthetic)

group                                                                                              jit                                    nojit
-----                                                                                              ---                                    -----
flashblock_validation_launch_flashblock_sequence_eth_transfers/stream/4fb_x_125tx                  1.00     28.5±0.05ms        ? ?/sec    1.10     31.4±3.99ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_eth_transfers/stream/4fb_x_250tx                  1.00     58.0±4.26ms        ? ?/sec    1.11     64.1±6.54ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_eth_transfers/stream/4fb_x_50tx                   1.00     11.9±0.07ms        ? ?/sec    1.27     15.1±2.60ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_eth_transfers_with_bal/stream/4fb_x_125tx         1.00     35.0±0.66ms        ? ?/sec    1.10     38.3±3.01ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_eth_transfers_with_bal/stream/4fb_x_250tx         1.00     75.2±1.18ms        ? ?/sec    1.09     82.1±4.79ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_eth_transfers_with_bal/stream/4fb_x_50tx          1.00     14.9±0.38ms        ? ?/sec    1.28     19.1±2.99ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_fib/stream/4fb_x_125tx                            1.01     27.4±0.58ms        ? ?/sec    1.00     27.1±0.53ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_fib/stream/4fb_x_250tx                            1.00     54.3±0.74ms        ? ?/sec    1.02     55.1±3.46ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_fib/stream/4fb_x_50tx                             1.00     11.3±0.19ms        ? ?/sec    1.04     11.7±1.28ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_fib_with_bal/stream/4fb_x_125tx                   1.00     29.3±0.40ms        ? ?/sec    1.03     30.1±0.65ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_fib_with_bal/stream/4fb_x_250tx                   1.00     55.5±1.14ms        ? ?/sec    1.01     56.2±1.31ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_fib_with_bal/stream/4fb_x_50tx                    1.04     13.8±0.39ms        ? ?/sec    1.00     13.3±0.37ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_world_id_like_bn254/stream/4fb_x_10tx             1.00    138.6±2.54ms        ? ?/sec    1.00    138.3±4.37ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_world_id_like_bn254/stream/4fb_x_12tx             1.00    166.5±4.86ms        ? ?/sec    1.04   174.0±24.99ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_world_id_like_bn254/stream/4fb_x_5tx              1.00     68.3±0.14ms        ? ?/sec    1.02     69.7±4.46ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_world_id_like_bn254_with_bal/stream/4fb_x_10tx    1.00     21.8±1.41ms        ? ?/sec    1.26     27.4±0.35ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_world_id_like_bn254_with_bal/stream/4fb_x_12tx    1.00     23.4±1.53ms        ? ?/sec    1.23     28.8±0.43ms        ? ?/sec
flashblock_validation_launch_flashblock_sequence_world_id_like_bn254_with_bal/stream/4fb_x_5tx     1.00     18.6±0.77ms        ? ?/sec    1.32     24.5±0.41ms        ? ?/sec
flashblock_validation_process_flashblock_eth_transfers/txs/1000                                    1.00     49.8±0.22ms        ? ?/sec    1.00     49.6±0.65ms        ? ?/sec
flashblock_validation_process_flashblock_eth_transfers/txs/50                                      1.00      2.6±0.02ms        ? ?/sec    1.00      2.6±0.05ms        ? ?/sec
flashblock_validation_process_flashblock_eth_transfers/txs/500                                     1.00     25.0±0.16ms        ? ?/sec    1.01     25.1±0.81ms        ? ?/sec
flashblock_validation_process_flashblock_eth_transfers_with_bal/txs/1000                           1.00     50.5±0.40ms        ? ?/sec    1.03     52.1±2.35ms        ? ?/sec
flashblock_validation_process_flashblock_eth_transfers_with_bal/txs/50                             1.00      3.0±0.04ms        ? ?/sec    1.03      3.1±0.17ms        ? ?/sec
flashblock_validation_process_flashblock_eth_transfers_with_bal/txs/500                            1.00     25.7±0.22ms        ? ?/sec    1.01     25.9±0.50ms        ? ?/sec
flashblock_validation_process_flashblock_fib/txs/1000                                              1.02     50.0±1.79ms        ? ?/sec    1.00     49.1±0.11ms        ? ?/sec
flashblock_validation_process_flashblock_fib/txs/50                                                1.00      2.6±0.04ms        ? ?/sec    1.01      2.6±0.10ms        ? ?/sec
flashblock_validation_process_flashblock_fib/txs/500                                               1.00     24.6±0.22ms        ? ?/sec    1.01     24.9±0.92ms        ? ?/sec
flashblock_validation_process_flashblock_fib_with_bal/txs/1000                                     1.00     49.4±1.15ms        ? ?/sec    1.25     61.7±5.21ms        ? ?/sec
flashblock_validation_process_flashblock_fib_with_bal/txs/50                                       1.00      3.2±0.10ms        ? ?/sec    1.18      3.7±0.41ms        ? ?/sec
flashblock_validation_process_flashblock_fib_with_bal/txs/500                                      1.00     25.1±0.46ms        ? ?/sec    1.14     28.6±3.69ms        ? ?/sec
flashblock_validation_process_flashblock_world_id_like_bn254/txs/10                                1.00     33.8±0.07ms        ? ?/sec    1.37     46.2±1.35ms        ? ?/sec
flashblock_validation_process_flashblock_world_id_like_bn254/txs/25                                1.00     84.5±0.14ms        ? ?/sec    1.05     88.8±6.56ms        ? ?/sec
flashblock_validation_process_flashblock_world_id_like_bn254/txs/50                                1.00    168.1±0.16ms        ? ?/sec    1.02    172.0±6.41ms        ? ?/sec
flashblock_validation_process_flashblock_world_id_like_bn254_with_bal/txs/10                       1.00      5.5±0.33ms        ? ?/sec    1.20      6.6±0.12ms        ? ?/sec
flashblock_validation_process_flashblock_world_id_like_bn254_with_bal/txs/25                       1.00      7.7±0.14ms        ? ?/sec    1.04      8.1±0.57ms        ? ?/sec
flashblock_validation_process_flashblock_world_id_like_bn254_with_bal/txs/50                       1.00     13.3±1.30ms        ? ?/sec    1.11     14.8±0.59ms        ? ?/sec

Informational: the faster baseline is normalized to 1.00. Fixtures without heavy bytecode are not expected to gain from JIT.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants