Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove schedulers from benchmark models. #2308

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

quaquel
Copy link
Member

@quaquel quaquel commented Sep 21, 2024

this removes the schedulers from the benchmark models (in one case it was in the init but not used in step anyway).

@quaquel quaquel requested a review from EwoutH September 21, 2024 08:34
Copy link

Performance benchmarks:

Model Size Init time [95% CI] Run time [95% CI]
BoltzmannWealth small 🔴 +20.3% [+18.9%, +21.7%] 🔴 +23.7% [+23.4%, +23.9%]
BoltzmannWealth large 🔴 +28.6% [+28.1%, +29.1%] 🔴 +22.0% [+21.1%, +22.8%]
Schelling small 🟢 -8.0% [-8.4%, -7.6%] 🔵 -1.0% [-1.2%, -0.8%]
Schelling large 🟢 -9.0% [-9.4%, -8.5%] 🔵 -1.7% [-2.2%, -1.2%]
WolfSheep small 🔵 -0.7% [-0.9%, -0.5%] 🔵 -0.0% [-0.2%, +0.1%]
WolfSheep large 🔵 -2.9% [-3.8%, -2.0%] 🔵 -2.2% [-4.8%, -0.2%]
BoidFlockers small 🟢 -8.0% [-8.8%, -7.4%] 🔵 +0.9% [+0.2%, +1.6%]
BoidFlockers large 🟢 -8.4% [-8.9%, -8.0%] 🔵 -0.3% [-1.2%, +0.7%]

@quaquel quaquel added trigger-benchmarks Special label that triggers the benchmarking CI and removed trigger-benchmarks Special label that triggers the benchmarking CI labels Sep 21, 2024
Copy link

Performance benchmarks:

Model Size Init time [95% CI] Run time [95% CI]
BoltzmannWealth small 🔴 +23.1% [+21.9%, +24.3%] 🔴 +24.5% [+24.3%, +24.7%]
BoltzmannWealth large 🔴 +29.4% [+29.0%, +29.7%] 🔴 +23.9% [+23.3%, +24.7%]
Schelling small 🟢 -8.0% [-8.4%, -7.6%] 🔵 -1.2% [-1.4%, -1.0%]
Schelling large 🟢 -8.7% [-8.9%, -8.5%] 🔵 -1.1% [-2.1%, -0.2%]
WolfSheep small 🔵 +0.1% [-0.1%, +0.2%] 🔵 +0.0% [-0.2%, +0.2%]
WolfSheep large 🔵 -1.1% [-1.4%, -0.7%] 🔵 +0.3% [-0.2%, +0.7%]
BoidFlockers small 🟢 -8.0% [-8.5%, -7.4%] 🔵 -0.4% [-1.0%, +0.2%]
BoidFlockers large 🟢 -8.3% [-8.7%, -7.9%] 🔵 -1.7% [-2.1%, -1.1%]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants