Search results

benchmark EpistemeAI's gpt-oss-20b

Status: Open.

#50 In scicode-bench/SciCode;

· tomtyiu opened on Oct 4, 2025

Code extraction error for the previous substeps for specific questions 13, 62 and 76

Status: Open.

#49 In scicode-bench/SciCode;

· amaand-cerebras opened on Sep 22, 2025

README: Domain count mismatch — says “6 domains” but benchmark only has 5 (per paper & website)

Status: Open.

#48 In scicode-bench/SciCode;

· fenglang918 opened on Sep 6, 2025

bug: Inspect AI implementation runs n+1 step before n step

Status: Open.

#46 In scicode-bench/SciCode;

· TheFloatingString opened on Aug 13, 2025

Some example's <code>ground_truth_code</code> do not pass the tests in dev set

Status: Open.

#43 In scicode-bench/SciCode;

· John-Boccio opened on May 2, 2025

Add o3 and o4 mini to the leaderboard

Status: Open.

#42 In scicode-bench/SciCode;

· GypsyDignity opened on Apr 22, 2025

Add gpt-4.5 to the leaderboard

Status: Open.

#37 In scicode-bench/SciCode;

· LuigiPagani opened on Mar 9, 2025

Benchmark Claude Sonnet 3.7

Status: Open.

#36 In scicode-bench/SciCode;

· LuigiPagani opened on Mar 6, 2025

Benchmark o1

Status: Open.

#35 In scicode-bench/SciCode;

· LuigiPagani opened on Mar 6, 2025

Dependency versions for evaluation

Status: Open.

#2 In scicode-bench/SciCode;

· zrait opened on Jul 21, 2024