TEST-NEEDS.adoc

TEST-NEEDS: zerostep

CRG Grade: C — ACHIEVED 2026-04-04

Current State

Category	Count	Details
Source modules	7	Rust (main, metadata), Julia (contrastive_model, julia_utils), 3 Idris2 ABI
Unit tests	5	test/runtests.jl (5 @test)
Integration tests	0	None
E2E tests	0	None
Benchmarks	0	None
Fuzz tests	1	fuzz/fuzz_targets/fuzz_input.rs

What’s Missing

P2P Tests

• ❏ No tests for Rust <→ Julia interop

• ❏ No tests for contrastive model feeding into metadata processing

E2E Tests

• ❏ No test running zerostep binary end-to-end

• ❏ No test for the contrastive learning pipeline

Aspect Tests

• ❏ Security: No input validation tests

• ❏ Performance: ML contrastive model with 0 benchmarks

• ❏ Concurrency: No tests for parallel model execution

• ❏ Error handling: No tests for malformed input data, model failures

Build & Execution

• ❏ No Rust compilation test

• ❏ No Idris2 ABI compilation test

• ❏ Nickel config (config.ncl) untested

Benchmarks Needed

• ❏ Contrastive model training time

• ❏ Inference latency

• ❏ Metadata processing throughput

Self-Tests

• ❏ No self-diagnostic mode

FLAGGED ISSUES

• 5 @test for 7 source modules = barely tested

• ML project with 0 benchmarks – performance is the entire point

• Fuzz target exists (fuzz_input.rs) – rare positive

• Julia model code with no Julia-specific tests for the model itself

Priority: P1 (HIGH)