Skip to content

Batch simulation sweep infrastructure (M11.1)#59

Merged
SorraTheOrc merged 4 commits intomainfrom
copilot/remote-lobster
Dec 4, 2025
Merged

Batch simulation sweep infrastructure (M11.1)#59
SorraTheOrc merged 4 commits intomainfrom
copilot/remote-lobster

Conversation

Copy link

Copilot AI commented Dec 4, 2025

Adds multi-dimensional parameter grid sweeps with parallel execution for balance analysis. Extends existing tournament and difficulty sweep tooling to support broader parameter space exploration.

New Files

  • scripts/run_batch_sweeps.py — Batch runner with Cartesian product grid generation, ProcessPoolExecutor parallelism, JSON output per sweep with telemetry/metadata
  • content/config/batch_sweeps.yml — Default configuration: strategies, difficulties, seeds, worlds, tick budgets, parallel settings, sampling modes
  • tests/scripts/test_batch_sweeps.py — 29 tests covering grid generation, parallel execution, CLI parsing, output validation

Updated

  • docs/gengine/ai_tournament_and_balance_analysis.md — Configuration format, CLI reference, workflow documentation

Usage

# Run with default config
uv run python scripts/run_batch_sweeps.py --output-dir build/sweeps

# Override parameters via CLI
uv run python scripts/run_batch_sweeps.py \
    --strategies balanced aggressive --seeds 42 123 --ticks 100 200

# Custom config
uv run python scripts/run_batch_sweeps.py --config content/config/batch_sweeps.yml

Output Format

{
  "sweep_id": 0,
  "parameters": {"strategy": "balanced", "difficulty": "normal", "seed": 42, ...},
  "results": {"final_stability": 0.75, "actions_taken": 10, ...},
  "telemetry": {...},
  "metadata": {"timestamp": "...", "git_commit": "...", "runtime": {...}}
}
Original prompt

"Issue 58 - Batch Simulation Sweep Infrastructur" to gamedev agent

Created from Copilot CLI via the copilot delegate command.


✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

- Add scripts/run_batch_sweeps.py with multi-dimensional parameter grid support
- Add content/config/batch_sweeps.yml for sweep configuration
- Add 29 tests in tests/scripts/test_batch_sweeps.py
- Update docs/gengine/ai_tournament_and_balance_analysis.md with documentation

Implements task 11.1.1 (M11.1) from Phase 11 Automated Balance Workflow

Co-authored-by: SorraTheOrc <250240+SorraTheOrc@users.noreply.github.com>
Copilot AI changed the title [WIP] Add batch simulation sweep infrastructure Batch simulation sweep infrastructure (M11.1) Dec 4, 2025
Copilot AI requested a review from SorraTheOrc December 4, 2025 07:54
@SorraTheOrc SorraTheOrc merged commit b7b3415 into main Dec 4, 2025
1 of 2 checks passed
@SorraTheOrc SorraTheOrc deleted the copilot/remote-lobster branch December 4, 2025 09:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants