feat(eval): support DeepSeek Harness and run a reproducible ClawBench benchmark

[reacher-z]

Goal

Add DeepSeek Harness (dsh) as a first-class ClawBench harness, then run and publish a reproducible ClawBench evaluation with it.

DeepSeek Harness is an official DeepSeek open-source agent harness built around an “everything is a plugin” architecture. It is currently in developer preview and may introduce breaking changes, so the integration should pin an exact revision/version.

Scope

1. Harness adapter

• Add a deepseek-harness / dsh adapter alongside the existing OpenClaw, HermesAgent, and Claude Code paths.
• Provide setup and launch scripts, e.g. setup-deepseek-harness.sh and run-deepseek-harness.sh.
• Map ClawBench tasks into the dsh session/task interface.
• Capture the standard ClawBench trace bundle:
  • recording.mp4
  • actions.jsonl
  • agent-messages.jsonl
  • requests.jsonl
  • interception.json
  • run-meta.json
• Record the dsh package version or Git commit, plugin set, model configuration, corpus revision, and ClawBench commit in run-meta.json.
• Preserve ClawBench’s existing timeout, interception, judge, retry, and failure-taxonomy semantics.

2. Reproducibility smoke test

Run a small preregistered subset before the full evaluation:

• 5–10 tasks spanning multiple sites and metaclasses
• One inexpensive supported model/configuration
• Fixed task IDs, corpus commit, dsh revision, judge, limits, and seeds where applicable

Verify that:

• dsh completes tasks end-to-end under ClawBench;
• every attempted task produces a complete or explicitly failed trace bundle;
• failures are attributed to the agent, harness/adapter, site, model/API, or grader infrastructure;
• saved artifacts can be rescored without rerunning the agent.

3. Benchmark run

After the smoke test passes:

• Run the full ClawBench V2 corpus with DeepSeek Harness.
• If budget permits, also run V1 for historical comparability.
• Evaluate at least one model already tested under another harness, allowing the comparison to isolate harness effects.
• Match the model endpoint, task snapshot, judge, per-task limits, retry policy, and evaluation window.
• Run multiple trials, or clearly label the result as single-trial; do not silently mix protocols.

Track at minimum:

• Reward / task success rate
• Stage-1 interception rate
• Stage-2 judged success rate
• Attempted, completed, and infrastructure-failed task counts
• Cost, tokens, and wall-clock time
• Per-task result and failure category

4. Publish results

• Store raw and derived artifacts using the existing eval-results/ conventions.
• Add the DeepSeek Harness result rows to the leaderboard.
• Document the exact reproduction commands and environment.
• Publish a matched-model cross-harness comparison, including confidence intervals or trial variance when available.
• Clearly disclose that dsh is in developer preview and identify the exact evaluated revision.

Suggested CLI

# Smoke test
clawbench run \
  --corpus v2 \
  --harness deepseek-harness \
  --model <matched-model> \
  --tasks <smoke-test-ids>

# Full benchmark
clawbench run \
  --corpus v2 \
  --harness deepseek-harness \
  --model <matched-model>