Skip to content

feat: capture and persist per-sample cache_read tokens - #3

Merged
jshah-do merged 3 commits into
mainfrom
feat/cache-read-tokens
Oct 1, 2026
Merged

jshah-do merged 3 commits into
mainfrom
feat/cache-read-tokens

Conversation

@jshah-do

@jshah-do jshah-do commented Sep 30, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

  • Map provider cached_tokens / input_tokens_details into ModelUsage.cacheReadTokens and accumulate across turns (harbor, tau, search merge, replayed usage).
  • Persist run-level cache_read_tokens and sample-level sample_*_tokens (including sample_cache_read_tokens) in parquet so per-task cost can be computed from harness artifacts.
  • Keep reading older parquet files without the new column (cache_read_tokens defaults to 0).

Test plan

  • Smoke a short run and confirm parquet rows include cache_read_tokens / sample_cache_read_tokens when the provider reports cache hits
  • Confirm Tokens/evidence rebuild can consume the new columns once portal export lands

Map provider cached_tokens into usage, accumulate across turns/solvers, and write run- and sample-level cache_read columns in parquet so per-task cost can be computed from harness artifacts.
@jshah-do
jshah-do merged commit 1277363 into main Oct 1, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants