Skip to content

Commit 5da6597

Browse files
committed
docs(readme): add token optimization before/after screenshots showing 99.87% reduction
1 parent 9e16f9c commit 5da6597

3 files changed

Lines changed: 18 additions & 0 deletions

File tree

README.md

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -75,6 +75,24 @@
7575

7676
![Settings](screenshots/Providers.png)
7777

78+
### Token Optimization — Before & After
79+
80+
Prompt caching with Anthropic-format routing reduces token usage by **99.87%** on repeated requests.
81+
82+
| | Before | After |
83+
|---|---|---|
84+
| **Total Tokens** | 19,819 | 26 |
85+
| **Prompt Tokens** | 19,779 | 0 (cache hit) |
86+
| **Completion Tokens** | 40 | 26 |
87+
88+
**Before** — Every request sends the full system prompt (~19K prompt tokens):
89+
90+
![Before Optimization](screenshots/before.png)
91+
92+
**After** — Prompt caching enabled via Anthropic Messages API format (0 prompt tokens on cache hit):
93+
94+
![After Optimization](screenshots/after.png)
95+
7896
---
7997

8098
## 🚀 Installation

screenshots/after.png

103 KB
Loading

screenshots/before.png

130 KB
Loading

0 commit comments

Comments
 (0)