Start with costs by feature
Break down AI spending by feature and check whether it leads to results. ABTO records the model, token usage, cost, and response time for each call.
The same call volume can cost up to 100x more depending on the model
At 100,000 calls a month, the cheapest model in the table below (Claude Haiku 5.5) costs $25 and the most expensive (GPT-6 Astra) costs $2,500.
Unless you check that the pricier model earns back the difference in outcomes, that difference is simply cost.
| Model | Input | Output | 100K calls a month |
|---|---|---|---|
| GPT-6 Astra | $10 | $50 | $2,500 |
| Claude Fable 5.1 | $10 | $50 | $2,500 |
| Claude Opus 5.5 | $4 | $20 | $1,000 |
| Kimi K3 | $3 | $15 | $750 |
| GPT-6.1 Sol | $2 | $10 | $500 |
| Claude Sonnet 5.5 | $2 | $10 | $500 |
| Kimi K2.6 | $0.95 | $4 | $215 |
| Gemini 3.8 FlashAfter 2026-12-31, $1.5 / $7.5 | $0.75 | $3.75 | $188 |
| Gemini 3.5 Flash-Lite | $0.3 | $2.5 | $105 |
| DeepSeek Flash | $0.3 | $1.2 | $66 |
| GPT-6 Luna | $0.1 | $0.5 | $25 |
| Claude Haiku 5.5 | $0.1 | $0.5 | $25 |
Each request is counted as 1,000 input tokens and 300 output tokens. Input and output are each provider's public price in USD per 1M tokens.
Compare all 41 modelsChoose a cheaper model when outcomes hold up
Give some users a cheaper model and check that outcomes such as purchases and conversions hold up before switching. Once it meets your criteria, gradually increase its share and reduce the existing variant to 0%.
If the existing model performs better, you have numbers to judge whether the difference is worth its cost.
Prompt tokens cost money too
Removing unnecessary parts of a prompt can lower cost per request without changing the model. After shortening it, check that your success metrics remain steady.
What we saved on services our team runs
Nonsuri, which the ABTO team runs, reduced reasoning effort and shortened explanations, cutting model costs by 41% while increasing the payment rate by 18%.
Career SSOT, also run by our team, uses different model settings for cover letter drafting and resume editing, cutting model costs by 28% while raising its return visit rate by 12%.
Find the cause of a sudden cost increase
When costs spike, narrow the investigation from a feature to a variant to an individual call.