| name | cohere-cost-tuning |
| description | Optimize Cohere costs through model selection, token budgets, and usage monitoring.
Use when analyzing Cohere billing, reducing API costs,
or implementing usage monitoring and budget alerts.
Trigger with phrases like "cohere cost", "cohere billing",
"reduce cohere costs", "cohere pricing", "cohere expensive", "cohere budget".
|
| allowed-tools | Read, Grep |
| version | 1.5.0 |
| license | MIT |
| author | Jeremy Longshore <jeremy@intentsolutions.io> |
| tags | ["saas","ai","nlp","cohere"] |
| compatibility | Designed for Claude Code |
Cohere Cost Tuning
Overview
Optimize Cohere costs through model selection, token budgets, embedding compression, and usage monitoring. Cohere pricing is token-based with separate input/output rates.
Prerequisites
Cohere Pricing Model
Key principle: Cohere charges per token. Input tokens and output tokens have different rates. Embed, Rerank, and Classify have separate pricing based on search units.
| Tier | Access | Rate Limits | Cost |
|---|
| Trial | Free | 5-20 calls/min, 1000/month | $0 |
| Production | Metered | 1000 calls/min, unlimited | Per-token |
Model Cost Comparison
| Model | Input (per 1M tokens) | Output (per 1M tokens) | Best For |
|---|
command-r7b-12-2024 | Lowest | Lowest | High-volume, simple tasks |
command-r-08-2024 | Low | Low | RAG, cost-effective |
command-r-plus-08-2024 | Medium | Medium | Complex reasoning |
command-a-03-2025 | Higher | Higher | Best quality |
Non-Chat Pricing
| Endpoint | Pricing Unit | Notes |
|---|
| Embed | Per input token | Batch 96 texts to minimize calls |
| Rerank | Per search unit | 1 query + N docs = 1 search unit |
| Classify | Per classification | Charges per input classified |
Instructions
Strategy 1: Model Tiering
type CostTier = 'economy' | | ;
(): {
(tier) {
: ;
: ;
: ;
}
}
(): {
([, , ].(task)) {
();
}
([, , ].(task)) {
();
}
();
}