cohere-cost-tuning

name	cohere-cost-tuning
description	Optimize Cohere costs through model selection, token budgets, and usage monitoring. Use when analyzing Cohere billing, reducing API costs, or implementing usage monitoring and budget alerts. Trigger with phrases like "cohere cost", "cohere billing", "reduce cohere costs", "cohere pricing", "cohere expensive", "cohere budget".
allowed-tools	Read, Grep
version	1.0.0
license	MIT
author	Jeremy Longshore <[e-mail]>
tags	["saas","ai","nlp","cohere"]
compatible-with	claude-code

Cohere Cost Tuning

Overview

Optimize Cohere costs through model selection, token budgets, embedding compression, and usage monitoring. Cohere pricing is token-based with separate input/output rates.

Prerequisites

• Cohere production key (trial is free but limited)
• Access to dashboard.cohere.com billing page

Cohere Pricing Model

Key principle: Cohere charges per token. Input tokens and output tokens have different rates. Embed, Rerank, and Classify have separate pricing based on search units.

Tier	Access	Rate Limits	Cost
Trial	Free	5-20 calls/min, 1000/month	$0
Production	Metered	1000 calls/min, unlimited	Per-token

Model Cost Comparison

Model	Input (per 1M tokens)	Output (per 1M tokens)	Best For
command-r7b-12-2024	Lowest	Lowest	High-volume, simple tasks
command-r-08-2024	Low	Low	RAG, cost-effective
command-r-plus-08-2024	Medium	Medium	Complex reasoning
command-a-03-2025	Higher	Higher	Best quality

Non-Chat Pricing

Endpoint	Pricing Unit	Notes
Embed	Per input token	Batch 96 texts to minimize calls
Rerank	Per search unit	1 query + N docs = 1 search unit
Classify	Per classification	Charges per input classified

Instructions

Strategy 1: Model Tiering

type CostTier = 'economy' |  | ;

 ():  {
   (tier) {
     :   ;    
     :  ;       
     :   ;       
  }
}


 ():  {
  
   ([, , ].(task)) {
     ();
  }
  
   ([, , ].(task)) {
     ();
  }
  
   ();
}