Skip to main content

omni-cache

Manage the LLM response cache. View cache statistics, clear entries, configure TTL policies, and control semantic-similarity caching thresholds.

Informações da origem

Repositório
cheaper-inference/OmniRoute
Última atividade na origem
14 de outubro de 2026 às 16:08
Idioma detectado do SKILL.md
inglês
Estrelas
82.330
Forks
12.154

Opções de instalação

Por padrão, está selecionado o prompt que primeiro revisa a origem. Você pode mudar para um comando direto ou baixar uma cópia local.

Revise os arquivos de origem

Leia o SKILL.md e os arquivos complementares exibidos pelo SkillsMP antes de decidir se vai instalar.

Exibindo SKILL.md

SKILL.md
Instruções da origem · Visualização somente leitura
name
omni-cache
description
Manage the LLM response cache. View cache statistics, clear entries, configure TTL policies, and control semantic-similarity caching thresholds.
<!-- generated by src/lib/agentSkills/generator.ts; manual edits will be overwritten --> ## Overview Manage the LLM response cache. View cache statistics, clear entries, configure TTL policies, and control semantic-similarity caching thresholds. ## Authentication All requests require a valid Bearer token or session cookie. Obtain a token via `POST /api/auth/login` or configure `REQUIRE_API_KEY=false` for local development. ## Endpoints ### GET /api/cache Get cache statistics ```bash curl http://localhost:20128/api/cache \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### DELETE /api/cache Clear all caches ```bash curl -X DELETE http://localhost:20128/api/cache \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### GET /api/cache/stats Get detailed cache statistics Returns detailed statistics for all cache layers. ```bash curl http://localhost:20128/api/cache/stats \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### DELETE /api/cache/stats Clear cache statistics ```bash curl -X DELETE http://localhost:20128/api/cache/stats \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### GET /api/cache/entries GET cache › entries ```bash curl http://localhost:20128/api/cache/entries \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### DELETE /api/cache/entries DELETE cache › entries ```bash curl -X DELETE http://localhost:20128/api/cache/entries \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### GET /api/cache/reasoning GET cache › reasoning ```bash curl http://localhost:20128/api/cache/reasoning \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### DELETE /api/cache/reasoning DELETE cache › reasoning ```bash curl -X DELETE http://localhost:20128/api/cache/reasoning \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ## Payloads See the full OpenAPI specification at `GET /api/openapi/spec` or `docs/openapi.yaml` for detailed request/response schemas.
Ver no GitHub