Skip to main content

omni-cache

Manage the LLM response cache. View cache statistics, clear entries, configure TTL policies, and control semantic-similarity caching thresholds.

Datos de origen

Repositorio
cheaper-inference/OmniRoute
Última actividad en el origen
14 de octubre de 2026 a las 16:08
Idioma detectado de SKILL.md
inglés
Estrellas
82.330
Forks
12.154

Opciones de instalación

De forma predeterminada está seleccionado el prompt que primero revisa el origen. Puedes cambiar a un comando directo o descargar una copia local.

Revisa los archivos de origen

Lee SKILL.md y los archivos complementarios que muestra SkillsMP antes de decidir si quieres instalarlo.

Mostrando SKILL.md

SKILL.md
Instrucciones de origen · Vista previa de solo lectura
name
omni-cache
description
Manage the LLM response cache. View cache statistics, clear entries, configure TTL policies, and control semantic-similarity caching thresholds.
<!-- generated by src/lib/agentSkills/generator.ts; manual edits will be overwritten --> ## Overview Manage the LLM response cache. View cache statistics, clear entries, configure TTL policies, and control semantic-similarity caching thresholds. ## Authentication All requests require a valid Bearer token or session cookie. Obtain a token via `POST /api/auth/login` or configure `REQUIRE_API_KEY=false` for local development. ## Endpoints ### GET /api/cache Get cache statistics ```bash curl http://localhost:20128/api/cache \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### DELETE /api/cache Clear all caches ```bash curl -X DELETE http://localhost:20128/api/cache \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### GET /api/cache/stats Get detailed cache statistics Returns detailed statistics for all cache layers. ```bash curl http://localhost:20128/api/cache/stats \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### DELETE /api/cache/stats Clear cache statistics ```bash curl -X DELETE http://localhost:20128/api/cache/stats \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### GET /api/cache/entries GET cache › entries ```bash curl http://localhost:20128/api/cache/entries \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### DELETE /api/cache/entries DELETE cache › entries ```bash curl -X DELETE http://localhost:20128/api/cache/entries \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### GET /api/cache/reasoning GET cache › reasoning ```bash curl http://localhost:20128/api/cache/reasoning \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### DELETE /api/cache/reasoning DELETE cache › reasoning ```bash curl -X DELETE http://localhost:20128/api/cache/reasoning \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ## Payloads See the full OpenAPI specification at `GET /api/openapi/spec` or `docs/openapi.yaml` for detailed request/response schemas.
Ver en GitHub