Skip to main content

omni-cache

Manage the LLM response cache. View cache statistics, clear entries, configure TTL policies, and control semantic-similarity caching thresholds.

Informations de source

Dépôt
cheaper-inference/OmniRoute
Dernière activité de la source
14 octobre 2026 à 16:08
Langue détectée de SKILL.md
anglais
Étoiles
82 330
Forks
12 154

Options d'installation

Le prompt qui vérifie d'abord la source est sélectionné par défaut. Vous pouvez passer à une commande directe ou télécharger une copie locale.

Vérifiez les fichiers source

Lisez SKILL.md et les fichiers associés affichés par SkillsMP avant de décider de l'installer.

Affichage de SKILL.md

SKILL.md
Instructions source · Aperçu en lecture seule
name
omni-cache
description
Manage the LLM response cache. View cache statistics, clear entries, configure TTL policies, and control semantic-similarity caching thresholds.
<!-- generated by src/lib/agentSkills/generator.ts; manual edits will be overwritten --> ## Overview Manage the LLM response cache. View cache statistics, clear entries, configure TTL policies, and control semantic-similarity caching thresholds. ## Authentication All requests require a valid Bearer token or session cookie. Obtain a token via `POST /api/auth/login` or configure `REQUIRE_API_KEY=false` for local development. ## Endpoints ### GET /api/cache Get cache statistics ```bash curl http://localhost:20128/api/cache \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### DELETE /api/cache Clear all caches ```bash curl -X DELETE http://localhost:20128/api/cache \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### GET /api/cache/stats Get detailed cache statistics Returns detailed statistics for all cache layers. ```bash curl http://localhost:20128/api/cache/stats \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### DELETE /api/cache/stats Clear cache statistics ```bash curl -X DELETE http://localhost:20128/api/cache/stats \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### GET /api/cache/entries GET cache › entries ```bash curl http://localhost:20128/api/cache/entries \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### DELETE /api/cache/entries DELETE cache › entries ```bash curl -X DELETE http://localhost:20128/api/cache/entries \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### GET /api/cache/reasoning GET cache › reasoning ```bash curl http://localhost:20128/api/cache/reasoning \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### DELETE /api/cache/reasoning DELETE cache › reasoning ```bash curl -X DELETE http://localhost:20128/api/cache/reasoning \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ## Payloads See the full OpenAPI specification at `GET /api/openapi/spec` or `docs/openapi.yaml` for detailed request/response schemas.
Voir sur GitHub