Skip to main content

omni-cache

Manage the LLM response cache. View cache statistics, clear entries, configure TTL policies, and control semantic-similarity caching thresholds.

Quellinformationen

Repository
cheaper-inference/OmniRoute
Letzte Quellaktivität
14. Oktober 2026 um 16:08
Erkannte Sprache von SKILL.md
Englisch
Sterne
83.815
Forks
12.535

Installationsoptionen

Standardmäßig ist der Prompt ausgewählt, der zuerst die Quelle prüft. Sie können zu einem direkten Befehl wechseln oder eine lokale Kopie herunterladen.

Quelldateien prüfen

Lesen Sie SKILL.md und alle von SkillsMP angezeigten Begleitdateien, bevor Sie sich für eine Installation entscheiden.

SKILL.md wird angezeigt

SKILL.md
Quellanweisungen · Schreibgeschützte Vorschau
name
omni-cache
description
Manage the LLM response cache. View cache statistics, clear entries, configure TTL policies, and control semantic-similarity caching thresholds.
<!-- generated by src/lib/agentSkills/generator.ts; manual edits will be overwritten --> ## Overview Manage the LLM response cache. View cache statistics, clear entries, configure TTL policies, and control semantic-similarity caching thresholds. ## Authentication All requests require a valid Bearer token or session cookie. Obtain a token via `POST /api/auth/login` or configure `REQUIRE_API_KEY=false` for local development. ## Endpoints ### GET /api/cache Get cache statistics ```bash curl http://localhost:20128/api/cache \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### DELETE /api/cache Clear all caches ```bash curl -X DELETE http://localhost:20128/api/cache \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### GET /api/cache/stats Get detailed cache statistics Returns detailed statistics for all cache layers. ```bash curl http://localhost:20128/api/cache/stats \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### DELETE /api/cache/stats Clear cache statistics ```bash curl -X DELETE http://localhost:20128/api/cache/stats \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### GET /api/cache/entries GET cache › entries ```bash curl http://localhost:20128/api/cache/entries \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### DELETE /api/cache/entries DELETE cache › entries ```bash curl -X DELETE http://localhost:20128/api/cache/entries \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### GET /api/cache/reasoning GET cache › reasoning ```bash curl http://localhost:20128/api/cache/reasoning \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ### DELETE /api/cache/reasoning DELETE cache › reasoning ```bash curl -X DELETE http://localhost:20128/api/cache/reasoning \ -H "Authorization: Bearer $OMNIROUTE_TOKEN" ``` ## Payloads See the full OpenAPI specification at `GET /api/openapi/spec` or `docs/openapi.yaml` for detailed request/response schemas.
Auf GitHub ansehen