Cargando el README del repositorio…
A skill for tuning self-hosted LLM inference around the model, hardware, API requirements, and serving workload, including parallelism, KV tiers, and prefill/decode separation.
Mostrando 1 de 1 skills recopiladas.
Plan, deploy, benchmark, and tune self-hosted open-weight LLM inference on one machine or Kubernetes GPU clusters, including quantization, full-context capacity, OpenAI or Anthropic APIs, cache-aware routing, and prefill/decode disaggregation.
Idioma del texto original: inglés
Copia este prompt en el asistente de IA que estés usando.
Follow https://skillsmp.com/skill-install/prompt.md to install Agent Skills from https://github.com/abhiram1809/inference-god-mode.No se ha podido cargar el README. Puedes seguir explorando los Skills del repositorio a continuación.