Skill公開の投稿言語モデルの推論を最適化
投稿の要約 · 英語
A skill for tuning self-hosted LLM inference around the model, hardware, API requirements, and serving workload, including parallelism, KV tiers, and prefill/decode separation.
Abhi
@abhiram_ai_guy
I like to Gym, play chess and eat Chicken.