Step-by-step tutorial for adding a new lightweight JIT CUDA kernel to sglang's jit_kernel module
Idioma del texto original: inglés
Menú
SkillsMP ha recopilado 11 skills de FutureMLS-Lab/OSCAR. Abre una skill para revisar su origen y sus detalles.
Mostrando 11 de 11 skills recopiladas.
Step-by-step tutorial for adding a new lightweight JIT CUDA kernel to sglang's jit_kernel module
Idioma del texto original: inglés
Step-by-step tutorial for adding a heavyweight AOT CUDA/C++ kernel to sgl-kernel (including tests & benchmarks)
Idioma del texto original: inglés
Guide to SGLang CI workflow orchestration — stage ordering, fast-fail, gating, partitioning, execution modes, and debugging CI failures. Use when modifying CI workflows, adding stages, debugging CI pipeline issues, or understanding how tests are dispatched…
Idioma del texto original: inglés
Generate an e2e profiling trace of an SGLang server run. Launches a server, validates accuracy, captures a Chrome-compatible trace, and returns the profile path.
Idioma del texto original: inglés
Run SGLang auto benchmark searches with tiered server-flag sweeps, canonical dataset preparation, ShareGPT auto-download, custom-data conversion/validation, SLA or fixed-QPS benchmarking, CSV export, and optional second-stage speculative/EAGLE tuning. Use…
Idioma del texto original: inglés
Compact SGLang torch-profiler triage skill. Use when Codex should inspect an existing `trace.json(.gz)` or profile directory, trigger `sglang.profiler` against a live server, and return one compact report with kernel, overlap-opportunity, and fuse-pattern…
Idioma del texto original: inglés
Guide for writing SGLang CI/UT tests. Covers CustomTestCase, CI registration, server fixtures, model selection, mock testing, and test placement. Always read test/README.md for the full CI layout, how to run tests, and extra tips. Use when creating new tests,…
Idioma del texto original: inglés
Use when adding a new diffusion model or Diffusers pipeline to SGLang.
Idioma del texto original: inglés
Use when optimizing an existing SGLang diffusion kernel with AKO4ALL, including AKO4ALL repo hygiene, custom microbench setup, ncu-guided iteration, and end-to-end denoise validation. Also use when a sibling AKO4ALL repo must be cloned or refreshed before…
Idioma del texto original: inglés
Use when benchmarking denoise latency or profiling a diffusion bottleneck in SGLang.
Idioma del texto original: inglés
Use when choosing the fastest SGLang Diffusion flags for a model, GPU, and VRAM budget.
Idioma del texto original: inglés