FutureMLS-Lab/OSCAR

add-jit-kernel

Step-by-step tutorial for adding a new lightweight JIT CUDA kernel to sglang's jit_kernel module

Langue du texte source : anglais

add-sgl-kernel

Step-by-step tutorial for adding a heavyweight AOT CUDA/C++ kernel to sgl-kernel (including tests & benchmarks)

Langue du texte source : anglais

ci-workflow-guide

Guide to SGLang CI workflow orchestration — stage ordering, fast-fail, gating, partitioning, execution modes, and debugging CI failures. Use when modifying CI workflows, adding stages, debugging CI pipeline issues, or understanding how tests are dispatched…

Langue du texte source : anglais

generate-profile

Generate an e2e profiling trace of an SGLang server run. Launches a server, validates accuracy, captures a Chrome-compatible trace, and returns the profile path.

Langue du texte source : anglais

sglang-auto-benchmark

Run SGLang auto benchmark searches with tiered server-flag sweeps, canonical dataset preparation, ShareGPT auto-download, custom-data conversion/validation, SLA or fixed-QPS benchmarking, CSV export, and optional second-stage speculative/EAGLE tuning. Use…

Langue du texte source : anglais

sglang-torch-profiler-analysis

Compact SGLang torch-profiler triage skill. Use when Codex should inspect an existing `trace.json(.gz)` or profile directory, trigger `sglang.profiler` against a live server, and return one compact report with kernel, overlap-opportunity, and fuse-pattern…

Langue du texte source : anglais

write-sglang-test

Guide for writing SGLang CI/UT tests. Covers CustomTestCase, CI registration, server fixtures, model selection, mock testing, and test placement. Always read test/README.md for the full CI layout, how to run tests, and extra tips. Use when creating new tests,…

Langue du texte source : anglais

sglang-diffusion-add-model

Use when adding a new diffusion model or Diffusers pipeline to SGLang.

Langue du texte source : anglais

sglang-diffusion-ako4all-kernel

Use when optimizing an existing SGLang diffusion kernel with AKO4ALL, including AKO4ALL repo hygiene, custom microbench setup, ncu-guided iteration, and end-to-end denoise validation. Also use when a sibling AKO4ALL repo must be cloned or refreshed before…

Langue du texte source : anglais

sglang-diffusion-benchmark-profile

Use when benchmarking denoise latency or profiling a diffusion bottleneck in SGLang.

Langue du texte source : anglais

sglang-diffusion-performance

Use when choosing the fastest SGLang Diffusion flags for a model, GPU, and VRAM budget.

Langue du texte source : anglais