Skip to main content

sgl-project/sglang-jax

SkillsMP 已收集 sgl-project/sglang-jax 中的 3 个 Skill。打开任一 Skill 可查看来源和详情。

最近记录的来源活动
SkillsMP 收录数据更新
已收集 skills
3
GitHub 星标
348
GitHub Forks
139

这个仓库中的 skills

2 个职业分类 · 已分类 100%

已展示 3 / 3 个已收集 Skill。

职业分类
软件开发工程师
描述

Use when you need to CAPTURE / PRODUCE XProf (jax.profiler) profiling artifacts from sgl-jax (SGLang on JAX/TPU) for later performance analysis: driving a live server (/start_profile, stage-separated prefill/decode), offline bench_one_batch --profile, or…

原文语言:英语

更新
职业分类
数据科学家
描述

Use when evaluating a newly adapted model's accuracy/eval score. Runs evalscope eval (or the test/srt/run_eval.py fallback) against an OpenAI-compatible endpoint on datasets like gsm8k / aime, producing per-dataset reports and a score. Accuracy only —…

原文语言:英语

更新
职业分类
数据科学家
描述

Use when running throughput/latency (serving speed) benchmarks against an already-running model server. Uses sgl_jax.bench_serving to sweep batch-size/concurrency and measure throughput and latency, producing summary.csv and per-point bs_<N>/result.jsonl.…

原文语言:英语

更新
已展示 3 / 3 个已收集 Skill。