NVIDIA/srt-slurm

Letzte erfasste Quellaktivität: 6. Oktober 2026 um 21:04

SkillsMP-Katalog aktualisiert: 5. November 2026 um 19:57

gesammelte Skills: 7

GitHub-Stars: 95
GitHub-Forks: 109

Mit einem KI-Assistenten installieren

Diesen Prompt kopieren und in den verwendeten KI-Assistenten einfügen.

Follow https://skillsmp.com/skill-install/prompt.md to install Agent Skills from https://github.com/NVIDIA/srt-slurm.

README des Repositorys

README-Quelldatei: README.md

README-Quelldatei lesen

Vollständige README anzeigen

# srtctl Command-line tool for distributed LLM inference benchmarks on SLURM clusters using SGLang, vLLM, TensorRT LLM, TileRT, TokenSpeed and AMD's ATOM. Replace complex shell scripts and 50+ CLI flags with a declarative `schema: 2` YAML recipe: `engine:` names the engine, `roles:` describes each worker role, and `services:` covers everything launched next to the workers. **Documentation:** https://nvidia.github.io/srt-slurm/ (source in [docs/](docs/README.md); agents: [llms.txt](https://nvidia.github.io/srt-slurm/llms.txt)) ## Quick Start ```bash git clone https://github.com/NVIDIA/srt-slurm.git cd srt-slurm uv sync --no-dev # One-time setup: downloads etcd, NATS, uv and the tachometer binaries for the # compute nodes' architecture and writes srtslurm.yaml (account, partition, GPUs per node) make setup ARCH=aarch64 # or ARCH=x86_64 uv run srtctl dry-run -f examples/sglang/dynamo-agg.yaml # render without submitting uv run srtctl apply -f examples/sglang/dynamo-agg.yaml # submit ``` [Installation](docs/installation.md) covers cluster-specific setup; [examples/](examples/README.md) has runnable recipes, one per frontend and topology. ## Let an agent drive it srtctl ships a skill that teaches Claude Code, Codex or Cursor how to set up a checkout, write `srtslurm.yaml`, author and validate recipes, submit them, and read the results. Install it into the checkout and hand the agent the checkout: ```bash uv run srtctl skill --target claude # .claude/skills/srtctl/SKILL.md uv run srtctl skill --target codex # .codex/skills/srtctl/SKILL.md uv run srtctl skill --target cursor # .cursor/rules/srtctl.mdc ``` The `srtctl-mcp` server, the recipe JSON Schema for editors, and `llms.txt` are described in the [documentation home](docs/README.md#for-agents-and-editors). ## Where things are documented - Write a recipe: [Recipe Guide](docs/config-reference.md), then the topic pages it links (engines, topology, frontends, benchmarks, services, ...) - Every field, type, default and allowed value: [Schema Reference](docs/schema-reference.md) (generated from the code) - Every command and flag: [CLI Guide](docs/cli.md) and [CLI Reference](docs/cli-reference.md) (generated) - Run and debug: [Monitoring](docs/monitoring.md), [SLURM FAQ](docs/slurm-faq.md) - Analyze: [Profiling](docs/profiling.md), [DSight](docs/dsight.md) - Old recipes: [Legacy (v1) layout](docs/legacy-v1.md); `srtctl migrate` rewrites them

README des Repositorys wird geladen…

Skills in diesem Repository

Klassifizierung ausstehend

Skill

Beruf

Beschreibung

Aktualisiert

srtctl

nicht klassifiziert

Run srt-slurm (srtctl) inference benchmarks on a Slurm cluster. Use when setting up a checkout, writing or migrating a recipe, submitting a job, or reading its results.

Quellsprache: Englisch

2026-10-06

perf-goal-writer

nicht klassifiziert

Write or refine a ready-to-use /goal prompt for a performance benchmark, regression investigation or optimization campaign. Define measurable targets, a matched baseline, change boundaries, diagnostic evidence and completion criteria. Use for drafting the…

Quellsprache: Englisch

2026-10-03

add-config-field

nicht klassifiziert

Add, rename, or re-type a recipe or srtslurm.yaml field in srt-slurm so that it ships complete (schema, resolver, dry-run, docs, example, tests).

Quellsprache: Englisch

2026-10-03

dsight-query

nicht klassifiziert

Analyze existing DSight reports through the read-only SQLite-backed CLI, Python or MCP query interface. Use when inspecting request latency, lifecycle, metrics, Nsight ranges or CPU samples, comparing runs, or gathering evidence for a dashboard view.

Quellsprache: Englisch

2026-10-03

slurm-job-sizing

nicht klassifiziert

Size Slurm allocations, warmup and traffic for short debugging jobs or full srt-slurm benchmarks.

Quellsprache: Englisch

2026-10-02

design-rule-sweep

nicht klassifiziert

Periodic cleanup of srt-slurm drift - shrink the Design Rule baselines, fix stale agent docs, and open small focused PRs.

Quellsprache: Englisch

2026-09-29

validate-without-cluster

nicht klassifiziert

Verify an srt-slurm change end to end without SLURM or GPUs, using dry-run, the mock orchestrator, and the launch snapshots.

Quellsprache: Englisch

2026-09-29

Es werden 7 von 7 gesammelten Skills angezeigt.