ROCm

Given a TheRock nightly build (URL or run-id), return the rocm-systems pin_sha used in that build

Check whether a given rocm-systems commit is included in a specific TheRock nightly build

Find the first TheRock nightly build that includes a given rocm-systems commit

Reviews Pull Requests or local diffs with an 8-agent fan-out covering static analysis, dead code, code smells + quality (naming, complexity, single-responsibility, magic numbers), language rules (C++/Python/CMake), architecture, simplification, performance…

Walk through a PR review interactively, one finding at a time. Generate review via pr-review, then for each issue present analysis + proposed inline comment, let user accept/edit/skip, accumulate into a PENDING GitHub review, submit at end.

Use when user wants to list, analyze, review, or summarize GitHub PR comments on a pull request number or URL

Use when architectural decisions involve competing quality attributes (performance vs modifiability, availability vs consistency, security vs usability), when the user says "tradeoff analysis", "ATAM", "quality attributes", "what are we giving up", or when a…

Use when moving computation from runtime to compile time — precomputed lookup tables, compile-time constants, type-based template dispatch, or zero-cost conditional branching with if constexpr; use when a function or value could be evaluated before the binary…

Check and generate changelog entries for amd-smi. Use when: reviewing PRs for changelog updates, generating release notes, checking CHANGELOG.md compliance.

Use when writing or restructuring git commits or opening/updating a pull request for amd-smi — composing commit titles, commit message bodies, PR titles, or PR descriptions. Defines the Conventional Commits `type(amdsmi):` house title convention, the…

Diagnoses why a compute kernel on an AMD GPU is slow, instruction by instruction, with Advanced Thread Trace (rocprofv3 --att) and the rocprof-trace-decoder Python API. Use when a kernel runs below its expected throughput and you need the instructions and…

Replays an HRR capture archive (a `.hrr` directory from HIP Record and Replay, or one of its `pid-*` process directories) on an AMD GPU and reports what failed: outcome, fault class, faulting kernel, fault address and failing event, without the original…

Records a failing HIP or ROCm GPU workload into an HRR archive that can be replayed and debugged later, and checks that archive is readable before anyone is asked to send it. Use when an AMD GPU workload crashes, hangs, aborts with a memory access fault, or…

Profiles an AMD GPU application with rocprof-compute and finds which kernel is slow and why, using performance metrics and PC sampling. Collects counters and selects kernels and dispatches, then analyzes GPU memory throughput, compute efficiency, wavefront…

Analyzes the AMD GPU memory hierarchy with rocprof-compute, covering the Memory Chart, vL1D and L2 caches, LDS bank conflicts, Infinity Fabric traffic, and the experimental gfx950 memory bandwidth analysis. Use when the user asks about memory bandwidth, cache…

Collects and analyzes rocprof-compute PC sampling to show which individual instructions in an AMD GPU kernel are hot and why wavefronts stall there, with ISA and source line attribution. Use when the user asks which instruction or source line is slow, asks…

Predict and analyze LDS access conflicts with an exact rocKE architecture profile and a serializable semantic result. Use when examining lane-to-LDS byte-address mappings, checking broadcasts or conflict multiplicity, comparing supported gfx profiles, or…

Render and explain MMA (MFMA/WMMA) layout visualizations at any scale — the A/B/C tee, register files, logical tiles, derived/final-C, C store distribution, and LDS view. Answers questions from "how does this distribution map a logical tile to registers?" and…

Design and author a GPU kernel with the rocKE tiling API, end-to-end. Dispatches the Tiling Kernel Architect (lead) who consults MMA/LDS/Profiling specialists and drives layout-viz / bank-conflict / build / profile. Any algorithm — the stage classes are…

Create or extend a hipDNN generic-kernel-ingestor integration: graph/kernel contracts, descriptors, native hooks, packaging, host checks, exact-engine device correctness and final corpus coverage.

Run, read, and extend hipDNN's cross-provider integration test suite (dnn-providers/integration-tests): bundles and sweeps, golden data and DVC, .support.json claim sidecars, per-engine TOML, tier YAML, CTest lanes. Doc-driven: loads all of its knowledge at…

Build hipDNN with providers via the repository superbuild. Faster than standalone since providers build alongside hipDNN in a single CMake invocation. On Windows, auto-runs the wheel-based ROCm setup if not already prepared.

Run tests against an existing hipDNN superbuild. Supports per-component selection (hipdnn, miopen-provider, hipblaslt-provider, hip-kernel-provider, integration-tests), unit/integration/external-integration scope, and gtest filtering. Reproduces the…

Run clang-tidy on hipDNN after a build, scoped to the translation units affected by changed files. Much faster than ENABLE_CLANG_TIDY=ON, which runs clang-tidy inline with every compile. Resolves changed headers to the translation units that include them. Use…

Comprehensive reference for authoring FlyDSL GPU kernels on AMD GPUs. Covers the layout algebra, tiled copy/MMA, buffer ops, loop-carried range loops, SharedAllocator (LDS), autotuning, and common patterns. Use when writing, reviewing, or understanding FlyDSL…

Clean up FlyDSL kernels and shared helpers while preserving numerical behavior and performance. Use for raw-IR migrations, helper deduplication, dead-code removal, and reviews of those changes against the checkout API.

Profile GPU kernels using rocprofv3 to collect ATT instruction-level traces, then analyze the trace data using hotspot_analyzer.py to identify top-K stall hotspots (VMEM-load, VMEM-wait, LDS/SMEM-wait, barrier, MFMA stalls) mapped back to source lines, and…

Advisory AI code review for a FlyDSL pull request. Catches silent-correctness bugs, JIT cache-key mistakes, architecture-capability holes, index-width overflow, unbounded buffer descriptors, layout-algebra errors, dead flags, and tests or benchmarks that…

Review a FlyDSL PR, commit, branch, kernel, or consuming module for API-stability compliance. Detect breaking changes to stable APIs, usage of unstable FlyDSL APIs, and direct upstream MLIR dialect operations. Use when asked to review API compatibility, a…

Review a FlyDSL release candidate against published releases for API stability violations, including export paths, signatures, result interfaces, semantics, and deprecation windows. Use for release compatibility reviews and breaking-change checks.

Comprehensive guide to optimizing GEMM (General Matrix Multiply) kernels in FlyDSL on AMD CDNA GPUs. Covers tiling strategy, LDS ping-pong double-buffer, XOR bank-conflict swizzle, A/B data prefetch pipeline, 2-stage software pipelining, MFMA instruction…

Detect per-kernel GPU resource regressions (VGPR, SGPR, register spills, scratch, static LDS) by diffing the final ISA before and after a change, using its `isa_resource_table.py` helper. Compile-only: needs no GPU and no profiler run, so it works on any…

Comprehensive reference for authoring FlyDSL GPU kernels on AMD GPUs. Covers the layout algebra, tiled copy/MMA, buffer ops, loop-carried range loops, SharedAllocator (LDS), autotuning, and common patterns. Use when writing, reviewing, or understanding FlyDSL…

Clean up aiter FlyDSL kernels and shared helpers while preserving numerical behavior and performance. Use for raw-IR migrations, helper deduplication, dead-code removal, and reviews of those changes against the pinned FlyDSL API.

Module-level JIT build-wall optimization for opus-based aiter modules. Use when an aiter JIT module's first-call build wall is a user-visible bottleneck or when adding a new module.

Advisory AI code review for aiter and FlyDSL PRs. Catches perf regressions, silent correctness bugs, dispatch gate holes, and AI-generated code patterns, but never acts as a merge gate. Invoke with a PR number (optionally owner/repo#N) and, when one exists, a…

Reproducible validation executor for kernel PRs. Applies an explicit base-to-head patch in an isolated worktree, runs it on a verified-idle GPU, compares the same targets against base, policy-checks the test diff, and emits a head-bound…

How to add/upload tuned config CSVs under aiter/configs (incl. model_configs/) without introducing duplicate shapes, and how to find & resolve duplicate-shape collisions. Use whenever adding a model's tuned config, merging/uploading config CSVs, editing…

Standard structure for aiter op_tests under op_tests/test_*.py — @benchmark + run_perftest candidate loop, a torch reference, a final markdown summary table, a __main__ guard so the module is importable, and faithful reproduction of the real model call…

Compile-time optimization guidance for HIP/C++ kernels using opus.hpp. Use when writing or reviewing OPUS kernels, analyzing compile time, reducing template instantiation overhead, or optimizing hipcc build performance.

Coding patterns and architecture index for the ATOM LLM inference engine

Capture a PyTorch profiler / kineto trace from a running ATOM server for a short benchmark window. Use when the user asks for "a trace", "profiler trace", "GPU trace", or "抓 trace" for performance investigation — what kernels ran, what's on the critical path,…

Run any ATOM workload — accuracy eval (GSM8K via lm_eval), performance benchmark, concurrency sweep, offline simple_inference, or fault repro under rocm-debug-agent. Use when the user asks to "test accuracy", "测精度", "跑 GSM8K", "跑 benchmark", "test…

AI code review for ATOM PRs. ATOM consumes aiter kernels and integrates with vLLM/SGLang plugins. Reviews check perf claims, aiter cross-repo deps, model coverage, dispatch correctness, and AI-generated code patterns. Invoke with a PR number.

Identify which GPU kernel is faulting/hanging in ATOM via rocm-debug-agent (for faults/asserts) or rocgdb (for silent livelocks). debug-agent dumps wave registers + faulting PC + (with --save-code-objects) disassembled code object on memory faults /…

Locate forward numerical bugs by dumping intermediate tensors from a target implementation and a known-good reference, then bisecting layer by layer. Also covers batch-invariance bisect (the same token at any batch position should produce a bitwise-identical…

Write GPU kernels that move data with the CCO SDMA device API (ccoSdma: put/get/quiet/waitSignal/commit). Covers the build flags and env vars needed to turn the path on, which template arguments and coop scope to pick, how completion and signals work, and the…

Add a new byte-moving path to UMBP's distributed mode as a TransferEngine (GPU copy, a second RDMA transport, a file/GDS engine, a fake for tests). Covers CanHandle pair-dispatch and why engines must be disjoint, the plan-builder/Submit/Wait split, bounce…

Deploy and set up the MORI environment in a fresh Docker container or bare host: start the container, install ROCm dependencies, NIC userspace libraries (AINIC/Broadcom/Mellanox-NVIDIA), RDMA-core, and MORI itself. Use when the user asks to deploy MORI,…

Discover, diagram, and diagnose the RDMA/GPU network topology of a GPU cluster (rails, NICs, GID/RoCE config, GPU<->NIC PCIe affinity), determine whether the fabric supports cross-rail communication, and localize a failure to a fabric tier (NIC / leaf /…

Known environment issues that make MORI slow or behave oddly without being MORI bugs — currently: HIP VMM peer traffic silently falling off XGMI onto PCIe/host memory on Linux kernels built without CONFIG_DMABUF_MOVE_NOTIFY / CONFIG_PCI_P2PDMA, which hits…

Add a new storage medium to UMBP's distributed mode as a MediumBackend (HBM, SSD, CXL, a remote object store, a fake for tests). Covers the two shapes a backend can take — a PageMemorySource for anything page-addressable, or a full MediumBackend for a medium…

Build and run the HIP/Verbs Acceptance Suite and report the verdict. Use when the user asks to run acceptance tests, run the HIP or Verbs tests, gate a machine, smoke-test the harness, or bring the suite up on new hardware.

Tell me which HIP acceptance tests are missing and need to be added. Analyzes a source tree (RCCL/NCCL/rocSHMEM/NIXL/Mooncake) for how it uses the HIP/CUDA/HSA APIs, compares against an embedded knowledge base of required acceptance scenarios AND against the…

Tell me which Verbs (libibverbs / rdma-cm / mlx5dv) acceptance tests are missing and need to be added. Analyzes a source tree (RCCL/NCCL/NIXL/etc.) for how it uses the RDMA verbs API, compares against an embedded knowledge base of required acceptance…

Scaffold a new HIP or Verbs test in the HIP/Verbs Acceptance Suite and wire it into the policies. Use when the user asks to add an acceptance test, add a HIP/Verbs test, cover a new primitive, or extend the suite.

Summarize a HIP/Verbs Acceptance Suite report.json — overall verdict, per-category breakdown, and the gate failures with their reason/ticket. Use when the user asks to explain acceptance results, summarize a run, or see why the gate failed.

Build and check a rocm-ernic C change before finishing it: the GCC and Clang warning builds, clang-tidy, the clang 23 thread-safety build, include-what-you-use, and line coverage of src/. Use after editing C in src/ or tests/, when changing #includes or…

Run rocm-ernic's non-C checks: ShellCheck, actionlint, and the embedded-shell checker; cmakelint; black, pylint, and vermin for Python; codespell; doc8 and the Sphinx docs build; and ansible-lint and ansible-test sanity. Use after editing shell scripts,…

Build and run rocm-ernic's tests under AddressSanitizer (with LSan and UBSan) or ThreadSanitizer, and loop threaded tests to shake out races. Use for a change to pointers, buffers, lengths, or input from outside the process (ASan), or to shared state, locks,…

Run rocm-ernic's unit tests and server tests under valgrind memcheck to find uninitialized reads, including uninitialized bytes sent with send() or write(). Use for a change to wire data or to anything passed to send()/write(), or when CI's GCC Debug valgrind…

Step-by-step checklist for bumping the pinned ONNX dependency / opset in ONNX Runtime (e.g. ONNX 1.21 / opset 26 → 1.22 / opset 27). Use when integrating a new ONNX release or release-candidate, updating the cmake/deps.txt onnx pin or the cmake/external/onnx…

Trigger, re-run, and unblock ONNX Runtime CI checks on a GitHub pull request. Use this skill when a required check is stuck, missing, failed, or needs re-running. Nearly all ORT CI runs as GitHub Actions workflows; only the "Linux Android Emulator QNN CI…

Build and run ONNX Runtime WebGPU provider tests on Linux WITHOUT a real GPU, using a software Vulkan adapter (Mesa lavapipe). Use when you need to exercise WebGPU EP kernels off-Mac — the Linux webgpu CI leg is build-only, so software Vulkan is how you…

Build ONNX Runtime from source. Use this skill when asked to build, compile, or generate CMake files for ONNX Runtime.

Force a fuzz-fill coverage-gap analysis on one specific llvm/llvm-project PR, regardless of whether it's been reviewed before. Use when asked to "check PR <N> for gaps", "run gap analysis on this PR", or similar for a single named PR.

Scan recent llvm/llvm-project PRs labeled for clang frontend, codegen, driver, analysis, static analyzer, bytecode, dataflow, or modules for fuzz-fill coverage gaps, keeping the largest non-test clang/lib diffs in a shared quota, and draft local review files…

Scan recent llvm/llvm-project PRs labeled llvm:ir, llvm:analysis, or llvm:transforms for fuzz-fill coverage gaps, keeping the largest non-test lib diffs in a shared quota, and draft local review files for PRs with real uncovered lines. Use when asked to "scan…

Scan recent llvm/llvm-project PRs touching the AMDGPU/SPIRV backends for fuzz-fill coverage gaps, and draft review comments for the ones that have real uncovered lines. Use when asked to "scan PRs for gaps", "run the PR gap scan", or similar.

Review PyTorch pull requests for code quality, test coverage, security, and backward compatibility. Use when reviewing PRs, when asked to review code changes, or when the user mentions "review PR", "code review", or "check this PR".

Query PyTorch CI, GitHub Actions, HUD, Grafana, and infrastructure metrics. Use when users ask about CI duration, job failures, queue times, workflow trends, runner health, dashboard data, or PyTorch infrastructure metrics.

Sub-triages issues in the oncall:distributed queue by assigning distributed module labels, routing to sub-oncalls, and marking triaged. Use when an issue has been routed to oncall:distributed and needs second-level triage.