菜单
Build edge-fm for Jetson Orin inside a mounted Docker workspace using `nvcr.io/nvidia/l4t-jetpack:r36.4.0`. Use when Codex needs to validate Orin compilation, reproduce a JetPack 6.1 build environment, or produce a repeatable Docker-based Orin build command without relying on Thor.
用 Codex 或 Claude 帮你安装 复制这段 Prompt，粘贴到 Codex、Claude 或其他助手里，让它检查 Skill 页面并帮你完成安装。
基于 SOC 职业分类
NCU-guided CUDA/CUTLASS kernel optimization workflow for edge-fm-x, including short standalone/repo-in-place tuning and long Humanize + KernelPilot loops. Use when optimizing kernels under src/, tuning standalone CUDA/CUTLASS reproductions, or when the user asks to speed up an Edge-FM CUDA kernel and mentions Nsight Compute, Nsight Systems, NCU, benchmark plateaus, Humanize, KernelPilot, long-running kernel search, source provenance, ledgers, CUTLASS, latency regressions, or iterative optimization.
Query NVIDIA PTX ISA 9.1, CUDA Runtime API 13.1, Driver API 13.1, Programming Guide v13.1, Best Practices Guide, Nsight Compute, Nsight Systems local documentation. Debug and optimize GPU kernels with nsys/ncu/compute-sanitizer workflows. Includes hardware quick guides for T4, A100, H100, A800, RTX 3060, and Jetson Orin. Use when writing, debugging, or optimizing CUDA code, GPU kernels, PTX instructions, inline PTX, TensorCore operations (WMMA, WGMMA, TMA, tcgen05), or when the user mentions CUDA API functions, error codes, device properties, memory management, profiling, GPU performance, compute capabilities, CUDA Graphs, Cooperative Groups, Unified Memory, dynamic parallelism, or CUDA programming model concepts.
Develop, debug, and optimize CUTLASS C++, CuTe C++, and CuTe DSL kernels using the local third_party/cutlass repository in this workspace. Use when the user mentions CUTLASS, CuTe, CuTe DSL, cute::Layout, cute::Tensor, TiledMMA, TiledCopy, CollectiveBuilder, CollectiveMainloop, CollectiveEpilogue, GEMM kernel, grouped GEMM, sparse GEMM, FMHA, StreamK, warp specialization, TMA, WGMMA, tcgen05, blockscaled GEMM, or asks about writing or understanding high-performance CUDA kernels with CUTLASS/CuTe.
Generate detailed benchmark reports inside this edge-fm repo, covering configurable Qwen2.5 LLM/VLM model matrices on CUDA. The default fair comparison remains Transformers vs EdgeFM(cuda-graph) vs TRT-Edge-LLM for LLM, while VLM currently uses Transformers vs EdgeFM(cuda-graph). Use when the user asks for benchmark指标、性能对比、详细报告、cuda-graph vs TRT-Edge-LLM analysis, VLM benchmark reports, or wants the existing tests/engine/test_qwen2_generate.py benchmark flow wrapped into a repeatable local workflow.
Run an end-to-end Humanize Kernel Agent Loop for GPU kernel optimization: plan, refine, create a clean standalone repo, use kernel-knowledge, benchmark, profile with Nsight Compute, maintain lineage/ledgers, and start RLCR.
Use when optimizing GPU kernels with Humanize or Codex and the agent should consult the local kernel knowledge pack before planning, choosing optimization directions, or doing plateau research. Covers code-first framework/topic lookup, source provenance, baseline-derived candidates, and user-directed kernel stacks.
| name | edge-fm-orin-docker-build |
| description | Build edge-fm for Jetson Orin inside a mounted Docker workspace using `nvcr.io/nvidia/l4t-jetpack:r36.4.0`. Use when Codex needs to validate Orin compilation, reproduce a JetPack 6.1 build environment, or produce a repeatable Docker-based Orin build command without relying on Thor. |
这个 skill 只用于 Orin，不要把 thor 当成替代平台。默认平台固定为 -DPLATFORM=orin，镜像固定为 nvcr.io/nvidia/l4t-jetpack:r36.4.0。
docker pull nvcr.io/nvidia/l4t-jetpack:r36.4.0
export EDGE_FM_BUILD_JOBS="${EDGE_FM_BUILD_JOBS:-1}"
docker run --rm --platform linux/arm64 \
-v "$PWD":/workspace/edge-fm \
-w /workspace/edge-fm \
nvcr.io/nvidia/l4t-jetpack:r36.4.0 \
bash -lc 'apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y cmake ninja-build && cmake -S . -B build-orin -G Ninja -DPLATFORM=orin -DCMAKE_BUILD_TYPE=Release && cmake --build build-orin --parallel "${EDGE_FM_BUILD_JOBS}"'
export EDGE_FM_BUILD_JOBS="${EDGE_FM_BUILD_JOBS:-1}"
docker run --rm --platform linux/arm64 \
-v "$PWD":/workspace/edge-fm \
-w /workspace/edge-fm \
nvcr.io/nvidia/l4t-jetpack:r36.4.0 \
bash -lc 'apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y cmake ninja-build && cmake -S . -B build-orin -G Ninja -DPLATFORM=orin -DCMAKE_BUILD_TYPE=Release && cmake --build build-orin --parallel "${EDGE_FM_BUILD_JOBS}" && cmake --install build-orin'
COPY 进镜像。orin，不要改成 thor，也不要用 thor 的编译选项代替 orin。-DPLATFORM=orin。build-orin/，避免污染通用 build/。cmake 和 ninja-build。EDGE_FM_BUILD_JOBS=1 起步；Jetson/JetPack 容器内某些 CUDA 模板单元内存开销很大，先保证稳定通过，再按机器内存上调。/usr/local/cuda/targets/aarch64-linux/include/usr/lib/aarch64-linux-gnu/usr/include/aarch64-linux-gnucmake -S . -B build-orin -DPLATFORM=orin 是否通过。cmake --build build-orin --parallel 是否完成。build-orin/install/ 下出现 lib/ 与 python/。