菜单
SkillsMP 已收集 jstzwj/ai-infra-plugins 中的 18 个 Skill。打开任一 Skill 可查看来源和详情。
已展示 18 / 18 个已收集 Skill。
Comprehensive reference documentation and skill for xFormers, Facebook Research's toolbox to accelerate research on Transformers. Use this skill whenever the user mentions xformers, memory_efficient_attention, FMHA, flash attention, SwiGLU, RMSNorm, RoPE,…
原文语言：英语
Comprehensive reference documentation and skill for bitsandbytes, the k-bit quantization library for PyTorch enabling accessible large language models. Use this skill whenever the user mentions bitsandbytes, LLM.int8(), QLoRA, 4-bit quantization, 8-bit…
原文语言：英语
NVIDIA Megatron-LM & Megatron Core - GPU-optimized framework for training large language models with tensor parallelism, pipeline parallelism, data parallelism (DDP/FSDP), context parallelism, expert parallelism, FP8/FP4 quantization, CUDA graphs, MoE…
原文语言：英语
Comprehensive reference documentation and skill for NVIDIA NCCL (Collective Communications Library), the GPU communication library for multi-GPU and multi-node collectives. Use this skill whenever the user mentions NCCL, all-reduce, all-gather,…
原文语言：英语
Comprehensive reference documentation and skill for PyTorch - the GPU-accelerated tensor computation and deep learning framework. Covers tensor operations, automatic differentiation, neural network modules (nn), optimization, distributed training, CUDA…
原文语言：英语
Comprehensive reference documentation and skill for SGLang - a high-performance serving framework for large language models and multimodal models. Covers SGLang architecture, ServerArgs configuration, OpenAI-compatible API server, native API, offline engine…
原文语言：英语
Comprehensive reference documentation and skill for vLLM - a high-throughput and memory-efficient inference and serving engine for large language models (LLMs). Covers vLLM architecture (V0 and V1), engine APIs (LLMEngine, AsyncLLMEngine, LLM),…
原文语言：英语
Comprehensive reference documentation and skill for NVIDIA CUDA C++ - the parallel computing platform and programming model for GPU acceleration. Covers CUDA Programming Guide (Release 13.2) and CUDA C++ Best Practices Guide (Release 13.2). Includes…
原文语言：英语
Comprehensive reference documentation and skill for OpenAI Triton - a language and compiler for writing highly efficient custom Deep-Learning primitives on GPUs. Covers Python API (triton.language, triton.runtime, triton.compiler), MLIR dialects and passes,…
原文语言：英语
Comprehensive reference documentation and skill for MLIR (Multi-Level Intermediate Representation) - the extensible compiler infrastructure framework from the LLVM project. Covers the MLIR language reference, IR core concepts (Operations, Values, Blocks,…
原文语言：英语
Comprehensive reference documentation and skill for Ray - a unified framework for scaling AI and Python applications. Covers Ray Core (tasks, actors, objects, scheduling, placement groups, namespaces, runtime environment, fault tolerance, compiled graphs,…
原文语言：英语
Comprehensive reference documentation and skill for TensorFlow - the end-to-end open source platform for machine learning. Covers TensorFlow 2.x Python API (tensors, operations, variables, autograd, tf.function, tf.data, Keras, distributed training), C++ core…
原文语言：英语
Comprehensive reference documentation and skill for ONNX Runtime - the cross-platform high-performance inference and training engine for ONNX models. Covers C/C++ API, Python API (InferenceSession, OrtValue, SessionOptions), all Execution Providers (CUDA,…
原文语言：英语
Comprehensive reference documentation and skill for JAX - Google's library for high-performance numerical computing and machine learning research. Covers JAX core (transformations, tracing, jaxprs, pytrees), jax.numpy, jax.lax, jax.nn, jax.random, automatic…
原文语言：英语
Comprehensive reference documentation and skill for DeepSpeed - the distributed deep learning training and inference optimization library. Covers ZeRO optimization (Stages 0-3), ZeRO-Offload, ZeRO-Infinity, SuperOffload, ZenFlow, pipeline parallelism, tensor…
原文语言：英语
Comprehensive reference documentation and skill for TileLang - a concise domain-specific language (DSL) for developing high-performance GPU/CPU kernels built on Apache TVM. Covers the complete programming model (3-level abstraction), language API (memory…
原文语言：英语
Comprehensive reference for XLA (Accelerated Linear Algebra) compiler - covering architecture, operation semantics, HLO IR, compilation pipeline, GPU/CPU/TPU backends, PJRT API, MLIR integration, custom calls, autotuning, SPMD partitioning, debugging tools,…
原文语言：英语
NVIDIA CUTLASS CUDA Template Library - comprehensive reference for high-performance matrix multiplication (GEMM), convolution, tensor operations, and CuTe DSL across all GPU architectures (Volta through Blackwell)
原文语言：英语