Menu
SkillsMP a collecté 18 skills depuis jstzwj/ai-infra-plugins. Ouvrez un skill pour examiner sa source et ses détails.
Affichage de 18 skills collectés sur 18.
Comprehensive reference documentation and skill for xFormers, Facebook Research's toolbox to accelerate research on Transformers. Use this skill whenever the user mentions xformers, memory_efficient_attention, FMHA, flash attention, SwiGLU, RMSNorm, RoPE,…
Langue du texte source : anglais
Comprehensive reference documentation and skill for bitsandbytes, the k-bit quantization library for PyTorch enabling accessible large language models. Use this skill whenever the user mentions bitsandbytes, LLM.int8(), QLoRA, 4-bit quantization, 8-bit…
Langue du texte source : anglais
NVIDIA Megatron-LM & Megatron Core - GPU-optimized framework for training large language models with tensor parallelism, pipeline parallelism, data parallelism (DDP/FSDP), context parallelism, expert parallelism, FP8/FP4 quantization, CUDA graphs, MoE…
Langue du texte source : anglais
Comprehensive reference documentation and skill for NVIDIA NCCL (Collective Communications Library), the GPU communication library for multi-GPU and multi-node collectives. Use this skill whenever the user mentions NCCL, all-reduce, all-gather,…
Langue du texte source : anglais
Comprehensive reference documentation and skill for PyTorch - the GPU-accelerated tensor computation and deep learning framework. Covers tensor operations, automatic differentiation, neural network modules (nn), optimization, distributed training, CUDA…
Langue du texte source : anglais
Comprehensive reference documentation and skill for SGLang - a high-performance serving framework for large language models and multimodal models. Covers SGLang architecture, ServerArgs configuration, OpenAI-compatible API server, native API, offline engine…
Langue du texte source : anglais
Comprehensive reference documentation and skill for vLLM - a high-throughput and memory-efficient inference and serving engine for large language models (LLMs). Covers vLLM architecture (V0 and V1), engine APIs (LLMEngine, AsyncLLMEngine, LLM),…
Langue du texte source : anglais
Comprehensive reference documentation and skill for NVIDIA CUDA C++ - the parallel computing platform and programming model for GPU acceleration. Covers CUDA Programming Guide (Release 13.2) and CUDA C++ Best Practices Guide (Release 13.2). Includes…
Langue du texte source : anglais
Comprehensive reference documentation and skill for OpenAI Triton - a language and compiler for writing highly efficient custom Deep-Learning primitives on GPUs. Covers Python API (triton.language, triton.runtime, triton.compiler), MLIR dialects and passes,…
Langue du texte source : anglais
Comprehensive reference documentation and skill for MLIR (Multi-Level Intermediate Representation) - the extensible compiler infrastructure framework from the LLVM project. Covers the MLIR language reference, IR core concepts (Operations, Values, Blocks,…
Langue du texte source : anglais
Comprehensive reference documentation and skill for Ray - a unified framework for scaling AI and Python applications. Covers Ray Core (tasks, actors, objects, scheduling, placement groups, namespaces, runtime environment, fault tolerance, compiled graphs,…
Langue du texte source : anglais
Comprehensive reference documentation and skill for TensorFlow - the end-to-end open source platform for machine learning. Covers TensorFlow 2.x Python API (tensors, operations, variables, autograd, tf.function, tf.data, Keras, distributed training), C++ core…
Langue du texte source : anglais
Comprehensive reference documentation and skill for ONNX Runtime - the cross-platform high-performance inference and training engine for ONNX models. Covers C/C++ API, Python API (InferenceSession, OrtValue, SessionOptions), all Execution Providers (CUDA,…
Langue du texte source : anglais
Comprehensive reference documentation and skill for JAX - Google's library for high-performance numerical computing and machine learning research. Covers JAX core (transformations, tracing, jaxprs, pytrees), jax.numpy, jax.lax, jax.nn, jax.random, automatic…
Langue du texte source : anglais
Comprehensive reference documentation and skill for DeepSpeed - the distributed deep learning training and inference optimization library. Covers ZeRO optimization (Stages 0-3), ZeRO-Offload, ZeRO-Infinity, SuperOffload, ZenFlow, pipeline parallelism, tensor…
Langue du texte source : anglais
Comprehensive reference documentation and skill for TileLang - a concise domain-specific language (DSL) for developing high-performance GPU/CPU kernels built on Apache TVM. Covers the complete programming model (3-level abstraction), language API (memory…
Langue du texte source : anglais
Comprehensive reference for XLA (Accelerated Linear Algebra) compiler - covering architecture, operation semantics, HLO IR, compilation pipeline, GPU/CPU/TPU backends, PJRT API, MLIR integration, custom calls, autotuning, SPMD partitioning, debugging tools,…
Langue du texte source : anglais
NVIDIA CUTLASS CUDA Template Library - comprehensive reference for high-performance matrix multiplication (GEMM), convolution, tensor operations, and CuTe DSL across all GPU architectures (Volta through Blackwell)
Langue du texte source : anglais