Install or verify the correct PyTorch build for a user's accelerator backend before Quark installation. Trigger for "install PyTorch", "pip install torch", "set up torch for ROCm", "set up torch for CUDA", "torch version mismatch", "CPU-only torch installed",…
Skills in this repository
amd/Quark - Page 2
SkillsMP has collected 46 skills from amd/Quark. Open a skill to review its source and details.
amd/QuarkShowing 6 of 46 collected skills.
End-to-end LLM accuracy evaluation on AMD ROCm (ROCm-only) — docker container setup OR host (no-docker) runtime, vLLM/SGLang/ATOM serving, lm-eval / lighteval / evalscope benchmarks. Use when the user wants to evaluate, benchmark, or compare an LLM's…
End-to-end Torch LLM PTQ recipe for AMD Quark — for PyTorch / HuggingFace transformers models (safetensors input): quantize, then validate, then evaluate accuracy, in one flow. Delegates the PTQ path (intake, planning, manifest, execution) to the…
Inspect a HuggingFace transformers / safetensors model and prepare metadata for Quark Torch PTQ planning. Use for model path validation, architecture detection, quantization target discovery, layer counting, risk assessment, or transformers compatibility…
Torch LLM PTQ workflow for AMD Quark — for PyTorch / HuggingFace transformers models (safetensors input). Use when the user wants a complete PTQ pipeline: model inspection, quantization planning, script generation, and optional execution. Stops at the…
Validate Quark Torch quantization output (HuggingFace safetensors + config.json) using four lightweight checks: auxiliary file copy alignment, excluded tensor MD5 byte-identity, config.json deep comparison after stripping quantization keys, and safetensors…