Menü
Skills in diesem Repository
SkillsMP hat 46 Skills aus amd/Quark gesammelt. Öffne einen Skill, um Quelle und Details zu prüfen.
amd/QuarkEs werden 6 von 46 gesammelten Skills angezeigt.
Install or verify the correct PyTorch build for a user's accelerator backend before Quark installation. Trigger for "install PyTorch", "pip install torch", "set up torch for ROCm", "set up torch for CUDA", "torch version mismatch", "CPU-only torch installed",…
Quellsprache: Englisch
End-to-end LLM accuracy evaluation on AMD ROCm (ROCm-only) — docker container setup OR host (no-docker) runtime, vLLM/SGLang/ATOM serving, lm-eval / lighteval / evalscope benchmarks. Use when the user wants to evaluate, benchmark, or compare an LLM's…
Quellsprache: Englisch
End-to-end Torch LLM PTQ recipe for AMD Quark — for PyTorch / HuggingFace transformers models (safetensors input): quantize, then validate, then evaluate accuracy, in one flow. Delegates the PTQ path (intake, planning, manifest, execution) to the…
Quellsprache: Englisch
Inspect a HuggingFace transformers / safetensors model and prepare metadata for Quark Torch PTQ planning. Use for model path validation, architecture detection, quantization target discovery, layer counting, risk assessment, or transformers compatibility…
Quellsprache: Englisch
Torch LLM PTQ workflow for AMD Quark — for PyTorch / HuggingFace transformers models (safetensors input). Use when the user wants a complete PTQ pipeline: model inspection, quantization planning, script generation, and optional execution. Stops at the…
Quellsprache: Englisch
Validate Quark Torch quantization output (HuggingFace safetensors + config.json) using four lightweight checks: auxiliary file copy alignment, excluded tensor MD5 byte-identity, config.json deep comparison after stripping quantization keys, and safetensors…
Quellsprache: Englisch