Validate quantization math, packed formats, and inference kernels against a Torch oracle; enforce quantized persistent weight storage for inference implementations, dispatch, and cache changes; adjudicate near-tie mismatches.
原文语言:英语
复制这段 Prompt,发给你正在使用的 AI 助手。
Follow https://skillsmp.com/skill-install/prompt.md to install Agent Skills from https://github.com/ModelCloud/GPTQModel.正在加载仓库 README…
已展示 3 / 3 个已收集 Skill。
Validate quantization math, packed formats, and inference kernels against a Torch oracle; enforce quantized persistent weight storage for inference implementations, dispatch, and cache changes; adjudicate near-tie mismatches.
原文语言:英语
End-to-end smoke test for GPT-QModel's lazy checkpoint load (LazyTurtle) and first-layer materialization through StageInputsCapture.cache_inputs. Use when verifying lazy-load behavior, first-layer input capture, shell_module_materialize module_path…
原文语言:英语
Diagnose and correct GPT-QModel tokenizer initialization, tokenization normalization, special-token handling, prompt rendering, and chat-template problems. Use when inference or evaluation quality suggests wrong token IDs or prompts, when a model needs…
原文语言:英语
暂时无法加载仓库 README。你仍可浏览下方的 Skill 目录。