ov-gguf-debug-accuracy

Debug wrong or degraded output from a GGUF model running through the OpenVINO GGUF frontend or the ggml-openvino backend. Use when a GGUF model converts but produces garbage, repeated or drifting tokens, a cosine-similarity cliff between layers, output that diverges from llama.cpp CPU, or a broadcast/shape crash that appears only at decode or only for one architecture. Do NOT use for ops that fail to convert at all ("Translation for operation type ... is not implemented"), or for build and CMake failures.

Ir para a instalação

Repositório: openvinotoolkit/openvino
Última atividade na origem: 21 de agosto de 2026 às 19:00
Idioma detectado do SKILL.md: inglês
Estrelas: 10.809
Forks: 3.366

Opções de instalação

Por padrão, está selecionado o prompt que primeiro revisa a origem. Você pode mudar para um comando direto ou baixar uma cópia local.

Instalar com Codex ou Claude Copie este prompt, cole no Codex, Claude ou outro assistente e deixe que ele revise a página da skill e instale para você.

Um comando direto ignora o prompt de revisão. Verifique a origem antes de executá-lo.

npx skills add https://github.com/openvinotoolkit/openvino --skill ov-gguf-debug-accuracy

O comando permanece em uma só linha. Role horizontalmente para revisá-lo antes de copiar.

Prefere uma cópia local? Baixe os arquivos disponíveis atualmente no SkillsMP.

Revise os arquivos de origem

Leia o SKILL.md e os arquivos complementares exibidos pelo SkillsMP antes de decidir se vai instalar.

SKILL.md

Instruções da origem · Visualização somente leitura

name

ov-gguf-debug-accuracy

description

Read src/frontends/gguf/docs/debugging_accuracy.md — the coarse-to-fine bisection strategy, the ggml-CPU oracle technique, the catalogue of bug archetypes with their generalizable lessons, the debug env vars, and the checklist.
Apply its one governing rule before anything else: every accuracy claim is a comparison against the real llama.cpp CPU implementation, never a hand-derived reference. If you are about to write out an op's math to form an expectation, generate it from ggml instead.
Work the bisection steps in order and do not open a debugger until they have cornered the bug. Check the bug archetypes first when a cosine cliff or dynamic-shape crash points near one.
After any fix to a shared path — especially a VIEW or op_case predicate — re-run the other supported architectures and confirm their classification and output are unchanged.

Voltar à pesquisa Voltar à instalação

ov-github-actions-ci

Author, edit, debug, and review the OpenVINO GitHub Actions CI infrastructure — regular (non-agentic) workflows under .github/workflows, reusable job_*.yml workflows, custom composite actions under .github/actions, CI helper scripts under .github/scripts, Dockerfiles under .github/dockerfiles, and the Smart CI / labeler / components configuration. Use when a user wants to add or change a build/test job or step, create or modify a reusable workflow, write or fix a custom action, adjust runners/containers/caches, wire up Smart CI for a component, pin action versions, fix workflow permissions/security, or debug a failing CI workflow's YAML. Do NOT use for gh-aw agentic workflows (*.md with gh-aw frontmatter — use ov-agentic-workflows), for diagnosing a specific product/test failure's root cause in C++/Python code, or for non-CI GitHub configuration.

2026-08-27

ov-gguf-add-architecture

Enable a new model architecture/family in the OpenVINO GGUF frontend's native .gguf builder, or check whether a GGUF model is supported. Use when the user asks to enable, support or bring up a GGUF/llama.cpp model (llama, qwen, phi, gemma, MoE and similar decoder-only families), when a .gguf file is rejected as an unsupported architecture, or when working on arch_registry / DecoderBuilder in src/frontends/gguf/src/builder/. Do NOT use for adding a single ggml op translator or for debugging wrong output from an already-supported model.

2026-08-21

ov-gguf-enable-op

Enable a ggml operation in the OpenVINO GGUF frontend by adding or fixing an op translator. Use when conversion fails with "Translation for operation type GGML_OP_* is not implemented", when the user asks to add/implement/fix a GGUF or ggml op translator or an op_case, or when working on src/frontends/gguf/src/op/. Do NOT use for enabling a new model architecture (that is usually just a name in arch_registry.cpp), for wrong numerical output from an op that already converts, or for GGUF quantization format work.

2026-08-21

Ver todas deste repositório

name

ov-gguf-debug-accuracy

description

Read src/frontends/gguf/docs/debugging_accuracy.md — the coarse-to-fine bisection strategy, the ggml-CPU oracle technique, the catalogue of bug archetypes with their generalizable lessons, the debug env vars, and the checklist.
Apply its one governing rule before anything else: every accuracy claim is a comparison against the real llama.cpp CPU implementation, never a hand-derived reference. If you are about to write out an op's math to form an expectation, generate it from ggml instead.
Work the bisection steps in order and do not open a debugger until they have cornered the bug. Check the bug archetypes first when a cosine cliff or dynamic-shape crash points near one.
After any fix to a shared path — especially a VIEW or op_case predicate — re-run the other supported architectures and confirm their classification and output are unchanged.

ov-gguf-debug-accuracy

Informações da origem

Opções de instalação

Revise os arquivos de origem

Mais deste repositório

Mais deste repositório