ov-gguf-add-architecture

Enable a new model architecture/family in the OpenVINO GGUF frontend's native .gguf builder, or check whether a GGUF model is supported. Use when the user asks to enable, support or bring up a GGUF/llama.cpp model (llama, qwen, phi, gemma, MoE and similar decoder-only families), when a .gguf file is rejected as an unsupported architecture, or when working on arch_registry / DecoderBuilder in src/frontends/gguf/src/builder/. Do NOT use for adding a single ggml op translator or for debugging wrong output from an already-supported model.

Jump to install

Repository: openvinotoolkit/openvino
Last source activity: August 21, 2026 at 19:00
Detected SKILL.md language: English
Stars: 10,809
Forks: 3,366

Install options

The review-first prompt is selected by default. You can switch to a direct command or download a local copy.

Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.

A direct command skips the review prompt. Inspect the source before running it.

npx skills add https://github.com/openvinotoolkit/openvino --skill ov-gguf-add-architecture

The command stays on one line. Scroll horizontally to inspect it before copying.

Prefer a local copy? Download the files currently available to SkillsMP.

Review the source files

Read SKILL.md and any companion files shown by SkillsMP before deciding whether to install.

SKILL.md

Source instructions · Read-only preview

name

ov-gguf-add-architecture

description

Read src/frontends/gguf/docs/adding_an_architecture.md — most architectures in the transformer family need no code, only a general.architecture string added to arch_registry.cpp plus the correct RoPE type. It also lists exactly which structural features are auto-detected from the tensor table and metadata, and how to verify a new arch.
Check src/frontends/gguf/docs/supported_models.md first to see whether the architecture is already accepted and how support was verified.
Only if the family is structurally novel, consult the "10% case" section before adding builder code.
Verify as that document prescribes, including the graph-fingerprint check, and re-run the other supported architectures after any change to shared builder logic.

Back to search Back to installation

ov-github-actions-ci

Author, edit, debug, and review the OpenVINO GitHub Actions CI infrastructure — regular (non-agentic) workflows under .github/workflows, reusable job_*.yml workflows, custom composite actions under .github/actions, CI helper scripts under .github/scripts, Dockerfiles under .github/dockerfiles, and the Smart CI / labeler / components configuration. Use when a user wants to add or change a build/test job or step, create or modify a reusable workflow, write or fix a custom action, adjust runners/containers/caches, wire up Smart CI for a component, pin action versions, fix workflow permissions/security, or debug a failing CI workflow's YAML. Do NOT use for gh-aw agentic workflows (*.md with gh-aw frontmatter — use ov-agentic-workflows), for diagnosing a specific product/test failure's root cause in C++/Python code, or for non-CI GitHub configuration.

2026-08-27

ov-gguf-debug-accuracy

Debug wrong or degraded output from a GGUF model running through the OpenVINO GGUF frontend or the ggml-openvino backend. Use when a GGUF model converts but produces garbage, repeated or drifting tokens, a cosine-similarity cliff between layers, output that diverges from llama.cpp CPU, or a broadcast/shape crash that appears only at decode or only for one architecture. Do NOT use for ops that fail to convert at all ("Translation for operation type ... is not implemented"), or for build and CMake failures.

2026-08-21

ov-gguf-enable-op

Enable a ggml operation in the OpenVINO GGUF frontend by adding or fixing an op translator. Use when conversion fails with "Translation for operation type GGML_OP_* is not implemented", when the user asks to add/implement/fix a GGUF or ggml op translator or an op_case, or when working on src/frontends/gguf/src/op/. Do NOT use for enabling a new model architecture (that is usually just a name in arch_registry.cpp), for wrong numerical output from an op that already converts, or for GGUF quantization format work.

2026-08-21

View all from this repository

name

ov-gguf-add-architecture

description

Read src/frontends/gguf/docs/adding_an_architecture.md — most architectures in the transformer family need no code, only a general.architecture string added to arch_registry.cpp plus the correct RoPE type. It also lists exactly which structural features are auto-detected from the tensor table and metadata, and how to verify a new arch.
Check src/frontends/gguf/docs/supported_models.md first to see whether the architecture is already accepted and how support was verified.
Only if the family is structurally novel, consult the "10% case" section before adding builder code.
Verify as that document prescribes, including the graph-fingerprint check, and re-run the other supported architectures after any change to shared builder logic.

ov-gguf-add-architecture

Source facts

Install options

Review the source files

More from this repository

More from this repository