llama.cpp-loader

llama.cpp - C/C++ framework for LLM inference with GGUF models. Use when running, building, or optimizing LLM inference locally with llama.cpp. Keywords: llama.cpp, gguf, llm, inference, quantization, cuda, metal, vulkan, rocm, hip, opencl, multimodal, function-calling, speculative-decoding, build, cmake.