llama-cpp

name	llama-cpp
description	Run LLM inference with llama.cpp on CPU, Apple Silicon, AMD/Intel GPUs, or ...
version	2.0.0
triggers	["llama cpp","llama-cpp"]
author	Orchestra Research
license	MIT
dependencies	["llama-cpp-python>=0.2.0"]
metadata	{"hermes":{"tags":["llama.cpp","GGUF","Quantization","CPU Inference","Apple Silicon","Edge Deployment","Non-NVIDIA","AMD GPUs","Intel GPUs","Embedded","Model Compression"]}}
category	mlops

llama-cpp

Run LLM inference with llama.cpp on CPU, Apple Silicon, AMD/Intel GPUs, or ...