local-inference-bridge

name	local-inference-bridge
description	Routes complex reasoning and heavy-lifting prompts to the local Ollama instance to maximize local GPU/CPU utilization and bypass cloud rate limits.

Local Inference Bridge

This skill allows the agent to leverage the host's local GPU/CPU by executing prompts via the Ollama CLI.

The Local Routing Loop

1. Evaluation: If a task is "heavy" (e.g., analyzing 10+ files, rewriting a large module, or deep architectural reasoning), trigger local routing.
2. Dispatch: Use terminal(command='ollama run <model> "<prompt>"').
3. Ingestion: Capture the stdout of the local model.
4. Synthesis: Use the cloud brain (if available) only for final formatting or high-level orchestration, while keeping the "heavy lifting" local.

When to use Local routing

• Deep Code Reviews: Analyzing logic across multiple files.
• Large Scale Refactoring: Generating large blocks of code.
• Privacy-Sensitive Work: When data should not leave the local machine.
• Rate-Limit Avoidance: When the cloud provider is unstable or slow.

Verification

• Run ollama list to verify the model is present.
• Test with a simple ollama run <model> "Hello from the bridge" call.