llm-council

name

llm-council

description

Multi-model LLM Council with live dashboard. Query multiple AI models simultaneously, see responses side-by-side in a swarm-style dashboard, synthesize consensus, and run anonymous model-to-model voting. Use when the user asks to start the LLM council, compare models, query multiple models, convene council, ask all models, do model comparison, run multi-model queries, or launch the council dashboard. Supports Claude Sonnet 4.5, Claude Opus 4.5, GPT-4o, GPT-5.1, Gemini 2.5 Flash, and Gemini 2.5 Pro via AI Gateway.

LLM Council

Query multiple AI models in parallel with a live web dashboard.

Launch

cd ~/.claude/skills/llm-council/scripts
# Kill any existing server on the port
fuser -k 8787/tcp 2>/dev/null
# Start server
nohup python3 server.py > /tmp/council-server.log 2>&1 &
# Wait for startup, verify health
sleep 2 && curl -s --max-time 5 http://localhost:8787/health
# Export port for browser access
/app/export-port.sh 8787

Environment: COUNCIL_PORT (default 8787), AI_GATEWAY_API_KEY (required, auto-detected from environment).

Files

• scripts/server.py - ThreadingHTTPServer, serves static files + API routes, SSE streaming
• scripts/ai_gateway.py - AI Gateway client: query, parallel query, streaming, synthesis, anonymous voting
• scripts/static/index.html - Dashboard UI (HappyCapy design system, light/dark theme)
• scripts/static/app.js - Client-side logic (model selector, SSE parsing, markdown rendering, voting UI)

API

Method	Path	Description
GET	/	Dashboard
GET	/api/models	List models
GET	/health	Health check
POST	/api/council/stream	Query models (SSE)
POST	/api/council/synthesize	Synthesize consensus
POST	/api/council/vote	Anonymous model vote (SSE with keepalive)

Key Details

• Server uses ThreadingHTTPServer for concurrent request handling
• Vote endpoint streams SSE keepalive pings every 5s to prevent proxy timeouts (Cloudflare 524)
• Static files served with Cache-Control: no-store, no-cache headers
• Script tag uses cache-busting version param: app.js?v=... (bump when editing app.js)
• Model IDs use dots not hyphens: anthropic/claude-sonnet-4.5 (not claude-sonnet-4-5)