| name | multimodal-llm |
| license | MIT |
| compatibility | Claude Code 2.1.220+. |
| author | OrchestKit |
| version | 2.1.1 |
| description | Vision, audio, video generation, and multimodal LLM integration patterns. Use when processing images, transcribing audio, generating speech, generating AI video (Kling v3, Sora 2, Veo 3.1 std/lite/fast, Runway Gen-4.5 via `gen4_turbo`), or building multimodal AI pipelines. |
| tags | ["vision","audio","video","multimodal","image","speech","transcription","tts","kling","sora","veo","video-generation"] |
| user-invocable | false |
| disable-model-invocation | true |
| context | fork |
| agent | multimodal-specialist |
| complexity | high |
| persuasion-type | reference |
| effort | high |
| metadata | {"category":"mcp-enhancement"} |
| allowed-tools | ["Read","Glob","Grep","WebFetch","WebSearch"] |
Multimodal LLM Patterns
Integrate vision, audio, and video generation capabilities from leading multimodal models. Covers image analysis, document understanding, real-time voice agents, speech-to-text, text-to-speech, and AI video generation (Kling v3, Sora 2, Veo 3.1 std/lite/fast tiers, Runway Gen-4.5 via gen4_turbo).
Canonical model IDs (pinned against yonatan-hq/platform/apps/api/app/config.py):
| Provider | Model IDs |
|---|
| Anthropic | claude-opus-5 (recommended, 2,576 px budget, production default), claude-opus-4-8, claude-opus-4-7, claude-opus-4-6, claude-sonnet-4-6, claude-haiku-4-5-20251001. claude-fable-5 is Anthropic's frontier tier above Opus (GA 2026-07). Premium cost — never auto-pin it; the fable-spend-consent gate requires explicit user consent before any Fable spend |
| OpenAI | gpt-5.5 (current flagship) |
| Google | gemini-3.1-pro-preview (flagship), gemini-3.1-flash-lite-preview (cost) |
| Veo | veo-3.1-generate-preview / veo-3.1-lite-generate-preview / veo-3.1-fast-generate-preview |
| Kling | kling-v3 (model_name field in Kling API) |
| Runway | gen4_turbo (product label: Gen-4.5) |
Quick Reference
