| name | distributed-inference-orchestrator |
| description | Manage AI processing across multiple global GPU providers. |
Distributed Inference Orchestrator
This skill manages the 'Brain Latency' of the system by routing AI queries to the closest or cheapest GPU provider (RunPod, Lambda, AWS) in real-time.
Instructions
- Monitor live prices and queue times for 5+ GPU cloud providers.
- Implement 'Failover' logic: if Provider A is slow, route to Provider B.
- Use 'Load Balancing' to handle bursts of 10,000+ simultaneous AI requests.
- Optimize cold-start times for custom model weights.
Examples
- "Route all non-urgent 8K video renders to the cheapest available GPU node globally."