api-runtime-monitor

name	api-runtime-monitor
description	Monitors LTX API runtime performance, latency, error rates, and throughput. Alerts on performance degradation or errors.
tags	["monitoring","api","performance","latency","errors"]

API Runtime Monitor

When to use

• "Monitor API latency"
• "Alert on API errors"
• "Track API throughput"
• "Monitor inference time"
• "Alert on API performance degradation"

What it monitors

• Latency: Request processing time, inference time, queue time
• Error rates: % of failed requests, error types, error sources
• Throughput: Requests per hour/day, by endpoint/model
• Performance: P50/P95/P99 latency, success rate
• Utilization: API usage by org, model, resolution

Steps

1. Gather requirements from user:

   • Which performance metric to monitor (latency, errors, throughput)
   • Alert threshold (e.g., "P95 latency > 30s", "error rate > 5%", "throughput drops > 20%")
   • Time window (hourly, daily)
   • Scope (all requests, specific endpoint, specific org)
   • Notification channel

2. Read shared files:

   • shared/bq-schema.md — GPU cost table (has API runtime data) and ltxvapi tables
   • shared/metric-standards.md — Performance metric patterns