Set up Prometheus and Grafana monitoring for AQUA vLLM model deployments on OCI. Covers the signing proxy, container registry setup, OCI Container Instance deployment, and PromQL dashboards. Triggered when user wants to monitor LLM deployments, view TTFT/latency/throughput metrics, or set up observability for AQUA.
Installer avec Codex ou Claude Copiez ce prompt, collez-le dans Codex, Claude ou un autre assistant, puis laissez-le vérifier la page du skill et l'installer pour vous.
Une commande directe contourne le prompt de vérification. Examinez la source avant de l'exécuter.
Set up Prometheus and Grafana monitoring for AQUA vLLM model deployments on OCI. Covers the signing proxy, container registry setup, OCI Container Instance deployment, and PromQL dashboards. Triggered when user wants to monitor LLM deployments, view TTFT/latency/throughput metrics, or set up observability for AQUA.
user-invocable
true
disable-model-invocation
false
AQUA Deployment Metrics Monitoring
Monitor vLLM model deployments with Prometheus + Grafana hosted on an OCI Container Instance. The monitoring stack consists of:
Signing Proxy — handles OCI IAM auth when scraping the /metrics endpoint
Prometheus — scrapes metrics every 5s, stores time series
Grafana — visualizes dashboards from Prometheus data
Available Metrics (vLLM Prometheus)
All standard vLLM Prometheus metrics are available:
AQUA Model Deployment
└── /predict/metrics endpoint (requires OCI IAM signature)
↑
Signing Proxy :8080
(resource_principal auth)
↑
Prometheus :9090
(scrapes localhost:8080 every 5s)
↑
Grafana :3000
(visualizes from localhost:9090)
↑
User browser (public IP of Container Instance)
Step 1: Clone the Monitoring Stack
git clone https://github.com/oracle-samples/oci-data-science-ai-samples.git
cd oci-data-science-ai-samples/ai-quick-actions/aqua_metrics
