monitoring-observability

name	monitoring-observability
license	MIT
compatibility	Claude Code 2.1.220+.
description	Monitoring and observability patterns for Prometheus metrics, Grafana dashboards, Langfuse v4 LLM tracing (as_type, score_current_span, should_export_span, LangfuseMedia), and drift detection. Use when adding logging, metrics, distributed tracing, LLM cost tracking, or quality drift monitoring.
tags	["monitoring","observability","prometheus","grafana","langfuse","tracing","metrics","drift-detection","logging"]
context	fork
version	3.0.0
author	OrchestKit
user-invocable	false
disable-model-invocation	true
complexity	medium
persuasion-type	reference
targets	[{"library":"langfuse","version":">=4.0.0"}]
upstream-version-tested	4.14.2
metadata	{"category":"document-asset-creation"}
allowed-tools	["Read","Glob","Grep","WebFetch","WebSearch"]
path_patterns	["**/metrics/**","**/tracing/**","prometheus.*","grafana/**"]

Monitoring & Observability

A wrap around Prometheus, Grafana, OpenTelemetry and Langfuse, not a re-teaching of them. This skill carries OrchestKit's delta (version floors, house decisions, scars) and points at the vendor for everything else. Start at references/ork-delta.md.

Upstream coverage (do not restate)

These topics are fully covered first-party. Read the source, do not add a local copy.

Topic	First-party source
Prometheus metric types, RED method, cardinality, PromQL	https://prometheus.io/docs/practices/
Alertmanager grouping, inhibition, escalation, runbooks	https://prometheus.io/docs/alerting/latest/configuration/
Grafana dashboards, Loki and LogQL, Promtail	https://grafana.com/docs/
OpenTelemetry spans, sampling, context propagation	https://opentelemetry.io/docs/
Langfuse Python SDK (@observe, as_type, score_current_span, should_export_span, LangfuseMedia)	https://langfuse.com/docs/sdk/python
Langfuse v2 to v4 Python and v3 to v5 JS migration paths	https://langfuse.com/docs/sdk/python/v4-migration
Langfuse self-hosting (ClickHouse, Redis, S3, Helm)	https://langfuse.com/docs/deployment/self-host
Langfuse cost tracking, model pricing, Metrics API v2	https://langfuse.com/docs/model-usage-and-cost
Langfuse scores, online evaluators, annotation queues, prompt management	https://langfuse.com/docs/scores/overview
Langfuse framework integrations (LangChain, LangGraph, CrewAI, Pydantic AI, Bedrock, LiveKit)	https://langfuse.com/docs/integrations
Agent Graphs, observation types, rendered tool calls