monitoring-observability

Monitoring and observability patterns for Prometheus metrics, Grafana dashboards, Langfuse v4 LLM tracing (as_type, score_current_span, should_export_span, LangfuseMedia), and drift detection. Use when adding logging, metrics, distributed tracing, LLM cost tracking, or quality drift monitoring.

Ir a la instalación

Repositorio: yonatangross/orchestkit
Última actividad en el origen: 5 de agosto de 2026 a las 16:40
Idioma detectado de SKILL.md: inglés
Estrellas: 219
Forks: 20

Opciones de instalación

De forma predeterminada está seleccionado el prompt que primero revisa el origen. Puedes cambiar a un comando directo o descargar una copia local.

Instalar con Codex o Claude Copia este prompt, pégalo en Codex, Claude u otro asistente, y deja que revise la página de la skill y la instale por ti.

Un comando directo omite el prompt de revisión. Revisa el origen antes de ejecutarlo.

npx skills add https://github.com/yonatangross/orchestkit --skill monitoring-observability

El comando permanece en una sola línea. Desplázate horizontalmente para revisarlo antes de copiarlo.

¿Prefieres una copia local? Descarga los archivos que SkillsMP tiene disponibles ahora.

Revisa los archivos de origen

Lee SKILL.md y los archivos complementarios que muestra SkillsMP antes de decidir si quieres instalarlo.

Explorador de archivos

27 archivos

SKILL.md

Instrucciones de origen · Vista previa de solo lectura

Volver a la búsqueda Volver a la instalación

chain-patterns

Chain patterns for multi-phase pipelines: MCP detection, handoff files, checkpoint-resume, worktree agents, CronCreate monitoring. Use when building or debugging a pipeline skill.

2026-08-12

doctor

OrchestKit doctor for health diagnostics across manifest integrity, hook configuration, skill validation, agent frontmatter, MCP server connectivity, CC version compatibility, and permission rules. Reports issues with severity levels and auto-remediation suggestions. Validates component counts, detects orphaned entries, and checks CC version matrix compliance. Use when diagnosing plugin health, troubleshooting configuration issues, or running pre-release checks.

2026-08-12

telemetry-inspect

Inspects the OrchestKit telemetry pipeline for the current project — lists all known telemetry files with write counts, sizes, schema status, growth trend, and orphan detection. Use when verifying the observability pipeline is healthy, debugging a missing writer, or auditing which files have schema locks vs. which are drift-vulnerable. Read-only — never modifies telemetry files.

2026-08-12

Ver todos los de este repositorio

Monitoring & Observability

A wrap around Prometheus, Grafana, OpenTelemetry and Langfuse, not a re-teaching of them. This skill carries OrchestKit's delta (version floors, house decisions, scars) and points at the vendor for everything else. Start at references/ork-delta.md.

Upstream coverage (do not restate)

These topics are fully covered first-party. Read the source, do not add a local copy.

Topic

First-party source

Prometheus metric types, RED method, cardinality, PromQL

https://prometheus.io/docs/practices/

Alertmanager grouping, inhibition, escalation, runbooks

https://prometheus.io/docs/alerting/latest/configuration/

Grafana dashboards, Loki and LogQL, Promtail

https://grafana.com/docs/

OpenTelemetry spans, sampling, context propagation

https://opentelemetry.io/docs/

Langfuse Python SDK (@observe, as_type, score_current_span, should_export_span, LangfuseMedia)

https://langfuse.com/docs/sdk/python

Langfuse v2 to v4 Python and v3 to v5 JS migration paths

https://langfuse.com/docs/sdk/python/v4-migration

Langfuse self-hosting (ClickHouse, Redis, S3, Helm)

https://langfuse.com/docs/deployment/self-host

Langfuse cost tracking, model pricing, Metrics API v2

https://langfuse.com/docs/model-usage-and-cost

Langfuse scores, online evaluators, annotation queues, prompt management

https://langfuse.com/docs/scores/overview

Langfuse framework integrations (LangChain, LangGraph, CrewAI, Pydantic AI, Bedrock, LiveKit)

https://langfuse.com/docs/integrations

Agent Graphs, observation types, rendered tool calls

Monitoring & Observability

Upstream coverage (do not restate)

These topics are fully covered first-party. Read the source, do not add a local copy.

Topic

First-party source

Prometheus metric types, RED method, cardinality, PromQL

https://prometheus.io/docs/practices/

Alertmanager grouping, inhibition, escalation, runbooks

https://prometheus.io/docs/alerting/latest/configuration/

Grafana dashboards, Loki and LogQL, Promtail

https://grafana.com/docs/

OpenTelemetry spans, sampling, context propagation

https://opentelemetry.io/docs/

Langfuse Python SDK (@observe, as_type, score_current_span, should_export_span, LangfuseMedia)

https://langfuse.com/docs/sdk/python

Langfuse v2 to v4 Python and v3 to v5 JS migration paths

https://langfuse.com/docs/sdk/python/v4-migration

Langfuse self-hosting (ClickHouse, Redis, S3, Helm)

https://langfuse.com/docs/deployment/self-host

Langfuse cost tracking, model pricing, Metrics API v2

https://langfuse.com/docs/model-usage-and-cost

Langfuse scores, online evaluators, annotation queues, prompt management

https://langfuse.com/docs/scores/overview

Langfuse framework integrations (LangChain, LangGraph, CrewAI, Pydantic AI, Bedrock, LiveKit)

https://langfuse.com/docs/integrations

Agent Graphs, observation types, rendered tool calls

name	monitoring-observability
license	MIT
compatibility	Claude Code 2.1.220+.
description	Monitoring and observability patterns for Prometheus metrics, Grafana dashboards, Langfuse v4 LLM tracing (as_type, score_current_span, should_export_span, LangfuseMedia), and drift detection. Use when adding logging, metrics, distributed tracing, LLM cost tracking, or quality drift monitoring.
tags	["monitoring","observability","prometheus","grafana","langfuse","tracing","metrics","drift-detection","logging"]
context	fork
version	3.0.0
author	OrchestKit
user-invocable	false
disable-model-invocation	true
complexity	medium
persuasion-type	reference
targets	[{"library":"langfuse","version":">=4.0.0"}]
upstream-version-tested	4.14.2
metadata	{"category":"document-asset-creation"}
allowed-tools	["Read","Glob","Grep","WebFetch","WebSearch"]
path_patterns	["/metrics/","/tracing/","prometheus.","grafana/*"]

name	monitoring-observability
license	MIT
compatibility	Claude Code 2.1.220+.
description	Monitoring and observability patterns for Prometheus metrics, Grafana dashboards, Langfuse v4 LLM tracing (as_type, score_current_span, should_export_span, LangfuseMedia), and drift detection. Use when adding logging, metrics, distributed tracing, LLM cost tracking, or quality drift monitoring.
tags	["monitoring","observability","prometheus","grafana","langfuse","tracing","metrics","drift-detection","logging"]
context	fork
version	3.0.0
author	OrchestKit
user-invocable	false
disable-model-invocation	true
complexity	medium
persuasion-type	reference
targets	[{"library":"langfuse","version":">=4.0.0"}]
upstream-version-tested	4.14.2
metadata	{"category":"document-asset-creation"}
allowed-tools	["Read","Glob","Grep","WebFetch","WebSearch"]
path_patterns	["/metrics/","/tracing/","prometheus.","grafana/*"]

Category	Rules	Impact	When to Use
Infrastructure Monitoring	1	CRITICAL	Grafana dashboards, Golden Signals, SLO/SLI
LLM Observability	1	HIGH	Langfuse tracing, observation types, agent graphs
Silent Failures	3	HIGH	Tool skipping, quality degradation, loop/token spike alerting

Rule	File	Key Pattern
Tool Skipping	`rules/silent-tool-skipping.md`	Expected vs actual tool calls, Langfuse traces
Quality Degradation	`rules/silent-degraded-quality.md`	Heuristics + LLM-as-judge, z-score baselines
Silent Alerting	`rules/silent-alerting.md`	Loop detection, token spikes, escalation workflow

Decision	Recommendation	Rationale
Metric methodology	RED method (Rate, Errors, Duration)	Industry standard, covers essential service health
Log format	Structured JSON	Machine-parseable, supports log aggregation
Tracing	OpenTelemetry	Vendor-neutral, auto-instrumentation, broad ecosystem
LLM observability	Langfuse (not LangSmith)	Open-source, self-hosted, built-in prompt management
LLM tracing API	`@observe(as_type=...)` + `score_current_span()`	v4: semantic types, inline scoring, span filtering
Langfuse APIs	Observations API v2 + Metrics API v2	v4 (Mar 2026): faster querying, aggregations at scale
Hook telemetry transport	JSONL under `~/.claude/analytics/`, never an SDK in-process	Hooks are per-event processes; SDK init would be paid on every spawn (`references/ork-delta.md`)

monitoring-observability

Opciones de instalación

Revisa los archivos de origen