monitoring-observability

Monitoring and observability patterns for Prometheus metrics, Grafana dashboards, Langfuse v4 LLM tracing (as_type, score_current_span, should_export_span, LangfuseMedia), and drift detection. Use when adding logging, metrics, distributed tracing, LLM cost tracking, or quality drift monitoring.

インストールへ移動

リポジトリ: yonatangross/orchestkit
ソースの最終更新活動: 2026年8月5日 16:40
検出された SKILL.md の言語: 英語
スター: 219
フォーク: 20

インストール方法

デフォルトでは、最初にソースを確認する Prompt が選択されています。直接コマンドに切り替えるか、ローカルコピーをダウンロードすることもできます。

Codex または Claude でインストールこの Prompt をコピーして Codex、Claude、または他のアシスタントに貼り付けると、Skill ページを確認してインストールできます。

直接コマンドでは確認用 Prompt が省略されます。実行前にソースを確認してください。

npx skills add https://github.com/yonatangross/orchestkit --skill monitoring-observability

コマンドは1行のまま表示されます。コピー前に横へスクロールして全体を確認してください。

ローカルで確認しますか？SkillsMP が現在取得できるファイルをダウンロードできます。

ソースファイルを確認

インストールを決める前に、SKILL.md と SkillsMP に表示されている付属ファイルをお読みください。

ファイルエクスプローラー

27 ファイル

SKILL.md

ソースの指示 · 読み取り専用プレビュー

検索に戻るインストールに戻る

chain-patterns

Chain patterns for multi-phase pipelines: MCP detection, handoff files, checkpoint-resume, worktree agents, CronCreate monitoring. Use when building or debugging a pipeline skill.

2026-08-12

doctor

OrchestKit doctor for health diagnostics across manifest integrity, hook configuration, skill validation, agent frontmatter, MCP server connectivity, CC version compatibility, and permission rules. Reports issues with severity levels and auto-remediation suggestions. Validates component counts, detects orphaned entries, and checks CC version matrix compliance. Use when diagnosing plugin health, troubleshooting configuration issues, or running pre-release checks.

2026-08-12

telemetry-inspect

Inspects the OrchestKit telemetry pipeline for the current project — lists all known telemetry files with write counts, sizes, schema status, growth trend, and orphan detection. Use when verifying the observability pipeline is healthy, debugging a missing writer, or auditing which files have schema locks vs. which are drift-vulnerable. Read-only — never modifies telemetry files.

2026-08-12

このリポジトリのすべてを見る

Monitoring & Observability

A wrap around Prometheus, Grafana, OpenTelemetry and Langfuse, not a re-teaching of them. This skill carries OrchestKit's delta (version floors, house decisions, scars) and points at the vendor for everything else. Start at references/ork-delta.md.

Upstream coverage (do not restate)

These topics are fully covered first-party. Read the source, do not add a local copy.

Topic

First-party source

Prometheus metric types, RED method, cardinality, PromQL

https://prometheus.io/docs/practices/

Alertmanager grouping, inhibition, escalation, runbooks

https://prometheus.io/docs/alerting/latest/configuration/

Grafana dashboards, Loki and LogQL, Promtail

https://grafana.com/docs/

OpenTelemetry spans, sampling, context propagation

https://opentelemetry.io/docs/

Langfuse Python SDK (@observe, as_type, score_current_span, should_export_span, LangfuseMedia)

https://langfuse.com/docs/sdk/python

Langfuse v2 to v4 Python and v3 to v5 JS migration paths

https://langfuse.com/docs/sdk/python/v4-migration

Langfuse self-hosting (ClickHouse, Redis, S3, Helm)

https://langfuse.com/docs/deployment/self-host

Langfuse cost tracking, model pricing, Metrics API v2

https://langfuse.com/docs/model-usage-and-cost

Langfuse scores, online evaluators, annotation queues, prompt management

https://langfuse.com/docs/scores/overview

Langfuse framework integrations (LangChain, LangGraph, CrewAI, Pydantic AI, Bedrock, LiveKit)

https://langfuse.com/docs/integrations

Agent Graphs, observation types, rendered tool calls

Monitoring & Observability

Upstream coverage (do not restate)

These topics are fully covered first-party. Read the source, do not add a local copy.

Topic

First-party source

Prometheus metric types, RED method, cardinality, PromQL

https://prometheus.io/docs/practices/

Alertmanager grouping, inhibition, escalation, runbooks

https://prometheus.io/docs/alerting/latest/configuration/

Grafana dashboards, Loki and LogQL, Promtail

https://grafana.com/docs/

OpenTelemetry spans, sampling, context propagation

https://opentelemetry.io/docs/

Langfuse Python SDK (@observe, as_type, score_current_span, should_export_span, LangfuseMedia)

https://langfuse.com/docs/sdk/python

Langfuse v2 to v4 Python and v3 to v5 JS migration paths

https://langfuse.com/docs/sdk/python/v4-migration

Langfuse self-hosting (ClickHouse, Redis, S3, Helm)

https://langfuse.com/docs/deployment/self-host

Langfuse cost tracking, model pricing, Metrics API v2

https://langfuse.com/docs/model-usage-and-cost

Langfuse scores, online evaluators, annotation queues, prompt management

https://langfuse.com/docs/scores/overview

Langfuse framework integrations (LangChain, LangGraph, CrewAI, Pydantic AI, Bedrock, LiveKit)

https://langfuse.com/docs/integrations

Agent Graphs, observation types, rendered tool calls

name	monitoring-observability
license	MIT
compatibility	Claude Code 2.1.220+.
description	Monitoring and observability patterns for Prometheus metrics, Grafana dashboards, Langfuse v4 LLM tracing (as_type, score_current_span, should_export_span, LangfuseMedia), and drift detection. Use when adding logging, metrics, distributed tracing, LLM cost tracking, or quality drift monitoring.
tags	["monitoring","observability","prometheus","grafana","langfuse","tracing","metrics","drift-detection","logging"]
context	fork
version	3.0.0
author	OrchestKit
user-invocable	false
disable-model-invocation	true
complexity	medium
persuasion-type	reference
targets	[{"library":"langfuse","version":">=4.0.0"}]
upstream-version-tested	4.14.2
metadata	{"category":"document-asset-creation"}
allowed-tools	["Read","Glob","Grep","WebFetch","WebSearch"]
path_patterns	["/metrics/","/tracing/","prometheus.","grafana/*"]

name	monitoring-observability
license	MIT
compatibility	Claude Code 2.1.220+.
description	Monitoring and observability patterns for Prometheus metrics, Grafana dashboards, Langfuse v4 LLM tracing (as_type, score_current_span, should_export_span, LangfuseMedia), and drift detection. Use when adding logging, metrics, distributed tracing, LLM cost tracking, or quality drift monitoring.
tags	["monitoring","observability","prometheus","grafana","langfuse","tracing","metrics","drift-detection","logging"]
context	fork
version	3.0.0
author	OrchestKit
user-invocable	false
disable-model-invocation	true
complexity	medium
persuasion-type	reference
targets	[{"library":"langfuse","version":">=4.0.0"}]
upstream-version-tested	4.14.2
metadata	{"category":"document-asset-creation"}
allowed-tools	["Read","Glob","Grep","WebFetch","WebSearch"]
path_patterns	["/metrics/","/tracing/","prometheus.","grafana/*"]

Category	Rules	Impact	When to Use
Infrastructure Monitoring	1	CRITICAL	Grafana dashboards, Golden Signals, SLO/SLI
LLM Observability	1	HIGH	Langfuse tracing, observation types, agent graphs
Silent Failures	3	HIGH	Tool skipping, quality degradation, loop/token spike alerting

Rule	File	Key Pattern
Tool Skipping	`rules/silent-tool-skipping.md`	Expected vs actual tool calls, Langfuse traces
Quality Degradation	`rules/silent-degraded-quality.md`	Heuristics + LLM-as-judge, z-score baselines
Silent Alerting	`rules/silent-alerting.md`	Loop detection, token spikes, escalation workflow

Decision	Recommendation	Rationale
Metric methodology	RED method (Rate, Errors, Duration)	Industry standard, covers essential service health
Log format	Structured JSON	Machine-parseable, supports log aggregation
Tracing	OpenTelemetry	Vendor-neutral, auto-instrumentation, broad ecosystem
LLM observability	Langfuse (not LangSmith)	Open-source, self-hosted, built-in prompt management
LLM tracing API	`@observe(as_type=...)` + `score_current_span()`	v4: semantic types, inline scoring, span filtering
Langfuse APIs	Observations API v2 + Metrics API v2	v4 (Mar 2026): faster querying, aggregations at scale
Hook telemetry transport	JSONL under `~/.claude/analytics/`, never an SDK in-process	Hooks are per-event processes; SDK init would be paid on every spawn (`references/ork-delta.md`)

monitoring-observability

インストール方法

ソースファイルを確認