foundry-observability
Trace, monitor, and evaluate Microsoft Foundry agents — OpenTelemetry GenAI traces in Application Insights (KQL), eval↔trace correlation, azd ai agent monitor, dataset curation from prod traces, built-in quality + safety/RAI evaluators, batch evals, regression detection. Use for scenario evaluation and tracing.
Source facts
- Repository
- microsoft/frontier-agentic-cobuild-rvas
- Last source activity
- September 17, 2026 at 14:54
- Detected SKILL.md language
- English
- Stars
- 6
- Forks
- 4
Install options
The review-first prompt is selected by default. You can switch to a direct command or download a local copy.
Review the source files
Read SKILL.md and any companion files shown by SkillsMP before deciding whether to install.
Showing SKILL.md
SKILL.md
Source instructions · Read-only preview- name
- foundry-observability
- description
- Trace, monitor, and evaluate Microsoft Foundry agents — OpenTelemetry GenAI traces in Application Insights (KQL), eval↔trace correlation, azd ai agent monitor, dataset curation from prod traces, built-in quality + safety/RAI evaluators, batch evals, regression detection. Use for scenario evaluation and tracing.
# foundry-observability (stub)
> **Minimal stub** — pointer to the upstream [`microsoft/skills`](https://github.com/microsoft/skills)
> skill. Install on demand; do not vendor the full body (avoids context rot).
**Install the full skill:**
```bash
npx skills add microsoft/skills --skill foundry-observability
```
**Maps to:** Each scenario's evaluation and tracing lessons.
**Before implementing:** query `microsoft-docs` for current `AIProjectInstrumentor` /
`configure_azure_monitor` and `azure-ai-evaluation` signatures. **Gotcha:** set
`AZURE_EXPERIMENTAL_ENABLE_GENAI_TRACING=true` and `OTEL_INSTRUMENTATION_GENAI_CAPTURE_MESSAGE_CONTENT=true`
**before importing** the SDK. App Insights is provisioned by `azd up`
(`APPLICATIONINSIGHTS_CONNECTION_STRING` in `.env`).
**Upstream source:** `.github/plugins/microsoft-foundry/skills/foundry-observability/`
View on GitHub