Arize-ai/arize-skills

ملف Arize-ai

آخر نشاط مصدر مسجل: ١٦ أكتوبر ٢٠٢٦ في ٢٣:١٥

آخر تحديث لفهرس SkillsMP: ٢٦ أكتوبر ٢٠٢٦ في ١١:٣٧

skills مجمعة: ١٨

نجوم GitHub: ٦٥
تفرعات GitHub: ١٤

ملف README للمستودع

مصدر ملف README للمستودع: README.md

قراءة الملف الأصلي

عرض ملف README كاملًا

# Arize Skills Skills that guide AI coding agents to help you add observability, run experiments, and optimize prompts for your LLM applications. These skills encode the workflows we've refined building the [Arize](https://arize.com) platform and helping teams debug LLM apps in production. They handle the `ax` CLI flags, data shape quirks, and multi-step recipes so you don't have to. Works with Cursor, Claude Code, Codex, GitHub Copilot, Windsurf, Devin, and [40+ other agents](https://github.com/vercel-labs/skills#supported-agents). ## New to Arize? Start Here **Adding tracing to your app** — give your coding agent this prompt: > Install Arize skills from https://github.com/Arize-ai/arize-skills and use the arize-instrumentation skill to add tracing to this application. The agent installs the skills, instruments your app, and verifies a trace reaches Arize AX — all in one session. You'll just need to provide your Arize credentials and approve the code changes. **Already have traces?** Give your agent this prompt to install the skills and start debugging: > Install Arize skills from https://github.com/Arize-ai/arize-skills, then use the arize-trace skill to export and analyze recent traces from my project. Summarize any errors or latency issues you find. ## Installation ### Option 1: npx (recommended) Install all skills non-interactively — this is what the agent runs for the prompt above: ```bash npx skills add Arize-ai/arize-skills --skill "*" --yes ``` Want to hand-pick skills, agent, and scope yourself? Drop the flags for the interactive wizard: ```bash npx skills add Arize-ai/arize-skills ``` Both auto-detect your agent (Cursor, Claude Code, Codex, etc.) and symlink skills into place. ### Option 2: git clone **macOS / Linux:** ```bash git clone https://github.com/Arize-ai/arize-skills.git cd arize-skills ./install.sh --project ~/my-project ``` **Windows (PowerShell):** ```powershell git clone https://github.com/Arize-ai/arize-skills.git cd arize-skills .\install.ps1 -Project ~\my-project ``` The installer detects installed agents and optionally installs the `ax` CLI. Use `--global` / `-Global` instead to install to `~/.<agent>/skills/`. ### Option 3: ax CLI If you already have `ax` installed (v0.39.0+): ```bash ax skills install # interactive ax skills install --agent claude-code --yes # non-interactive, Claude only ax skills install --global --agent cursor --yes # globally for Cursor ax skills clear --yes # remove Arize skills ``` Use `--agent` (repeatable) to target specific agents: claude-code, cursor, codex, windsurf. Pass `--global` to install globally in `~/.<agents>/skills/` instead of your project, or `--yes` to skip confirmations. ### Option 4: Claude Code plugin Open up a Claude Code session and execute the following: ``` /plugin marketplace add Arize-ai/arize-skills /plugin install arize-skills@arize-skills ``` ### Option 5: Devin For Devin Desktop and the Devin CLI, install the repo as a Devin plugin: ```bash devin plugins install Arize-ai/arize-skills ``` Then set up `ax` as described in [Prerequisites](#prerequisites). See the [Devin install guide](guides/devin.md) for details. ## Prerequisites ### Arize CLI (`ax`) The skills use the `ax` CLI to interact with the Arize API. Install it if you don't have it: ```bash # Preferred (isolated environment) uv tool install arize-ax-cli # or pipx install arize-ax-cli # Fallback pip install arize-ax-cli ``` ### Authentication **Option A — `ax` CLI profile** (recommended): Set up your API key once and it persists across all sessions and projects: ```bash # Interactive wizard (creates 'default' profile if no profiles exist) ax profiles create # Or pass the key directly (optional profile name as positional arg) ax profiles create --api-key YOUR_API_KEY ax profiles create staging --api-key YOUR_STAGING_KEY # Update an existing profile (patches only what you specify) ax profiles update --api-key NEW_API_KEY ax profiles update --region us-east-1b # Other profile management ax profiles list ax profiles show ax profiles use staging ax profiles delete staging ``` You'll also need a space name or ID. Find yours by running `ax spaces list -o json` (use the `name` or base64 `id`), then persist it: ```bash # macOS/Linux — add to ~/.zshrc or ~/.bashrc export ARIZE_SPACE="my-workspace" # name, or base64 ID like U3BhY2U6... ``` **Option B — Environment variables**: ```bash export ARIZE_API_KEY="your-api-key" # from https://app.arize.com/admin > API Keys export ARIZE_SPACE="my-workspace" # space name or base64 ID from ax spaces list # export ARIZE_DEFAULT_PROJECT=my-project # optional default project # export OPENAI_API_KEY="sk-..." # for AI integrations and evaluators # export ANTHROPIC_API_KEY="sk-ant-..." # for AI integrations and evaluators ``` ### Verify ```bash ax --version && ax profiles show 2>&1 ``` ### On-prem / self-hosted Arize Point the CLI at your deployment with a **single-endpoint** profile (hostname and HTTPS port, usually `443`). Replace the host with the value your operations team provides: ```bash ax profiles create my-onprem --api-key <key> --single-host arize.yourcompany.com --single-port 443 ax profiles use my-onprem ax profiles validate ``` For interactive setup, `ax profiles create` also offers **Advanced → Single endpoint**. More options (TOML, Flight/OTLP splits) are documented in the [arize-ax-cli README](https://github.com/Arize-ai/arize-ax-cli/blob/main/README.md#on-premise-deployments). ## Available Skills | Skill | Description | |-------|-------------| | [arize-trace](skills/arize-trace/SKILL.md) | Export traces and spans by trace ID, span ID, or session ID. Debug LLM application issues. | | [arize-phoenix-migration](skills/arize-phoenix-migration/SKILL.md) | Migrate Phoenix project traces into Arize AX, preserve historical IDs and timestamps, and verify imported spans. | | [arize-instrumentation](skills/arize-instrumentation/SKILL.md) | Add Arize AX tracing to an app. Two-phase flow: analyze codebase, then implement instrumentation (uses [Agent-Assisted Tracing](https://arize.com/docs/ax/set-up-with-ai-assistants)). | | [arize-span-routing](skills/arize-span-routing/SKILL.md) | Send each agent's or tenant's Python spans to its correct Arize space and project using application metadata. | | [arize-dataset](skills/arize-dataset/SKILL.md) | Create, manage, and download datasets and examples. | | [arize-experiment](skills/arize-experiment/SKILL.md) | Run and analyze experiments against datasets. | | [arize-evaluator](skills/arize-evaluator/SKILL.md) | Create LLM-as-judge evaluators, run evaluation tasks, and set up continuous monitoring. | | [arize-ai-provider-integration](skills/arize-ai-provider-integration/SKILL.md) | Create and manage LLM provider credentials (OpenAI, Anthropic, Azure, Bedrock, Vertex, and more). | | [arize-annotation](skills/arize-annotation/SKILL.md) | Create and manage annotation configs (categorical, continuous, freeform); bulk-annotate project spans via the Python SDK. | | [arize-prompt-optimization](skills/arize-prompt-optimization/SKILL.md) | Optimize prompts using trace data, experiments, and meta-prompting. | | [arize-prompts](skills/arize-prompts/SKILL.md) | Manage Prompt Hub templates and versions with `ax prompts` (create, versions, labels). | | [arize-link](skills/arize-link/SKILL.md) | Generate deep links to traces, spans, and sessions in the Arize UI. | | [arize-compliance-audit](skills/arize-compliance-audit/SKILL.md) | Audit an AI agent for regulatory compliance (EU AI Act, NIST AI RMF, GDPR, HIPAA). Produces a tailored remediation checklist. | | [arize-admin](skills/arize-admin/SKILL.md) | Manage organizations, spaces, roles, role bindings, resource restrictions, and API keys. Enterprise admin workflows: team onboarding, SAML/SSO role mapping, service key management, and access control. | | [arize-migrate-langfuse](skills/arize-migrate-langfuse/SKILL.md) | Migrate from Langfuse to Arize AX: historical trace import (OTLP), dataset import, prompt/evaluator recreate, optional live cutover. | | [arize-migrate-langsmith](skills/arize-migrate-langsmith/SKILL.md) | Migrate from LangSmith to Arize AX: historical trace import (OTLP), dataset import, prompt/evaluator recreate, optional live cutover. | | [arize-migrate-braintrust](skills/arize-migrate-braintrust/SKILL.md) | Migrate from Braintrust to Arize AX: historical trace import (OTLP), dataset import, prompt/evaluator recreate, optional live cutover. | > [!WARNING] > **arize-compliance-audit is for guidance only and does not constitute legal advice or a complete compliance assessment.** It identifies common technical patterns based on publicly available regulatory frameworks and cannot account for your organisation's specific legal obligations, contractual commitments, or operational context. Always consult a qualified attorney or compliance specialist for binding assessments. ## Installer Flags **Bash (`install.sh`):** | Flag | Description | |------|-------------| | `--project <dir>` | **Required.** Target project directory for skill symlinks | | `--global` | Install to `~/.<agent>/skills/` instead (alternative to `--project`) | | `--copy` | Copy files instead of symlinking | | `--force` | Overwrite existing skills | | `--skip-cli` | Don't install `ax` CLI even if missing | | `--agent <name>` | Manually specify agent (cursor, claude, codex, copilot) — repeatable | | `--skill <name>` | Only install/uninstall specific skills — repeatable (e.g. `--skill arize-trace --skill arize-dataset`) | | `--yes` | Skip confirmation prompts | | `--list` | List all available skills and exit | | `--uninstall` | Remove previously installed skill symlinks | **PowerShell (`install.ps1`):** | Flag | Description | |------|-------------| | `-Project <dir>` | **Required.** Target project directory for skill symlinks | | `-Global` | Install to `~/.<agent>/skills/` instead (alternative to `-Project`) | | `-Copy` | Copy files instead of symlinking | | `-Force` | Overwrite existing skills | | `-SkipCli` | Don't install `ax` CLI even if missing | | `-Agent <name>` | Manually specify agent (cursor, claude, codex, copilot) — repeatable | | `-Skill <name>` | Only install/uninstall specific skills — repeatable | | `-Yes` | Skip confirmation prompts | | `-Uninstall` | Remove previously installed skill symlinks | | `-List` | List all available skills and exit | ## Updating - **npx path:** `npx skills update` - **git clone path:** `cd arize-skills && git pull` (symlinks update automatically) ## Testing Skills `tests/run_skill.py` is an interactive test harness that runs a skill end-to-end using the Claude Agent SDK. It creates a temporary workspace, passes in your Arize credentials, and streams the agent's output. Export the required environment variables before running: ```bash export ARIZE_API_KEY="your-api-key" # from https://app.arize.com/admin > API Keys export ARIZE_SPACE="my-workspace" # space name or base64 ID from ax spaces list export TEST_PROJECT_NAME="my-project" # optional: Arize project for trace tests export TEST_MODEL="claude-sonnet-4-6" # optional: Claude model override ``` Then run the harness: ```bash python tests/run_skill.py --skill arize-trace --prompt "Export trace abc123" ``` > [!WARNING] > **Configure `.claude/settings.json` before running the test harness** > > The test harness uses Claude Code's `bypassPermissions` mode, which **skips all interactive > approval prompts**. This is safe because the agent runs in a sandboxed temporary workspace — > but **only** if your `settings.json` has a denylist blocking dangerous shell commands. > > **Without this, `bypassPermissions` gives the agent unrestricted shell access.** > > Add the following to `.claude/settings.json` in this repo (create it if it doesn't exist): > > ```json > { > "permissions": { > "deny": [ > "Bash(rm -rf*)", > "Bash(curl*)", > "Bash(wget*)", > "Bash(ssh*)", > "Bash(scp*)", > "Bash(git push*)", > "Bash(sudo*)", > "Bash(chmod*)", > "Bash(chown*)" > ] > } > } > ``` ## Links - [Arize Documentation](https://docs.arize.com) - [Arize REST API Reference](https://docs.arize.com/arize/api-reference/rest-api) - [ax CLI (arize-ax-cli)](https://github.com/Arize-ai/arize-ax-cli) - [OpenInference Semantic Conventions](https://github.com/Arize-ai/openinference) ## License MIT

جارٍ تحميل ملف README للمستودع…

Skills في هذا المستودع

مطوّرو البرمجيات محللو التمويل والاستثمار

٢ فئات مهنية · 22% مصنفة

محللو التمويل والاستثمار

INVOKE THIS SKILL when auditing an AI agent or LLM app for regulatory compliance. Covers EU AI Act, GPAI Code of Practice, GDPR, NIST AI RMF, Colorado AI Act, HIPAA, and ISO 42001. Scans the codebase for compliance gaps, cross-references Arize instrumentation…

لغة النص الأصلي: الإنجليزية

2026-07-15

عرض ١٨ من أصل ١٨ skills مجمعة.

التثبيت بمساعدة مساعد ذكي

انسخ هذا الطلب إلى المساعد الذكي الذي تستخدمه.

Follow https://skillsmp.com/skill-install/prompt.md to install Agent Skills from https://github.com/Arize-ai/arize-skills.