菜单
Validates the entire template stack works end-to-end — tests, Docker, infra, health checks. Use after making cross-layer changes, before PRs, or when verifying template integrity.
用 Codex 或 Claude 帮你安装 复制这段 Prompt，粘贴到 Codex、Claude 或其他助手里，让它检查 Skill 页面并帮你完成安装。
基于 SOC 职业分类
Reference for using and extending agentkit — YAML-driven agent specification loading and validation. Use when defining agent specs, loading YAML configs, extending AgentSpec with custom fields, or managing multiple agent configurations.
Reference for using and extending evalkit — evaluation framework with protocol-based evaluators, weighted rubric scoring, quality gates, and coaching moments. Use when creating custom evaluators, configuring rubrics, understanding scoring, or extending the evaluation framework.
Reference for using and extending foundrykit — Azure AI Foundry client, AgentManager, ToolRegistry, and FoundrySettings. Use when working with Azure AI credentials, creating/running agents, registering tools, or extending foundrykit for custom needs.
Validates performance and concurrency behavior of backend endpoints. Use when preparing for production, checking latency under load, or verifying system stability.
Confirms deployability and basic system health after deployment or container start. Use after azd deploy, docker compose up, or any deployment to verify the system is alive.
Reference for using and extending synthetickit — 3-stage synthetic data generation with scenarios, quality gates, and provenance tracking. Use when generating evaluation datasets, defining scenarios, writing custom generators/classifiers, or extending the pipeline.
| name | e2e-validation |
| description | Validates the entire template stack works end-to-end — tests, Docker, infra, health checks. Use after making cross-layer changes, before PRs, or when verifying template integrity. |
| argument-hint | Optionally specify which layers to validate (e.g., "backend only", "full stack") |
Step-by-step validation that every layer of the template works together. Run after any cross-cutting change.
cd py
uv sync --all-packages
Pass criteria: No errors. All workspace members resolve.
cd py
uv run pytest libs/ -v
Pass criteria: 100+ tests, 0 failures. Covers foundrykit, agentkit, evalkit, synthetickit, testkit.
cd py
uv run pytest apps/app-template/tests/ -v
Pass criteria: 3 tests pass (healthz, chat, stream).
cd py
uv run pytest apps/sample-eval-e2e/tests/ -v
Pass criteria: 13 tests pass (synthetic generation, evaluation pipeline, end-to-end integration).
cd py
uv run uvicorn --app-dir apps/app-template main:app --port 8001 &
sleep 3
curl -s http://localhost:8001/healthz | grep '"ok"'
curl -s -X POST http://localhost:8001/api/v1/chat \
-H "Content-Type: application/json" \
-d '{"message": "hello"}' | grep '"response"'
kill %1
Pass criteria: Health returns {"status": "ok"}, chat returns a response with Summary:.
cd ts
pnpm install
pnpm --filter ui-copilot-template lint
pnpm --filter ui-copilot-template typecheck
pnpm --filter ui-copilot-template test
pnpm --filter ui-copilot-template build
Pass criteria: All 4 commands succeed.
cp .env.example .env
docker compose up --build -d
sleep 20
curl -s http://localhost:8001/healthz | grep '"ok"'
curl -s http://localhost:5173 | grep -i "html"
docker compose down
Pass criteria: Backend healthcheck passes, frontend serves HTML.
cd infra
terraform init -backend=false
terraform validate
terraform fmt -check -recursive
Pass criteria: No errors, no formatting drift.
cd py
uv run ruff check .
Pass criteria: No lint errors.
If time-constrained, run at least:
cd py && uv sync --all-packages && uv run pytest libs/ apps/ -v
cd infra && terraform init -backend=false && terraform validate
This covers library integrity + infra syntax in ~30 seconds.
uv sync --all-packages succeeds