| name | umbraco-skill-test-runner |
| description | Run tests from skill examples and generate a report (project) |
| version | 1.0.0 |
| location | managed |
| allowed-tools | Bash, Read, Glob |
Skill Test Runner
Runs all tests from skill examples (unit, mocked, E2E) and outputs a JSON report.
Usage
cd .claude/skills/umbraco-skill-test-runner/scripts
npm install --silent
npx tsx run-tests.ts
Test Types
| Type | Description | Runner |
|---|
| Unit | Component tests with @open-wc/testing | Web Test Runner |
| Mocked | Integration tests against mocked backoffice | Playwright |
| E2E | Full end-to-end against real Umbraco | Playwright |
Environment Variables
| Variable | Default | Description |
|---|
UMBRACO_USER_LOGIN | - | Admin email for E2E authentication |
UMBRACO_USER_PASSWORD | - | Admin password for E2E authentication |
UMBRACO_URL | https://localhost:44325 | Umbraco instance URL |
Auto-Start Umbraco
If E2E tests are needed and Umbraco is not running, the script will automatically:
- Start Umbraco from
./Umbraco-CMS.Skills/ using dotnet run
- Wait for the instance to be ready
- Run E2E tests
- Stop Umbraco when done (if it was started by the script)
Output
Generates test-report.json in the project root with structure:
{
"timestamp": "2024-12-26T12:00:00Z",
"umbracoStarted": true,
"summary": {
"total": 10,
"passed": 8,
"failed": 1,
"skipped": 1
},
"results": [
{
"example": "counter-dashboard",
"path": "plugins/umbraco-testing-skills/.../counter-dashboard",
"type": "unit",
"status": "passed",
"duration": 1234
}
]
}
Integration
This skill is Phase 3 of the validate-skills command, running after:
- Link validation (
umbraco-skill-validator)
- Code analysis (
umbraco-skill-code-analyzer)
