opendatahub-io/odh-test-gen

test-plan-create

Generate a test plan from a strategy (RHAISTRAT or RHOAIENG issue), with optional ADR for extra technical depth. Use when starting test planning for a new RHOAI feature with a defined Jira strategy.

원문 언어: 영어

test-plan-generate-test-file

Generate one complete test file with all functions for assigned test cases, including quality scoring and auto-revision

원문 언어: 영어

test-plan-publish

Publish test plan artifacts to GitHub — creates a branch, commits all artifacts, and opens a PR with optional reviewer assignment. Use after test plan review to make artifacts available for team collaboration and formal review feedback.

원문 언어: 영어

test-plan-review

Reviews a generated test plan for completeness, consistency, and quality using a 5-criteria rubric. Scores, auto-revises, and re-scores (max 2 cycles). Use for automated quality assessment and iterative improvement of generated test plans.

원문 언어: 영어

test-plan-score

Score an existing test plan using the quality rubric without triggering auto-revision. Use for standalone quality assessment of test plans or evaluating test plans created outside the automated generation pipeline.

원문 언어: 영어

test-plan-score-test-function

Score generated test function code for completeness, quality, and convention adherence using a 5-criteria rubric. Use for validating generated test code quality before including in the final implementation.

원문 언어: 영어

test-plan-create-cases

Generate individual test case files from an existing test plan. Use after test plan approval to generate individual TC specifications with preconditions, steps, and expected results organized by category and priority.

원문 언어: 영어

test-plan-case-implement

Generate executable test automation code from test case specifications (default target: opendatahub-tests; override with --target-repo). Skips TC-UI-*. Use after test cases are reviewed to create production-ready pytest code that follows repository…

원문 언어: 영어

test-plan-resolve-feedback

Assess PR review comments on a published test plan, let the user decide what to apply, make changes, and push updates to the same branch. Use when receiving PR review feedback to efficiently apply approved changes with human control over what gets updated.

원문 언어: 영어

test-plan-ui-verify

Browser-based UI test execution against live ODH/RHOAI clusters. Loads TCs from a GitHub PR or repo folder via ui_prepare.py, executes each via a persistent Playwright browser, and produces a visual HTML report with PASS/FAIL/BLOCKED/INCOMPLETE verdicts and…

원문 언어: 영어

test-plan-analyze-endpoints

Analyzes strategy and ADR to extract feature scope, AC-traced test objectives, and interfaces under test. Use for extracting technical scope and e2e test surface from requirements documents.

원문 언어: 영어

test-plan-analyze-infra

Analyzes strategy and ADR to identify test environment configuration, test data, test users, infrastructure, and tooling requirements. Use for determining test execution prerequisites and infrastructure setup needs.

원문 언어: 영어

test-plan-analyze-risks

Analyzes strategy and ADR to determine test levels, test types, priority definitions, non-functional requirements, and risks with mitigations. Use for identifying what needs testing, how to prioritize test coverage, and what risks to mitigate.

원문 언어: 영어

test-plan-update

Update an existing test plan with new documentation (ADR, API specs, design docs). Re-analyzes, updates artifacts, bumps version, and optionally regenerates test cases. Use when requirements evolve or new technical documentation becomes available after…

원문 언어: 영어

test-plan-merge

Intelligently merge new analyzer findings into an existing test plan, preserving user edits while incorporating updates from new documentation. Use for test plan updates when re-analysis produces new findings that need to be integrated without overwriting…

원문 언어: 영어

test-plan-resolve-gaps

Cross-reference existing test plan gaps with new analyzer findings and documentation to determine which gaps are resolved and which remain open. Use after adding new documentation to identify what questions have been answered and what's still missing.

원문 언어: 영어