open-testing-management

name

open-testing-management

description

Test management, defect management, process evaluation, and maturity assessment using the MANAGES agent pipeline. Use this skill whenever the user mentions test management, defect management, process improvement, TMMi, maturity assessment, ARCI matrix, quality policy, test policy, process evaluation, defect lifecycle, triage, test process, roles and responsibilities, QAM, QPM, GTA, generic test agreements, process maturity, test improvement, or wants to evaluate and improve their testing practices. Also trigger for defect tracking, anomaly management, process compliance, test governance, or organizational testing capability. MANDATORY TRIGGERS: test management, defect management, TMMi, maturity, ARCI, process improvement, quality policy, defect lifecycle, process evaluation, test governance.

Open Testing Management (MANAGES)

Assess, govern, and improve test processes using TMMi maturity models, TMap organizing topics, and ISO 29119 process standards. The MANAGES pipeline evaluates current testing practices, identifies gaps, and generates improvement roadmaps.

Agent Pipeline

Agent 1: M_maturity — Maturity Assessor

Purpose: Assess test process maturity using the TMMi (Test Maturity Model integration) framework.

TMMi Levels:

Level	Name	Process Areas	Focus
1	Initial	—	Ad hoc, chaotic testing
2	Managed	Test Policy & Strategy, Test Planning, Test Monitoring & Control, Test Design & Execution, Test Environment	Basic test management
3	Defined	Test Organization, Test Training, Test Lifecycle & Integration, Non-Functional Testing, Peer Reviews	Standardized processes
4	Measured	Test Measurement, Product Quality Evaluation, Advanced Peer Reviews, Quality Control	Quantitative management
5	Optimization	Defect Prevention, Test Process Optimization, Quality Optimization	Continuous improvement

Assessment Procedure:

1. Load TMMi process areas from standards/tmmi.json (16 process areas, 113 practices)
2. For each process area, evaluate specific goals and specific practices
3. Rate each practice: Not Performed / Partially Performed / Largely Performed / Fully Performed
4. Calculate process area satisfaction (all specific goals must be satisfied)
5. Determine overall maturity level (all PAs at that level must be satisfied)
6. Generate gap analysis showing practices that need improvement

Output: TMMi Assessment Report (xlsx) with:

• Executive Summary and overall maturity level
• Per-process-area scoring with evidence
• Gap analysis with specific improvement actions
• Radar chart showing capability per process area
• Improvement roadmap with timeline

KB Files: standards/tmmi.json — 5 levels, 16 process areas, specific goals, specific practices

Agent 2: A_anomaly — Defect Lifecycle Manager

Purpose: Manage the complete defect lifecycle from logging through closure.

Defect Lifecycle States:

New → Assigned → In Progress → Resolved → Verified → Closed
                     ↓                        ↓
                 Deferred              Reopened → Assigned

Anomaly Administration Template (per IEEE 1044.1-1995):

Field	Description
Anomaly ID	Unique identifier
Title	Brief description
Severity	Critical / Major / Minor / Trivial
Priority	Immediate / High / Medium / Low
Status	Current lifecycle state
Found By	Tester name/ID
Found Date	Discovery date
Found In	Test level, build, environment
Assigned To	Developer/team responsible
Root Cause	Logic / Computation / Interface / Data / Documentation
Resolution	Fix description
Verified By	Tester who verified fix
Closed Date	Closure date

Triage Process:

1. Review new anomalies daily
2. Classify by severity and priority using IEEE 1044.1 classification scheme
3. Assign to appropriate developer/team
4. Set target resolution date based on priority
5. Track aging — escalate overdue anomalies

Agent 3: N_norming — Process Compliance Evaluator

Purpose: Evaluate test processes against recognized standards and generate compliance checklists.

Standards Evaluated:

• ISO/IEC/IEEE 29119-2: Test processes (organizational, management, fundamental)
• TMMi: Process areas and practices
• TMap: Organizing and performing topics
• IEEE 730-2014: SQA processes (16 activities in 3 groups)
• IEEE 1028-2008: Reviews and audits (5 types)

Process Evaluation Checklist Generation: For each standard, generate a checklist with:

• Process/Practice/Activity name
• Description of expected practice
• Evidence required
• Current status (Conformant / Partially Conformant / Non-Conformant / Not Applicable)
• Gap description and remediation action

KB Files: standards/iso-29119.json, standards/tmmi.json, standards/tmap.json, standards/ieee-standards.json

Agent 4: A_accountability_mgmt — Accountability Agent

Purpose: Define roles, responsibilities, and accountability using ARCI matrices and quality mappings.

ARCI Matrix (Accountable, Responsible, Consulted, Informed):

Activity	QA Manager	Test Lead	Test Analyst	Developer	Product Owner
Test Strategy	A	R	C	I	C
Test Planning	I	A	R	C	I
Test Design	I	C	A/R	C	I
Test Execution	I	C	A/R	I	I
Defect Triage	C	A	R	R	I
Release Advice	A	R	C	C	I

Quality Activity Matrix (QAM): Maps quality measures to activities Quality People Matrix (QPM): Maps quality measures to roles/people

Generate these matrices populated with project-specific context from user input.

Agent 5: G_governance_mgmt — Governance Agent

Purpose: Generate quality and test policies, generic test agreements (GTA), and process documentation.

Documents Generated:

1. Quality & Test Policy — Organization-level document defining testing principles, scope, objectives, and standards adherence. Aligned with TMap quality & test policy template.

2. Generic Test Agreements (GTA) — Standardized agreements defining:

   • Test levels and their boundaries
   • Entry and exit criteria per level
   • Defect severity/priority definitions
   • Communication protocols
   • Escalation procedures
   • Environment requirements

3. Test Process Description — Detailed process documentation aligned with ISO 29119-2:

   • Organizational test process
   • Test management process
   • Dynamic test processes (design, implementation, execution, completion)

Agent 6: E_efficiency — Efficiency Analyzer

Purpose: Analyze test process efficiency using quantitative metrics.

Efficiency Metrics:

Metric	Formula	Target	Interpretation
Defect Detection Effectiveness	(Defects found in testing / Total defects) × 100	>85%	Higher = better testing
Defect Removal Efficiency	(Defects removed before release / Total defects) × 100	>90%	Higher = fewer escapes
Test Execution Velocity	Test cases executed per tester per day	Varies	Higher = more efficient
Cost per Defect Found	Total test cost / Defects found	<$500	Lower = more efficient
Automation ROI	(Manual cost saved - Automation cost) / Automation cost	>200%	Higher = better ROI
Defect Leakage	(Post-release defects / Total defects) × 100	<10%	Lower = better
Test Case Effectiveness	Defects found per test case	>0.1	Higher = better test design
Review Effectiveness	Defects found per review hour	>1.0	Higher = more efficient

IEEE 982.2-1988 Measures Applied: Fault density (A1), Defect density (A2), Test coverage (A25), Defect removal efficiency (A39)

Agent 7: S_improvement — Improvement Planner

Purpose: Generate process improvement plans using TMMi improvement vectors.

Improvement Planning Procedure:

1. Start from M_maturity assessment results (current level and gaps)
2. Identify improvement actions for each unsatisfied practice
3. Prioritize using impact/effort matrix:
   • Quick Wins: High impact, low effort — implement immediately
   • Strategic: High impact, high effort — plan for next quarter
   • Fill-ins: Low impact, low effort — do when convenient
   • Deprioritize: Low impact, high effort — defer or skip
4. Create improvement roadmap with milestones and owners
5. Define success metrics for each improvement action

Improvement Roadmap Template:

#	Improvement Action	TMMi PA	Current State	Target State	Priority	Owner	Timeline	Success Metric
1	Implement test policy	Test Policy & Strategy	Not performed	Fully performed	Quick Win	QA Mgr	2 weeks	Policy approved
2	Standardize test design	Test Design & Execution	Partially	Largely	Strategic	Test Lead	3 months	80% techniques applied
3	Establish peer reviews	Peer Reviews	Not performed	Largely	Strategic	QA Mgr	2 months	100% deliverables reviewed

Knowledge Base

Located at /sessions/trusting-pensive-ptolemy/mnt/Open-Testing/knowledge-base/:

• terminology.json — 1105 terms including management terminology
• standards/tmmi.json — 5 maturity levels, 16 process areas, 113 practices
• standards/tmap.json — 11 organizing topics, 9 performing topics
• standards/iso-29119.json — Testing processes and documentation
• standards/ieee-standards.json — IEEE 730 (SQA), 829 (documentation), 1028 (reviews), 1044.1 (anomaly classification)
• supporting-materials.json — 20 course knowledge domains and exercise patterns

Read the xlsx skill at /sessions/trusting-pensive-ptolemy/mnt/.claude/skills/xlsx/SKILL.md before generating spreadsheets. Read the docx skill at /sessions/trusting-pensive-ptolemy/mnt/.claude/skills/docx/SKILL.md before generating documents.

Example Invocations

"Assess our testing maturity" → M_maturity TMMi assessment → N_norming standards compliance → E_efficiency metrics → S_improvement roadmap

"Set up defect management for our project" → A_anomaly lifecycle definition → G_governance GTA with severity/priority definitions → A_accountability ARCI matrix

"Help us improve our test process" → M_maturity current state → E_efficiency bottleneck analysis → S_improvement prioritized roadmap

"Create a quality policy for our organization" → G_governance quality & test policy → A_accountability roles/ARCI → N_norming standards alignment

Integration

• open-testing-design: Governance agent outputs feed into strategy design
• open-testing-reporting: Efficiency metrics feed into trend reports
• open-testing-coverage: Coverage data informs maturity assessment
• TMMi: Primary framework for maturity assessment (5 levels, 16 PAs)
• TMap: Organizing topics align with management activities