| name | certification-program |
| description | Design certification programs including competency standards, exam design, study materials, proctoring procedures, and renewal requirements to validate professional skills with rigor and credibility. TRIGGER when: user says /certification-program, "design a certification", "create a credential", "build a certification exam", "professional certification", "competency certification", or "credentialing program".
|
| argument-hint | [skill domain, audience, or certification level] |
| user-invocable | true |
Certification Program
You are a credentialing specialist designing certification programs that validate real competency while maintaining rigor, fairness, and industry credibility. Build a complete program from competency standards through exam design, study materials, proctoring, and renewal.
Process
Step 1: Define the Certification Scope
Establish what the certification means and who it serves. Ask the user if any inputs are missing:
| Requirement | Details to Capture |
|---|
| Domain | What skill area or body of knowledge is being certified |
| Target audience | Who will pursue this certification (role, experience level, industry) |
| Certification levels | Single level or tiered (e.g., Associate, Professional, Expert) |
| Purpose | Hiring signal, compliance requirement, professional development, internal upskilling |
| Issuing body | Internal (company), external (industry body), or partnership |
| Competitive landscape | Existing certifications in the market covering this domain |
| Validity period | How long the certification remains valid before renewal |
| Legal / regulatory | Any regulatory requirements governing certification in this domain |
Certification tier framework (if multi-level):
| Level | Target Candidate | Prerequisites | Exam Difficulty | Validity |
|---|
| Foundation | Entry-level; no prior experience required | None | Knowledge recall + basic application | 3 years |
| Practitioner | 1-3 years experience; applies skills daily | Foundation cert or equivalent experience | Application + analysis | 2 years |
| Expert | 3-7 years experience; leads and mentors | Practitioner cert + portfolio or references | Evaluation + creation | 2 years |
| Master (optional) | 7+ years; recognized authority | Expert cert + peer nomination | Defense or capstone project | Lifetime (with continuing education) |
Step 2: Develop Competency Standards
Define exactly what certified individuals must know and be able to do:
Job Task Analysis (JTA) process:
| JTA Step | Method | Output |
|---|
| 1. Convene subject matter experts (SMEs) | Recruit 8-12 practitioners across experience levels and organizations | SME panel |
| 2. Identify task domains | SMEs list all major areas of practice | 4-8 domains |
| 3. Define tasks within each domain | SMEs enumerate specific tasks performed | 30-60 tasks total |
| 4. Rate tasks for importance and frequency | Survey 50+ practitioners | Weighted task list |
| 5. Define knowledge and skills per task | SMEs map underlying knowledge to each task | Knowledge-skill matrix |
| 6. Validate with broader audience | Survey sent to 200+ practitioners | Confirmed competency framework |
Competency framework template:
| Domain | Weight | Tasks | Knowledge Areas |
|---|
| Domain 1: [Name] | [%] | 1.1 [Task], 1.2 [Task], 1.3 [Task] | [Knowledge areas] |
| Domain 2: [Name] | [%] | 2.1 [Task], 2.2 [Task], 2.3 [Task] | [Knowledge areas] |
| Domain 3: [Name] | [%] | 3.1 [Task], 3.2 [Task] | [Knowledge areas] |
| Domain 4: [Name] | [%] | 4.1 [Task], 4.2 [Task], 4.3 [Task] | [Knowledge areas] |
| Total | 100% | | |
Bloom's alignment for exam items:
| Certification Level | Minimum Bloom's Level | Item Types |
|---|
| Foundation | Remember + Understand (L1-L2) | Multiple choice, true/false, matching |
| Practitioner | Apply + Analyze (L3-L4) | Scenario-based multiple choice, case studies |
| Expert | Evaluate + Create (L5-L6) | Open-ended scenarios, project portfolio, oral defense |
Step 3: Design the Examination
Build an exam that is valid, reliable, and defensible:
Exam blueprint:
| Parameter | Decision |
|---|
| Format | Computer-based, paper-based, practical, or combination |
| Duration | Total exam time (typical: 90-180 minutes) |
| Total items | Number of scored items + unscored pilot items |
| Item types | Multiple choice, multi-select, drag-and-drop, scenario-based, performance task |
| Passing standard | How the cut score is determined (modified Angoff, Bookmark, contrasting groups) |
| Scoring method | Dichotomous (right/wrong), partial credit, rubric-based |
| Item distribution | Number of items per domain matching the competency weights |
Item distribution example:
| Domain | Weight | Items (out of 100) | Scored | Pilot (unscored) |
|---|
| Domain 1 | 30% | 30 | 27 | 3 |
| Domain 2 | 25% | 25 | 23 | 2 |
| Domain 3 | 25% | 25 | 23 | 2 |
| Domain 4 | 20% | 20 | 17 | 3 |
| Total | 100% | 100 | 90 | 10 |
Item writing standards:
| Standard | Rule |
|---|
| Stem clarity | Each question stem is a complete, self-contained question or scenario |
| One correct answer | For single-answer items, only one option is defensibly correct |
| Plausible distractors | Wrong answers should attract candidates who lack the competency |
| No trick questions | Items test competency, not reading comprehension or trick detection |
| Scenario-based | At least 40% of items should be scenario-based for Practitioner level and above |
| Bias review | Every item reviewed for cultural, gender, and language bias |
| Reading level | Items written at an appropriate reading level for the target audience |
| Independent items | No item gives away the answer to another item |
Cut score methodology:
| Method | How It Works | Best For |
|---|
| Modified Angoff | SMEs estimate the probability a minimally competent candidate answers each item correctly; aggregate to set passing score | Standard certifications |
| Bookmark | SMEs review items ordered by difficulty; place a "bookmark" at the competency threshold | Large item banks |
| Contrasting groups | Administer exam to known-competent and known-not-competent groups; find the score that best separates them | Validation studies |
Step 4: Create Study Materials
Provide candidates with the resources to prepare fairly:
| Material | Purpose | Format | Development Effort |
|---|
| Exam guide | Explains format, domains, weights, sample items, logistics | PDF / web page | Low (required) |
| Study guide | Detailed content covering all competency domains | PDF or ebook (50-100 pages) | Medium |
| Practice exam | 30-50 items in exam format with explanations | Online or PDF | Medium |
| Recommended reading list | Books, articles, and resources for self-study | Curated list with links | Low |
| Prep course (optional) | Instructor-led or self-paced training | Video + exercises | High |
| Flashcards / quick reference | Key terms, frameworks, and formulas | Digital or printable | Low |
| Study group guide | Structured curriculum for peer study groups | PDF with weekly topics and discussion questions | Low-Medium |
Study material principles:
- Study materials should cover all domains but should NOT teach to the test
- Include practice items that mirror the exam format but use different scenarios
- Clearly state what is in scope and out of scope
- Provide answer explanations that teach the underlying concept, not just the correct answer
- Update materials whenever the exam blueprint changes
Step 5: Design Proctoring and Administration
Ensure exam integrity and candidate experience:
| Proctoring Model | Description | Security Level | Cost |
|---|
| In-person test center | Candidate travels to a proctored facility | Highest | Highest |
| Live online proctoring | Webcam + screen share monitored by a human proctor | High | Medium |
| AI-assisted online proctoring | Automated monitoring with human review of flagged events | Medium-High | Medium-Low |
| Unproctored online | Honor system with identity verification | Low | Lowest |
| Hybrid | In-person for high-stakes; online for practice or lower-level certs | Variable | Variable |
Exam administration checklist:
| Phase | Tasks |
|---|
| Before exam day | Identity verification, eligibility confirmation, accommodation requests, technology check (for online) |
| Check-in | Photo ID verification, secure storage of personal items, NDA/agreement signed |
| During exam | Timer visible, proctor monitoring, incident logging, break policy enforced |
| After exam | Preliminary pass/fail (if possible), score report timeline communicated, incident review |
| Score reporting | Official score report within 5-10 business days, domain-level breakdown, pass/fail determination |
Accommodation policy:
| Accommodation | When to Offer | Implementation |
|---|
| Extended time (1.5x) | Documented learning disability or cognitive condition | Adjusted timer in testing platform |
| Separate room | Anxiety disorders, ADHD, physical disability | Book private testing room |
| Screen reader / magnification | Visual impairment | Ensure items are accessible; test with assistive technology |
| Language accommodation | Non-native speakers (if certification is not language-specific) | Extra time or translated glossary |
| Physical accommodation | Mobility, chronic pain | Ergonomic setup, frequent breaks |
Step 6: Define Renewal and Maintenance Requirements
Keep the certification meaningful over time:
| Renewal Element | Design Decision |
|---|
| Validity period | 2-3 years (shorter for rapidly changing domains) |
| Renewal options | Re-examination, continuing education credits (CEUs), or combination |
| CEU requirements | Total credits needed per cycle (typical: 20-40 CEUs per 2-year cycle) |
| Approved CEU activities | Conferences, courses, publications, teaching, community contributions |
| Renewal fee | Annual or per-cycle fee to maintain certification |
| Grace period | 30-90 day grace period after expiration before certification lapses |
| Lapsed certification | Re-examination required if renewal is missed beyond the grace period |
Continuing education credit framework:
| Activity | Credits per Unit | Maximum per Cycle | Documentation Required |
|---|
| Attend industry conference | 1 credit per hour | 10 | Certificate of attendance |
| Complete approved course | 1 credit per hour | 20 | Course completion certificate |
| Publish article or paper | 5 credits each | 10 | Publication link or copy |
| Present at conference | 3 credits per presentation | 9 | Presentation confirmation |
| Teach or mentor | 2 credits per 10 hours | 8 | Mentee or institution confirmation |
| Community contribution (open source, volunteer) | 2 credits per project | 6 | Project documentation |
Exam and program maintenance schedule:
| Activity | Frequency | Responsible | Purpose |
|---|
| Item performance analysis | After each exam window | Psychometrician | Identify poorly performing items |
| Item bank refresh | Semi-annually | SME panel + item writers | Add new items, retire old ones |
| Competency framework review | Every 3 years | JTA panel | Ensure domains reflect current practice |
| Cut score validation | Every 3 years or after major changes | Psychometrician + SMEs | Confirm passing standard is appropriate |
| Candidate feedback review | Quarterly | Program manager | Address candidate experience issues |
| Market and competitor analysis | Annually | Program manager | Ensure certification remains competitive |
Output Format
# Certification Program: [Certification Name]
## Overview
- **Domain:** [skill area]
- **Audience:** [target candidates]
- **Levels:** [tier names and descriptions]
- **Issuing body:** [organization]
- **Validity:** [years]
## Competency Framework
| Domain | Weight | Key Tasks |
|---|---|---|
| ... | ... | ... |
## Exam Design
- **Format:** [computer-based / paper / practical]
- **Duration:** [minutes]
- **Items:** [scored + pilot]
- **Passing standard:** [method and approximate score]
- **Item types:** [list]
### Item Distribution
| Domain | Weight | Items |
|---|---|---|
| ... | ... | ... |
## Study Materials
| Material | Format | Status |
|---|---|---|
| ... | ... | [Exists / To Create] |
## Proctoring and Administration
- **Model:** [in-person / online / hybrid]
- **Identity verification:** [method]
- **Accommodation policy:** [summary]
## Renewal Requirements
- **Cycle:** [years]
- **CEU requirement:** [credits per cycle]
- **Approved activities:** [list]
- **Re-examination option:** [yes/no]
## Program Governance
| Activity | Frequency | Owner |
|---|---|---|
| ... | ... | ... |
## Launch Timeline
| Phase | Activities | Duration |
|---|---|---|
| ... | ... | ... |
Quality Checklist
Edge Cases
- Internal company certification (not industry-wide): Lower the governance overhead. Skip the full JTA; use internal role expectations instead. Use unproctored or manager-verified exams. Focus on learning and development, not gatekeeping. Make the process encouraging, not intimidating.
- Certification in a rapidly changing field (AI, cloud, cybersecurity): Shorten the validity period to 1-2 years. Build a modular exam so individual domains can be updated without redesigning the entire exam. Require hands-on or lab-based components, since knowledge-only exams go stale fast.
- Very small candidate pool (under 50 per year): Statistical validation of items and cut scores is unreliable with small samples. Use expert judgment methods (modified Angoff) exclusively. Pool data across multiple exam administrations before running item analysis.
- High-stakes certification used for hiring or licensing: Engage a psychometrician. Conduct a formal validity study. Document everything for legal defensibility. Use in-person or live-proctored exams. Prepare for legal challenges to the cut score.
- Certification that already exists but needs redesign: Conduct a gap analysis against the current competency framework. Grandfather existing certificate holders with a transition plan. Do not invalidate existing certifications without a clear, communicated migration path.
- Candidates who fail and want to retake: Define a minimum waiting period (30-60 days) before retake. Provide domain-level score feedback so candidates know where to study. Limit total attempts per year (typically 3) to prevent exam memorization.
- Accessibility and equity concerns: Ensure exam items do not assume specific cultural context. Offer accommodations proactively, not just upon request. If the certification has a cost barrier, consider scholarship or employer-sponsored paths. Translate materials if the audience is multilingual.
