| name | aipom-adoption-impact-scorecard |
| description | Measure whether AI operating practices change behavior, decisions, workflows, reuse, outcomes, burden, and risk rather than merely increasing activity. |
| type | component |
| category | capability-adoption-and-reuse |
| phase | 4 |
| status | active |
| operating_level | ["organization","portfolio","product-team"] |
| audience | ["CPO","Product Operations","Product Manager","Team Lead","Finance","Enablement","People Operations","AI Governance"] |
| best_for | ["Evaluating learning or adoption investment","Replacing license and login metrics","Deciding whether a practice should scale change or stop"] |
| evidence_required | ["Target behavior and workflow baselines","Usage and applied-work evidence","Decision outcome burden and risk measures","Comparison and attribution evidence"] |
| produces | ["Adoption impact scorecard","Evidence and attribution notes","Scale revise reinforce or retire decision rules"] |
| assessment_questions | ["CAP-02","CAP-03","CAP-04","CAP-05","WFL-05"] |
| maturity_move | {"from":"operationalized","to":"compounding"} |
| estimated_time | 60-120 min |
| group_size | 3-8 |
| depends_on | ["role-based-aipom-competency-map"] |
| combine_with | ["aipom-learning-system-designer","aipom-production-evidence-review","aipom-operating-model-retrospective"] |
| sources | [] |
AIPOM Adoption Impact Scorecard
What Is It
Measure the chain from access and participation through applied behavior, workflow change, decision quality, reuse, product or business outcomes, burden, and risk. Attach each measure to a decision about reinforcement, revision, scale, or retirement.
Why Use It
Licenses, logins, prompts, attendance, and generated artifacts show activity. They do not show whether people use a practice responsibly, make better decisions, improve outcomes, or create hidden review and support costs.
When to Use It
Use before launching a capability or adoption program so baselines exist, and during recurring reviews. Scope measures to a named practice, role, workflow, and outcome.
What It Produces
- Adoption-to-impact causal chain
- Leading, behavioral, workflow, outcome, burden, risk, and reuse measures
- Baselines, segments, evidence quality, and attribution notes
- Reinforce, revise, scale, constrain, or retire decision rules
Who Should Participate
Include the practice owner, Product Operations, practitioners, workflow and outcome owners, analytics or finance, enablement, managers, and governance partners.
Evidence to Bring
Bring target behaviors, competency and workflow baselines, usage with context, work artifacts, decisions, outcomes, support burden, review labor, incidents, reuse, comparison groups or periods, and participant feedback.
How to Do It
- Name the practice, roles, workflow, outcome, owner, and decision horizon.
- Map the causal chain from availability to use, competent behavior, workflow change, and outcome.
- Choose the few measures that test each consequential link.
- Establish baselines, segments, comparison, cadence, and data limitations.
- Include quality, decision, outcome, burden, risk, and reuse countermeasures.
- Distinguish exposure, adoption, proficiency, consistency, and impact.
- Record attribution confidence and alternative explanations.
- Define reinforce, revise, scale, constrain, or retire thresholds.
- Assign collection, interpretation, decision, and improvement ownership.
Key Concepts
- Use is not competence; competence is not impact.
- Countermeasures reveal displaced work and hidden harm.
- Attribution should match the evidence design.
- A scorecard is complete only when results change a decision.
Organizational Applications
Use for learning systems, workflow playbooks, agent adoption, context practices, evaluation routines, governance controls, communities, and reusable skill libraries.
Common Pitfalls
- Reporting logins as adoption
- Measuring only enthusiasts
- Omitting review and support burden
- Claiming causality from a before-and-after chart
- Combining unlike roles or workflows
- Keeping a program because participation is high
Combine With
Use aipom-learning-system-designer to change capability, aipom-production-evidence-review for product behavior, and aipom-operating-model-retrospective for cross-system learning.
Assets and Templates
Sources
This skill is an original AIPOM synthesis of behavior change, workflow measurement, causal product metrics, adoption, and evaluation practice.
