| name | Wellbeing Psychometrics & Measurement |
| description | Design and interpret validated psychometric instruments for measuring wellbeing outcomes. Use when creating measurement frameworks, selecting assessment tools, designing surveys, or analyzing wellbeing data. Covers reliable scales with strong psychometric properties for research and evaluation. |
Wellbeing Psychometrics & Measurement
Rigorous measurement of wellbeing requires validated instruments with strong psychometric properties. This skill guides selection, implementation, and interpretation of evidence-based measurement tools.
Core Psychometric Principles
Validity Types
- Construct Validity: Does the instrument measure what it claims to measure?
- Criterion Validity: Does it predict relevant outcomes?
- Content Validity: Does it comprehensively cover the domain?
- Discriminant Validity: Does it distinguish from related but different constructs?
Reliability Indicators
- Cronbach's Alpha: Internal consistency (0.7-0.9 is acceptable, 0.6+ for exploratory)
- Test-Retest Reliability: Stability over time (typically ICC > 0.7)
- Inter-rater Reliability: Agreement between raters (Cohen's kappa, ICC)
Measurement Model Fit
- CFI/TLI: Comparative fit indices (>0.90 is good)
- RMSEA: Root Mean Square Error of Approximation (<0.08 is acceptable)
- SRMR: Standardized Root Mean Square Residual (<0.08 is good)
Validated Wellbeing Instruments
Multidimensional Wellbeing Scales
PERMA-Profiler (Kern et al., 2015)
Structure: 23 items across 6 domains
- Positive Emotion (hedonic wellbeing)
- Engagement (flow, absorption)
- Relationships (social connection)
- Meaning (life purpose)
- Accomplishment (achievement, mastery)
- Negative Emotion (reverse-scored)
Strengths: Brief, validated across cultures, theory-grounded (Seligman's PERMA model)
Use for: General wellbeing assessment, product/experience evaluation
Psychometrics: α ≈ 0.70-0.85 across domains
Administration: 5-10 minutes
Personal Wellbeing Index (PWI-8) (International Wellbeing Group)
Structure: 8 life satisfaction domains
- Standard of living
- Health
- Life achievement
- Personal relationships
- Personal safety
- Community connectedness
- Future security
- Life satisfaction (overall)
Strengths: Short, universal, used in major population studies
Use for: Population-level monitoring, longitudinal tracking
Psychometrics: α ≈ 0.80-0.85
Administration: 3-5 minutes
Hedonic & Eudaimonic Wellbeing
Scale of Positive and Negative Experience (SPANE) (Diener et al., 2010)
Structure: 12 items in 2 factors
- Positive experiences (positive, negative reversed, good, bad reversed, etc.)
- Negative experiences (negative, worried, sad, etc.)
Strengths: Brief, captures both dimensions, good cross-cultural validity
Use for: Affective wellbeing, emotional state tracking
Psychometrics: α ≈ 0.81-0.89
Administration: 2-3 minutes
Meaning in Life Scale (MLQ) (Steger et al., 2006)
Structure: 5 items in 2 dimensions
- Presence of meaning
- Search for meaning
Strengths: Concise eudaimonic measure, validated widely
Use for: Purpose and meaning assessment
Psychometrics: α ≈ 0.73-0.90
Administration: 2 minutes
Flourishing & Flourishing Specific Scales
Psychological Wellbeing Scale (PWB-18) (Ryff, 1989)
Dimensions: 6 core elements (3 items each)
- Autonomy
- Competence (mastery)
- Personal growth
- Purpose in life
- Positive relationships
- Self-acceptance
Strengths: Theoretically grounded in human potential, eudaimonic focus
Use for: Comprehensive psychological wellbeing assessment
Psychometrics: α ≈ 0.83-0.87
Administration: 10-15 minutes
Flourishing Scale (FS) (Diener et al., 2009)
Structure: 8 items across psychological flourishing
- Purpose, engagement, relationships, competence, optimism, self-respect
Strengths: Brief, robust factor structure, used widely in research
Use for: General flourishing assessment
Psychometrics: α ≈ 0.87-0.90
Administration: 3 minutes
Domain-Specific Measures
Satisfaction With Life Scale (SWLS) (Diener et al., 1985)
Structure: 5 items measuring global life satisfaction
Strengths: Gold standard for life satisfaction, extensive validation
Psychometrics: α ≈ 0.79-0.89
Administration: 2 minutes
UCLA Loneliness Scale (ULS-8) (Hughes et al., 2004)
Structure: 8 items measuring perceived social isolation
Strengths: Short form, validated, predictive of health outcomes
Psychometrics: α ≈ 0.82
Administration: 2 minutes
Rosenberg Self-Esteem Scale (RSE) (Rosenberg, 1965)
Structure: 10 items measuring global self-worth
Strengths: Most widely used self-esteem measure, culturally adapted
Psychometrics: α ≈ 0.77-0.88
Administration: 3 minutes
Experience Sampling & Real-time Measures
Experience Sampling Method (ESM) / Ecological Momentary Assessment (EMA)
Structure: Brief surveys delivered via app in real context
- Current activity and location
- Social context
- Emotional state (affect grid or PANAS)
- Engagement and stress levels
Strengths: Captures real-time experience, reduces recall bias
Use for: Product experience evaluation, diary-style wellbeing tracking
Consideration: Higher participant burden, data analysis complexity
Measurement Design Best Practices
Scale Selection Criteria
Administration Considerations
Frequency:
- Baseline: Before intervention/new design
- Post-test: Immediately after experience (1-7 days)
- Follow-up: Long-term effects (weeks to months)
Response Mode:
- Online/mobile preferred for research-through-design
- Paper for in-person contexts
- Experience sampling for real-time tracking
Anchoring Scales:
- Consistent 1-10 or 1-7 Likert scales
- Clear labeling ("Strongly Disagree" to "Strongly Agree")
- Avoid neutral mid-point for forced choice contexts
Data Quality Assurance
- Attention checks: Reverse-coded or logic questions
- Completion rates: Monitor for incomplete responses
- Response time: Identify rushed or suspicious patterns
- Missing data: Document and handle appropriately
Analysis & Interpretation
Descriptive Statistics
- Mean, median, standard deviation by subscale
- Floor/ceiling effects (>15% responses at extremes)
- Skewness and kurtosis
Inferential Analysis
- t-tests/ANOVA: Compare groups (e.g., treatment vs. control)
- Paired tests: Pre-post comparisons
- Correlation: Relationships between wellbeing dimensions
- Regression: Predictive relationships
Effect Sizes
- Cohen's d: 0.2 (small), 0.5 (medium), 0.8 (large)
- ηp²: 0.01 (small), 0.06 (medium), 0.14 (large)
- Report alongside p-values for practical significance
Qualitative Integration
- Triangulate quantitative findings with interview data
- Use scores to guide depth interviews with high/low scorers
- Contextualize numerical changes with lived experience
Quick Reference: Instrument Selection Matrix
| Goal | Best Instrument | Time | Focus |
|---|
| General wellbeing snapshot | PERMA-Profiler | 5 min | Multidimensional |
| Population monitoring | PWI-8 | 3 min | Life satisfaction |
| Emotional state | SPANE | 2 min | Affect |
| Eudaimonic wellbeing | PWB or MLQ | 5 min | Purpose/growth |
| Life satisfaction | SWLS | 2 min | Overall satisfaction |
| Psychological flourishing | Flourishing Scale | 3 min | Thriving |
| Real-time experience | ESM/EMA | 2 min | Momentary state |
| Loneliness/connection | UCLA-8 | 2 min | Social isolation |
| Self-worth | Rosenberg SES | 3 min | Self-esteem |
Common Pitfalls to Avoid
- Cherry-picking scales: Choose based on theory, not convenience
- Ignoring psychometrics: Always verify reliability/validity for your population
- Over-interpretation: Acknowledge measurement error and confidence intervals
- Single measure: Combine multiple instruments for comprehensive picture
- Ignoring context: Same score means differently in different populations
- Neglecting qualitative data: Numbers without stories miss crucial nuance
Resources
- Open Science Framework (OSF): Repository of validated instruments and protocols
- PubMed/Google Scholar: Search for validation studies in your population
- COSMIN: Guidelines for selecting Patient-Reported Outcome Measures
- International Wellbeing Group: PWI and related resources
