a-b-test-design

name	A/B Test Design
description	Statistical experiment design and analysis capabilities for product experimentation
allowed-tools	["Read","Write","Glob","Grep","Bash"]
graph	{"domains":["domain:software-engineering"],"specializations":["specialization:product-management"],"skillAreas":["skill-area:a-b-testing","skill-area:product-analytics"],"roles":["role:product-manager","role:product-analyst"],"workflows":["workflow:product-discovery","workflow:competitive-analysis"]}

A/B Test Design Skill

Overview

Specialized skill for statistical experiment design and analysis capabilities. Enables product teams to design rigorous experiments, calculate sample sizes, and interpret results with statistical confidence.

Capabilities

Experiment Design

• Calculate required sample sizes for experiments
• Design experiment variants and hypotheses
• Define success metrics and guardrail metrics
• Create experiment documentation templates
• Design multi-variant tests (A/B/n)
• Plan sequential and Bayesian experiments

Statistical Analysis

• Validate statistical significance of results
• Calculate practical significance and effect sizes
• Detect interaction effects and segments
• Perform power analysis
• Calculate confidence intervals
• Handle multiple comparison corrections

Decision Support