菜单
Confirm an offline relevance win with an online A/B on CTR/conversion before declaring victory. Reach for this after an offline gain.
默认使用会先检查来源的 Prompt；你也可以切换为直接命令，或下载本地副本。
决定是否安装前，请先阅读 SKILL.md，以及 SkillsMP 当前展示的配套文件。
用 Codex 或 Claude 帮你安装 复制这段 Prompt，粘贴到 Codex、Claude 或其他助手里，让它检查 Skill 页面并帮你完成安装。
直接命令不会经过审查 Prompt；运行前请先检查来源。
npx skills add https://github.com/mcorbett51090/RavenClaude --skill validate-online命令会保持在同一行。复制前请横向滚动并检查完整内容。
想先保存到本地？可下载 SkillsMP 当前能够提供的文件。
基于 SOC 职业分类
正在显示 SKILL.md
| name | validate-online |
| description | Confirm an offline relevance win with an online A/B on CTR/conversion before declaring victory. Reach for this after an offline gain. |
Offline gains don't always transfer to user behavior (§3 #6).
A clear NDCG/MRR improvement on the judgment list first (§3 #1).
Control vs variant on a real metric (CTR/conversion), powered and bias-aware (§3 #6).
Did the offline gain move the user metric? It may not (§3 #6).
Promote the variant only if online confirms; otherwise keep digging (§3 #6).
An online A/B result confirming (or refuting) the offline relevance gain. Traverse Tree 1 in the decision-trees file.