Menu
A/B testing, side-by-side comparison, and preference ranking for AI outputs.
Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.
Based on SOC occupation classification
Proactively identifying failure modes, misuse, and unintended consequences.
Managing shared context, memory, and state across multiple agents.
Coordinating text, image, voice, and tool-use modalities in a single interaction.
Helping users form warranted trust in the AI — neither overtrust nor undertrust — through deliberate confidence and source signalling.
Reading user emotional state from text signals — caps, punctuation density, repetition, latency — and adapting before the user disengages.
Designing review workflows to surface and mitigate bias in AI outputs.
| name | comparative-evaluation |
| description | A/B testing, side-by-side comparison, and preference ranking for AI outputs. |
Absolute quality scores are useful but limited. Comparative evaluation — putting outputs side by side and asking which is better — often reveals quality differences that rubrics miss.
A/B testing AI is different from A/B testing UI:
For human evaluation of AI outputs:
