| name | parity-check |
| description | Verify parity between notebook-like pipeline execution and scripted experiment workflows so research findings are reproducible. |
Parity Check
Use this skill when confirming notebook results and experiment-runner results are consistent for core metrics.
What this skill does
- Runs notebook-like pipeline calls in Python.
- Runs scripted experiment runner paths.
- Compares key outputs:
- event count
- realized Sharpe
- portfolio Sharpe
- net Sharpe (where applicable)
Primary test target
python/tests/test_experiment_scaffold.py
Command
uv run --python .venv/bin/python pytest python/tests/test_experiment_scaffold.py -q
Escalation criteria
If metrics drift:
- Check config mismatch (
pipeline/costs/gates).
- Check dataset seed and asset list.
- Check run manifest
config_digest and git SHA.