一键在 Manus 中运行任何 Skill

lemma-leakage

星标4

分支1

更新时间2026年7月15日 00:47

Audit suspicious model performance or a pipeline for target, preprocessing, temporal, group, sampling, or duplicate contamination.

安装

用 Codex 或 Claude 帮你安装复制这段 Prompt，粘贴到 Codex、Claude 或其他助手里，让它检查 Skill 页面并帮你完成安装。

在 Manus 中运行

来源

tkpratardan

tkpratardan/lemma

打开 GitHub 仓库查看创作者相关仓库

下载

在 Manus 中运行

Leakage audit

Deliver

Rank leakage findings by severity and show reproducible before/after scores, the contaminated path, the corrected validation design, and remaining risk.

Check

Reconstruct information available at the real prediction moment.
Audit features and missingness for target proxies and post-outcome facts.
Verify that imputers, encoders, selection, and scaling are fit within each training fold.
Check time travel, repeated entities, near duplicates, source overlap, and outcome-dependent sampling.
Remove suspicious features or strengthen the split and compare with a simple baseline.

Do not rationalize an implausible score, rely only on feature importance, randomly split temporal or repeated-entity data, or continue tuning before material leakage is resolved.

For the full leakage taxonomy, read references/deep-guide.md.

同仓库更多 Skills

同仓库

lemma-baseline

tkpratardan/lemma

Establish a dumb baseline and an honest validation harness before any real model, so every later number means something.

2026-07-154

lemma-causal

tkpratardan/lemma

Rigor for causal questions and A/B tests (the effect of acting on X): confounding, post-treatment bias, valid control groups.

2026-07-154

lemma-describe

tkpratardan/lemma

Rigor for descriptive and diagnostic analytics (what happened and why): denominators, grain, and confounded slices, not model leakage.

2026-07-154

lemma-eda

tkpratardan/lemma

EDA kickoff for a fresh dataset: fixed opening scaffold (goal, imports, load, sanity), then chapters derived from the data; scan leakage, land a baseline.

2026-07-154

lemma-inference

tkpratardan/lemma

Rigor for statistical inference (is the difference real): hypothesis tests, power, multiple comparisons, effect size over p-value.

2026-07-154

lemma-leakage

tkpratardan/lemma

Audit a dataset or pipeline for the five leakages that inflate a metric: target, preprocessing, temporal, group, and sampling.

2026-07-154

name	lemma-leakage
description	Audit suspicious model performance or a pipeline for target, preprocessing, temporal, group, sampling, or duplicate contamination.

Leakage audit

Deliver

Rank leakage findings by severity and show reproducible before/after scores, the contaminated path, the corrected validation design, and remaining risk.

Check

Reconstruct information available at the real prediction moment.
Audit features and missingness for target proxies and post-outcome facts.
Verify that imputers, encoders, selection, and scaling are fit within each training fold.
Check time travel, repeated entities, near duplicates, source overlap, and outcome-dependent sampling.
Remove suspicious features or strengthen the split and compare with a simple baseline.

Do not rationalize an implausible score, rely only on feature importance, randomly split temporal or repeated-entity data, or continue tuning before material leakage is resolved.

For the full leakage taxonomy, read references/deep-guide.md.