Skip to main content

forward-kernel-validation

Validate optimized Recirculation forward kernels against an unfused, unbatched oracle when changing batching, fusion, attention, CUDA graphs, or accelerator inference code.

소스 정보

저장소
ModelCloud/Recirculation
최근 소스 활동
2026년 8월 22일 12:54
감지된 SKILL.md 언어
영어
스타
9
포크
4

설치 방법

기본적으로 소스를 먼저 확인하는 Prompt가 선택됩니다. 직접 명령으로 전환하거나 로컬 사본을 다운로드할 수도 있습니다.

소스 파일 검토

설치 여부를 결정하기 전에 SKILL.md와 SkillsMP에 표시된 보조 파일을 읽어 보세요.

SKILL.md 표시 중

SKILL.md
소스 지침 · 읽기 전용 미리보기
name
forward-kernel-validation
description
Validate optimized Recirculation forward kernels against an unfused, unbatched oracle when changing batching, fusion, attention, CUDA graphs, or accelerator inference code.
# Forward kernel validation Compare optimized forward outputs with the unfused, unbatched implementation using identical weights, dtype, tokens, positions, masks, cache state, and Recirculation configuration. Use mean absolute forward error as the release gate: - Fused or batched kernels: mean absolute error must be at most `4e-3`. - Kernels that are both non-fused and non-batched: mean absolute error must be at most `2e-3`. A path qualifies for the `4e-3` limit if it uses fusion, batching, or both. Record max absolute error, relative L2, and normalized max for diagnostics, but do not use those metrics to accept or reject the kernel. A stricter explicitly requested gate may still be used. Benchmark accuracy, task scores, and greedy-token agreement are outcome diagnostics, not substitutes for the forward gate. Do not reject an otherwise passing optimization solely because a benchmark score or greedy output changes; report those changes separately. Save the selected gate, kernel classification, oracle configuration, and all error metrics with benchmark artifacts.
GitHub에서 보기