Skip to main content

forward-kernel-validation

Validate optimized Recirculation forward kernels against an unfused, unbatched oracle when changing batching, fusion, attention, CUDA graphs, or accelerator inference code.

Datos de origen

Repositorio
ModelCloud/Recirculation
Última actividad en el origen
22 de agosto de 2026 a las 12:54
Idioma detectado de SKILL.md
inglés
Estrellas
9
Forks
4

Opciones de instalación

De forma predeterminada está seleccionado el prompt que primero revisa el origen. Puedes cambiar a un comando directo o descargar una copia local.

Revisa los archivos de origen

Lee SKILL.md y los archivos complementarios que muestra SkillsMP antes de decidir si quieres instalarlo.

Mostrando SKILL.md

SKILL.md
Instrucciones de origen · Vista previa de solo lectura
name
forward-kernel-validation
description
Validate optimized Recirculation forward kernels against an unfused, unbatched oracle when changing batching, fusion, attention, CUDA graphs, or accelerator inference code.
# Forward kernel validation Compare optimized forward outputs with the unfused, unbatched implementation using identical weights, dtype, tokens, positions, masks, cache state, and Recirculation configuration. Use mean absolute forward error as the release gate: - Fused or batched kernels: mean absolute error must be at most `4e-3`. - Kernels that are both non-fused and non-batched: mean absolute error must be at most `2e-3`. A path qualifies for the `4e-3` limit if it uses fusion, batching, or both. Record max absolute error, relative L2, and normalized max for diagnostics, but do not use those metrics to accept or reject the kernel. A stricter explicitly requested gate may still be used. Benchmark accuracy, task scores, and greedy-token agreement are outcome diagnostics, not substitutes for the forward gate. Do not reject an otherwise passing optimization solely because a benchmark score or greedy output changes; report those changes separately. Save the selected gate, kernel classification, oracle configuration, and all error metrics with benchmark artifacts.
Ver en GitHub