Skip to main content

NVIDIA/nvidia-resiliency-ext

Latest recorded source activity
SkillsMP catalog refreshed
skills collected
4
GitHub stars
351
GitHub forks
70

Install with an AI assistant

Copy this prompt into the AI assistant you're using.

Loading the repository README…

Skills in this repository

2 occupation categories · 100% classified

Showing 4 of 4 collected skills.

occupation
Software Developers
description

Closed-loop fault injection and attribution accuracy benchmark. Draws from a prioritized pool of (fault_type, rank, iter, nodes) experiments and submits them 2 at a time via sbatch — waiting for each pair to finish before submitting the next — to bound…

updated
occupation
Data Scientists
description

Analyze PyTorch NCCL flight-recorder (FR) dumps to identify collective operation hangs and isolate the responsible ranks using CollectiveAnalyzer. Use when a distributed training job hangs due to an NCCL collective timeout and FR dump files are available.…

updated
occupation
Software Developers
description

Analyze a SLURM job log file for failure root-cause attribution and restart decisions using the packaged NVRx restart-agent. Use when you have a SLURM training job log and need to determine why the job failed and whether it should be restarted. Performs…

updated
occupation
Software Developers
description

Orchestration layer over nvidia_resiliency_ext attribution modules. Provides log-analysis, fr-analysis, and a Megatron-LM-oriented fault-injection feedback loop for benchmarking attribution quality on SLURM workloads.

updated
Showing 4 of 4 collected skills.