Lessons learned from dftracer annotation sessions — real errors, root causes, and exact fixes. Loaded by each per-file annotation subagent at startup. Updated by the pipeline recipe after every session (Step 8).
Interactive dftracer annotation pipeline. Clones the app, builds it, annotates all source files using the clang-based MCP annotation tools (clang_annotate_project / clang_annotate_file + clang_syntax_check + clang_lint_annotations), builds the annotated…
Sweep ANY ice4hpc application across a configuration space (input x node-scale x processes-per-node) collecting full-feature dftracer traces — PAPI, GPU (ROCProfiler or CUPTI), variorum power, node utilization, MPI — into a validated, compacted,…
System profile for matrix (LLNL NVIDIA H100 + Intel Sapphire Rapids, TOSS 4, Slurm) — the toolchain that actually works, the three partitions and their very different limits and backlogs, where CUPTI really lives, the PAPI ceiling, and the two permission…
System profile for Tuolumne (LLNL AMD MI300A / Cray PE) — module load order, Flux scheduler, ROMIO/MPICH-IO hints, Lustre striping, ROCm/PyTorch environment setup, and known build/run pitfalls
The dftracer PyPI package itself (C core + CMake build) — package layout, dependency graph (dftracer-utils, pybind11, pydftracer), install sources (PyPI release vs GitHub develop via pip), and session-local vs shared-venv install rules. Load this skill before…
IOR-specific knowledge: build quirks, annotation pitfalls, ROMIO tuning on VAST NVMe storage, and optimal dftracer run configuration for IOR 4.0.0. Load this skill whenever working with IOR.
ScaFFold (LBANN PyTorch benchmark, 3D U-Net on procedurally-generated fractals). Python/PyTorch DDP app running on Tuolumne MI300A. Environment setup, shared venv pattern for AI/ML workloads, MPI4PY Cray linkage, ROCm paths.