Skip to main content

hpc-supercomputing-clusters

Provides architecture, engineering, and operations patterns for HPC (High Performance Computing) clusters and supercomputers based on Supercomputers for Linux SysAdmins (Sergey Zhumatiy). Covers workload managers (Slurm Workload Manager), low-latency interconnects (InfiniBand/RDMA), parallelism libraries (OpenMPI, MPICH), parallel file systems (Lustre, GPFS, Ceph), and GPU-accelerated computing.

Source facts

Repository
dandgabr/Coacus
Last source activity
September 28, 2026 at 14:03
Detected SKILL.md language
English
Stars
6
Forks
5

Install options

The review-first prompt is selected by default. You can switch to a direct command or download a local copy.

Review the source files

Read SKILL.md and any companion files shown by SkillsMP before deciding whether to install.

File Explorer
5 files

Showing SKILL.md

SKILL.md
Source instructions · Read-only preview
name
hpc-supercomputing-clusters
description
Provides architecture, engineering, and operations patterns for HPC (High Performance Computing) clusters and supercomputers based on Supercomputers for Linux SysAdmins (Sergey Zhumatiy). Covers workload managers (Slurm Workload Manager), low-latency interconnects (InfiniBand/RDMA), parallelism libraries (OpenMPI, MPICH), parallel file systems (Lustre, GPFS, Ceph), and GPU-accelerated computing.
# HPC Clusters and Supercomputer Engineering This skill establishes the guidelines for designing, deploying, and operating **High Performance Computing (HPC)** environments and supercomputers on Linux, drawing on the book by **Sergey Zhumatiy**. --- ## 🚀 1. Topology of an HPC Cluster ``` ┌─────────────────────────┐ │ Head / Master Node │ │ (Slurm Controller) │ └────────────┬────────────┘ │ ┌────────────────────────┴────────────────────────┐ [ 10GbE Management Network ] [ InfiniBand / RDMA 200Gbps Network ] │ │ ┌─────────▼─────────┐ ┌─────────▼─────────┐ │ Parallel Storage │ │ Compute Nodes │ │ (Lustre / CephFS) │ │ (CPUs + GPUs H100)│ └───────────────────┘ └───────────────────┘ ``` --- ## 📋 2. Job Management with Slurm Workload Manager ### Batch Job Script Example (`submit_job.sh`) ```bash #!/bin/bash #SBATCH --job-name=scientific_sim #SBATCH --output=logs/sim_%j.log #SBATCH --error=logs/sim_%j.err #SBATCH --nodes=4 #SBATCH --ntasks-per-node=32 #SBATCH --cpus-per-task=1 #SBATCH --gres=gpu:4 #SBATCH --time=12:00:00 #SBATCH --partition=gpu_cluster module load openmpi/4.1.5-cuda-12.2 srun --mpi=pmix ./bin/simulation_engine --dataset /shared/lustre/input.dat ```
View on GitHub