hpc-supercomputing-clusters
Provides architecture, engineering, and operations patterns for HPC (High Performance Computing) clusters and supercomputers based on Supercomputers for Linux SysAdmins (Sergey Zhumatiy). Covers workload managers (Slurm Workload Manager), low-latency interconnects (InfiniBand/RDMA), parallelism libraries (OpenMPI, MPICH), parallel file systems (Lustre, GPFS, Ceph), and GPU-accelerated computing.
Informações da origem
- Repositório
- dandgabr/Coacus
- Última atividade na origem
- 28 de setembro de 2026 às 14:03
- Idioma detectado do SKILL.md
- inglês
- Estrelas
- 6
- Forks
- 5
Opções de instalação
Por padrão, está selecionado o prompt que primeiro revisa a origem. Você pode mudar para um comando direto ou baixar uma cópia local.
Revise os arquivos de origem
Leia o SKILL.md e os arquivos complementares exibidos pelo SkillsMP antes de decidir se vai instalar.
Explorador de arquivos
5 arquivosExibindo SKILL.md
SKILL.md
Instruções da origem · Visualização somente leitura- name
- hpc-supercomputing-clusters
- description
- Provides architecture, engineering, and operations patterns for HPC (High Performance Computing) clusters and supercomputers based on Supercomputers for Linux SysAdmins (Sergey Zhumatiy). Covers workload managers (Slurm Workload Manager), low-latency interconnects (InfiniBand/RDMA), parallelism libraries (OpenMPI, MPICH), parallel file systems (Lustre, GPFS, Ceph), and GPU-accelerated computing.
# HPC Clusters and Supercomputer Engineering
This skill establishes the guidelines for designing, deploying, and operating **High Performance Computing (HPC)** environments and supercomputers on Linux, drawing on the book by **Sergey Zhumatiy**.
---
## 🚀 1. Topology of an HPC Cluster
```
┌─────────────────────────┐
│ Head / Master Node │
│ (Slurm Controller) │
└────────────┬────────────┘
│
┌────────────────────────┴────────────────────────┐
[ 10GbE Management Network ] [ InfiniBand / RDMA 200Gbps Network ]
│ │
┌─────────▼─────────┐ ┌─────────▼─────────┐
│ Parallel Storage │ │ Compute Nodes │
│ (Lustre / CephFS) │ │ (CPUs + GPUs H100)│
└───────────────────┘ └───────────────────┘
```
---
## 📋 2. Job Management with Slurm Workload Manager
### Batch Job Script Example (`submit_job.sh`)
```bash
#!/bin/bash
#SBATCH --job-name=scientific_sim
#SBATCH --output=logs/sim_%j.log
#SBATCH --error=logs/sim_%j.err
#SBATCH --nodes=4
#SBATCH --ntasks-per-node=32
#SBATCH --cpus-per-task=1
#SBATCH --gres=gpu:4
#SBATCH --time=12:00:00
#SBATCH --partition=gpu_cluster
module load openmpi/4.1.5-cuda-12.2
srun --mpi=pmix ./bin/simulation_engine --dataset /shared/lustre/input.dat
```
Ver no GitHub