Skip to main content

research-deepspeed

Expert guidance for distributed training with DeepSpeed - ZeRO optimization stages, pipeline parallelism, FP16/BF16/FP8, 1-bit Adam, sparse attention

Source facts

Repository
GrayCodeAI/starling
Last source activity
July 13, 2026 at 09:28
Detected SKILL.md language
English
Stars
2
Forks
0

Install options

The review-first prompt is selected by default. You can switch to a direct command or download a local copy.

Review the source files

Read SKILL.md and any companion files shown by SkillsMP before deciding whether to install.

File Explorer
3 files

Showing SKILL.md

SKILL.md
Source instructions · Read-only preview
name
research-deepspeed
description
Expert guidance for distributed training with DeepSpeed - ZeRO optimization stages, pipeline parallelism, FP16/BF16/FP8, 1-bit Adam, sparse attention
license
MIT
tags
["deepspeed","distributed-training","zero","pipeline-parallelism","mixed-precision"]
version
1.0.0
author
Orchestra Research
dependencies
["deepspeed","torch","transformers","accelerate"]
<!-- hawk-progressive-disclosure:v1 body-sha256=50a9f023fbfaa4d0b3bd16637553166c08d32c9b90a893ec51e9d5ff5266c1e4 parts=2 --> # Progressive disclosure index The complete skill instructions are preserved in the ordered references below. Open the part whose headings match the current task; read all parts in order when the task spans sections or requires the complete procedure. ## Detailed instructions - [Part 1: Deepspeed Skill → When to Use This Skill](references/progressive-disclosure-part-001.md) — original lines 1–54 — @ref(progressive-disclosure-part-001.md) - [Part 2: Example Code Patterns → Reference Files](references/progressive-disclosure-part-002.md) — original lines 55–128 — @ref(progressive-disclosure-part-002.md)
View on GitHub