Skip to main content

apache/beam

Latest recorded source activity
SkillsMP catalog refreshed
skills collected
13
GitHub stars
8,679
GitHub forks
4,662

Loading the repository README…

Skills in this repository

Showing 13 of 13 collected skills.

occupation
Software Quality Assurance Analysts & Testers
description

Guides the contribution workflow for Apache Beam, including creating PRs, issue management, code review process, release cycles, and rigorous evaluation rules for high-risk core component changes. Use when contributing code, creating PRs, or modifying core…

updated
occupation
Postsecondary Teachers, All Other
description

Explains core Apache Beam programming model concepts including PCollections, PTransforms, Pipelines, and Runners. Use when learning Beam fundamentals or explaining pipeline concepts.

updated
occupation
Software Developers
description

End-to-end guide on developing new Apache Beam I/O connectors correctly, including core IO transforms, SchemaTransforms, URN proto definitions, Managed API integration, cross-language expansion service, and testing.

updated
occupation
Software Developers
description

Guides development and usage of I/O connectors in Apache Beam. Use when working with I/O connectors, creating new connectors, or debugging data source/sink issues.

updated
occupation
Software Developers
description

Guides YAML SDK development in Apache Beam, including environment setup, testing, and key concepts. Use when working with Beam YAML code in sdks/python/apache_beam/yaml/.

updated
occupation
Software Developers
description

Guide on how to add and propagate new metadata fields in Apache Beam's WindowedValue, extending protos, windmill persistence, and runner interfaces to avoid metadata loss.

updated
occupation
Software Developers
description

Guides understanding and working with Apache Beam runners (Direct, Dataflow, Flink, Spark, etc.). Use when configuring pipelines for different execution environments or debugging runner-specific issues.

updated
occupation
Software Developers
description

Rewrite Apache Beam DoFn methods (@ProcessElement, @OnTimer, @OnWindowExpiration) to remove legacy ProcessContext or OnTimerContext usage. Use this skill when you encounter DoFn methods that use context.element(), context.output(), etc., and need to modernize…

updated
occupation
Software Developers
description

Guides Python SDK development in Apache Beam, including environment setup, testing, building, and running pipelines. Use when working with Python code in sdks/python/.

updated
occupation
Software Developers
description

Guides understanding and using the Gradle build system in Apache Beam. Use when building projects, understanding dependencies, or troubleshooting build issues.

updated
occupation
Software Developers
description

Guides understanding and working with Apache Beam's CI/CD system using GitHub Actions. Use when debugging CI failures, understanding test workflows, or modifying CI configuration.

updated
occupation
Software Developers
description

Guides Java SDK development in Apache Beam, including building, testing, running examples, and understanding the project structure. Use when working with Java code in sdks/java/, runners/, or examples/java/.

updated
occupation
Software Developers
description

Ensures all new files include proper Apache 2.0 license headers. Use when creating any new file in the Apache Beam repository.

updated
Showing 13 of 13 collected skills.

Install with an AI assistant

Copy this prompt into the AI assistant you're using.