Skip to main content

GoogleCloudPlatform/DataflowTemplates

SkillsMP has collected 11 skills from GoogleCloudPlatform/DataflowTemplates. Open a skill to review its source and details.

Latest recorded source activity
SkillsMP catalog refreshed
skills collected
11
GitHub stars
1,311
GitHub forks
1,116

Skills in this repository

Showing 11 of 11 collected skills.

occupation
Software Quality Assurance Analysts & Testers
description

Functionally tests local Dataflow pipeline changes against the main branch using ephemeral GCP resources and gated approvals. Use ONLY when functionally testing one of these specific migration templates: gcs-spanner-dv, sourcedb-to-spanner,…

updated
occupation
Software Developers
description

Guide for implementing a database source connector in the v2/datastream-to-spanner forward migration Dataflow template. Details scope boundaries, prerequisites, connector implementations, registry registrations, unit testing, and smoke testing guidelines.

updated
occupation
Software Developers
description

Guide for implementing a database source connector in the v2/sourcedb-to-spanner forward migration Dataflow template. Details scope boundaries, prerequisites, connector implementations, registry registrations, unit testing, and smoke testing guidelines.

updated
occupation
Software Developers
description

Guide for implementing a database source connector in the v2/spanner-to-sourcedb reverse migration Dataflow template. Details scope boundaries, prerequisites, connector implementations, registry registrations, unit testing, and smoke testing guidelines.

updated
occupation
Software Quality Assurance Analysts & Testers
description

Specific runner skill that delegates to the Template-Agnostic Meta-Test Orchestrator for the datastream-to-spanner (CDC) template.

updated
occupation
Software Quality Assurance Analysts & Testers
description

Specific runner skill that delegates to the Template-Agnostic Meta-Test Orchestrator for the sourcedb-to-spanner (Bulk) template.

updated
occupation
Software Quality Assurance Analysts & Testers
description

Skill for adding data type integ tests for new source by provided datatype_mapping_matrix.

updated
occupation
Software Quality Assurance Analysts & Testers
description

Skill for adding functional integ test for new source by taking reference from existing MySQL integ tests.

updated
occupation
Software Quality Assurance Analysts & Testers
description

Template-agnostic Orchestrator Skill for generating and executing exhaustive testing suites for any migration template. It will generate the functional and datatype related test for the source.

updated
occupation
Software Quality Assurance Analysts & Testers
description

Specific runner skill that delegates to the Template-Agnostic Meta-Test Orchestrator for the spanner-to-sourcedb (Reverse Migration) template.

updated
occupation
Software Developers
description

Debugs logical errors and data discrepancies in Dataflow templates by launching jobs via Terraform and comparing source (e.g. Cloud SQL) vs destination (e.g. Spanner) data. Use ONLY when the pipeline launches and runs to completion (terminal state) but…

updated
Showing 11 of 11 collected skills.