GoogleCloudPlatform/DataflowTemplates

smt-functional-testing

Functionally tests local Dataflow pipeline changes against the main branch using ephemeral GCP resources and gated approvals. Use ONLY when functionally testing one of these specific migration templates: gcs-spanner-dv, sourcedb-to-spanner,…

원문 언어: 영어

add-source-datastream-to-spanner

Guide for implementing a database source connector in the v2/datastream-to-spanner forward migration Dataflow template. Details scope boundaries, prerequisites, connector implementations, registry registrations, unit testing, and smoke testing guidelines.

원문 언어: 영어

add-source-sourcedb-to-spanner

Guide for implementing a database source connector in the v2/sourcedb-to-spanner forward migration Dataflow template. Details scope boundaries, prerequisites, connector implementations, registry registrations, unit testing, and smoke testing guidelines.

원문 언어: 영어

add-source-spanner-to-sourcedb

Guide for implementing a database source connector in the v2/spanner-to-sourcedb reverse migration Dataflow template. Details scope boundaries, prerequisites, connector implementations, registry registrations, unit testing, and smoke testing guidelines.

원문 언어: 영어

add-integ-tests-datastream-to-spanner

Specific runner skill that delegates to the Template-Agnostic Meta-Test Orchestrator for the datastream-to-spanner (CDC) template.

원문 언어: 영어

add-integ-tests-sourcedb-to-spanner

Specific runner skill that delegates to the Template-Agnostic Meta-Test Orchestrator for the sourcedb-to-spanner (Bulk) template.

원문 언어: 영어

add-source-datatype-integ-test

Skill for adding data type integ tests for new source by provided datatype_mapping_matrix.

원문 언어: 영어

add-source-functional-integ-test

Skill for adding functional integ test for new source by taking reference from existing MySQL integ tests.

원문 언어: 영어

meta-test-orchestrator

Template-agnostic Orchestrator Skill for generating and executing exhaustive testing suites for any migration template. It will generate the functional and datatype related test for the source.

원문 언어: 영어

add-integ-tests-spanner-to-sourcedb

Specific runner skill that delegates to the Template-Agnostic Meta-Test Orchestrator for the spanner-to-sourcedb (Reverse Migration) template.

원문 언어: 영어

smt-e2e-dataflow-debugging

Debugs logical errors and data discrepancies in Dataflow templates by launching jobs via Terraform and comparing source (e.g. Cloud SQL) vs destination (e.g. Spanner) data. Use ONLY when the pipeline launches and runs to completion (terminal state) but…

원문 언어: 영어