GoogleCloudPlatform/DataflowTemplates

smt-functional-testing

Functionally tests local Dataflow pipeline changes against the main branch using ephemeral GCP resources and gated approvals. Use ONLY when functionally testing one of these specific migration templates: gcs-spanner-dv, sourcedb-to-spanner,…

原文の言語: 英語

add-source-datastream-to-spanner

Guide for implementing a database source connector in the v2/datastream-to-spanner forward migration Dataflow template. Details scope boundaries, prerequisites, connector implementations, registry registrations, unit testing, and smoke testing guidelines.

原文の言語: 英語

add-source-sourcedb-to-spanner

Guide for implementing a database source connector in the v2/sourcedb-to-spanner forward migration Dataflow template. Details scope boundaries, prerequisites, connector implementations, registry registrations, unit testing, and smoke testing guidelines.

原文の言語: 英語

add-source-spanner-to-sourcedb

Guide for implementing a database source connector in the v2/spanner-to-sourcedb reverse migration Dataflow template. Details scope boundaries, prerequisites, connector implementations, registry registrations, unit testing, and smoke testing guidelines.

原文の言語: 英語

add-integ-tests-datastream-to-spanner

Specific runner skill that delegates to the Template-Agnostic Meta-Test Orchestrator for the datastream-to-spanner (CDC) template.

原文の言語: 英語

add-integ-tests-sourcedb-to-spanner

Specific runner skill that delegates to the Template-Agnostic Meta-Test Orchestrator for the sourcedb-to-spanner (Bulk) template.

原文の言語: 英語

add-source-datatype-integ-test

Skill for adding data type integ tests for new source by provided datatype_mapping_matrix.

原文の言語: 英語

add-source-functional-integ-test

Skill for adding functional integ test for new source by taking reference from existing MySQL integ tests.

原文の言語: 英語

meta-test-orchestrator

Template-agnostic Orchestrator Skill for generating and executing exhaustive testing suites for any migration template. It will generate the functional and datatype related test for the source.

原文の言語: 英語

add-integ-tests-spanner-to-sourcedb

Specific runner skill that delegates to the Template-Agnostic Meta-Test Orchestrator for the spanner-to-sourcedb (Reverse Migration) template.

原文の言語: 英語

smt-e2e-dataflow-debugging

Debugs logical errors and data discrepancies in Dataflow templates by launching jobs via Terraform and comparing source (e.g. Cloud SQL) vs destination (e.g. Spanner) data. Use ONLY when the pipeline launches and runs to completion (terminal state) but…

原文の言語: 英語