GoogleCloudPlatform/DataflowTemplates

smt-functional-testing

Functionally tests local Dataflow pipeline changes against the main branch using ephemeral GCP resources and gated approvals. Use ONLY when functionally testing one of these specific migration templates: gcs-spanner-dv, sourcedb-to-spanner,…

لغة النص الأصلي: الإنجليزية

add-source-datastream-to-spanner

Guide for implementing a database source connector in the v2/datastream-to-spanner forward migration Dataflow template. Details scope boundaries, prerequisites, connector implementations, registry registrations, unit testing, and smoke testing guidelines.

لغة النص الأصلي: الإنجليزية

add-source-sourcedb-to-spanner

Guide for implementing a database source connector in the v2/sourcedb-to-spanner forward migration Dataflow template. Details scope boundaries, prerequisites, connector implementations, registry registrations, unit testing, and smoke testing guidelines.

لغة النص الأصلي: الإنجليزية

add-source-spanner-to-sourcedb

Guide for implementing a database source connector in the v2/spanner-to-sourcedb reverse migration Dataflow template. Details scope boundaries, prerequisites, connector implementations, registry registrations, unit testing, and smoke testing guidelines.

لغة النص الأصلي: الإنجليزية

add-integ-tests-datastream-to-spanner

Specific runner skill that delegates to the Template-Agnostic Meta-Test Orchestrator for the datastream-to-spanner (CDC) template.

لغة النص الأصلي: الإنجليزية

add-integ-tests-sourcedb-to-spanner

Specific runner skill that delegates to the Template-Agnostic Meta-Test Orchestrator for the sourcedb-to-spanner (Bulk) template.

لغة النص الأصلي: الإنجليزية

add-source-datatype-integ-test

Skill for adding data type integ tests for new source by provided datatype_mapping_matrix.

لغة النص الأصلي: الإنجليزية

add-source-functional-integ-test

Skill for adding functional integ test for new source by taking reference from existing MySQL integ tests.

لغة النص الأصلي: الإنجليزية

meta-test-orchestrator

Template-agnostic Orchestrator Skill for generating and executing exhaustive testing suites for any migration template. It will generate the functional and datatype related test for the source.

لغة النص الأصلي: الإنجليزية

add-integ-tests-spanner-to-sourcedb

Specific runner skill that delegates to the Template-Agnostic Meta-Test Orchestrator for the spanner-to-sourcedb (Reverse Migration) template.

لغة النص الأصلي: الإنجليزية

smt-e2e-dataflow-debugging

Debugs logical errors and data discrepancies in Dataflow templates by launching jobs via Terraform and comparing source (e.g. Cloud SQL) vs destination (e.g. Spanner) data. Use ONLY when the pipeline launches and runs to completion (terminal state) but…

لغة النص الأصلي: الإنجليزية