webiny/data-transfer

webiny 资料

最近记录的来源活动: 2026年7月30日 12:29

SkillsMP 收录数据更新: 2026年10月26日 11:37

已收集 skills: 6

GitHub 星标: 1
GitHub Forks: 0

仓库 README

仓库 README 来源：README.md

查看 README 源文件

展开完整 README

# `@webiny/data-transfer` A data-transfer tool for Webiny environments. Copies DynamoDB, S3, and OpenSearch records between AWS accounts with optional transformer chains. ## Use cases - **v5 to v6 migration** — built-in presets handle the full migration pipeline. - **Prod to dev seeding** — zero transformers, just copy data as-is. - **Custom transfers** — author your own transformers, pipelines, and presets. ## Getting started ```bash npx --yes --loglevel=silent @webiny/data-transfer my-transfer cd my-transfer ``` This scaffolds a new project with a `config.ts`, example preset, and everything wired up. The wizard walks you through credentials, preset selection, and transfer execution: ```bash yarn transfer ``` ### Manual setup If you prefer to set up manually: ```bash yarn add @webiny/data-transfer ``` Then create a `config.ts`: ```typescript import { createConfig, fromAwsProfile, loadEnv } from "@webiny/data-transfer"; loadEnv(import.meta.url); export default createConfig({ source: { dynamodb: { table: "Source-Table", region: "us-east-1" }, credentials: fromAwsProfile("source-profile") }, target: { dynamodb: { table: "Target-Table", region: "eu-central-1" }, credentials: fromAwsProfile("target-profile") }, pipeline: { preset: "copy-ddb" } }); ``` Run it: ```bash yarn webiny-data-transfer --config=./config.ts --preset=copy-ddb ``` ### Upgrading ```bash yarn up @webiny/data-transfer ``` The scaffolded project depends on `@webiny/data-transfer` via a caret range, so minor and patch updates are picked up automatically. ## Built-in presets | Preset | Description | | -------------- | ------------------------------------------------------------------------------- | | `v5-to-v6-ddb` | Full Webiny v5 to v6 migration of the primary DynamoDB table | | `v5-to-v6-os` | Migration of the OpenSearch companion DynamoDB table (run after `v5-to-v6-ddb`) | | `copy-ddb` | Verbatim DynamoDB + S3 copy (no transformations) | | `copy-os` | Verbatim OpenSearch companion table copy (no transformations) | | `copy-files` | S3-only file copy | Custom presets placed in your project's `presets/` directory are listed alongside built-ins. ## Documentation - [Config reference](docs/guides/config-reference.md) — `config.ts` setup, env helpers, credentials, IAM permissions, tuning, debug options - [Commands](docs/guides/commands.md) — guided wizard, direct `--config` runs, `init`, `init-project`, `--segments` - [Writing presets](docs/guides/writing-presets.md) — preset shape, pipeline builder, filters, multi-pipeline patterns - [Writing transformers](docs/guides/writing-transformers.md) — transformer factories, context types, processor slices, built-ins - [Extending built-in presets](docs/guides/pipeline-customizer.md) — PipelineCustomizer, `setup.ts`, custom DI - [Pipeline runtime](docs/guides/pipeline-runtime.md) — merge groups, first-match-wins, unmatched records, hooks - [Troubleshooting](docs/guides/troubleshooting.md) — common issues and fixes ## Development ```bash git clone git@github.com:webiny/data-transfer.git cd data-transfer yarn install yarn full # format, lint, typecheck, test, coverage yarn build # compile to dist/ ``` ## License MIT

正在加载仓库 README…

这个仓库中的 skills

软件开发工程师软件质量保证分析师与测试员

2 个职业分类 · 已分类 100%

skill

职业分类

描述

更新

handoff

软件开发工程师

End-of-session handoff — updates AGENTS.md and docs, writes a session handoff file, and generates a copy/paste prompt for the next agent. Use when user says "handoff", "wrap up", "end session", "clear context", or wants to prepare context for the next…

原文语言：英语

2026-07-30

review-fix-loop

软件质量保证分析师与测试员

Use when user says "review and fix", "review until clean", "run reviewer and fix", "keep reviewing until good", or wants iterative subagent review with automatic fixes applied between rounds. Works on specs, code, docs — any reviewable artifact.

原文语言：英语

2026-07-30

writing-data-transfer-preset

软件开发工程师

Use when writing or editing a @webiny/data-transfer preset file (selected at runtime by the wizard or --preset flag). Covers createTransferPreset, pipelineBuilderFactory.create, filter/use/hook composition, first-match-wins record dispatch, unmatched-record…

原文语言：英语

2026-06-10

writing-data-transfer-config

软件开发工程师

Use when writing or editing a @webiny/data-transfer config file (ddb.transfer.config.ts / os.transfer.config.ts / custom.transfer.config.ts). Covers createDdbConfig / createOsConfig signatures, credential shapes (fromAwsProfile vs literal), fromEnv /…

原文语言：英语

2026-05-11

writing-data-transfer-config

软件开发工程师

Use when writing or editing a @webiny/data-transfer config file (config.ts). Covers createConfig signature, credential shapes (fromAwsProfile vs literal), fromEnv / numberFromEnv helpers, loadEnv, source/target collision + trimming rules, tuning knobs.

原文语言：英语

2026-05-11

writing-data-transfer-preset

软件开发工程师

Use when writing or editing a @webiny/data-transfer preset file (the one referenced by pipeline.preset in a config). Covers createTransferPreset, pipelineBuilderFactory.create, filter/use/hook composition, first-match-wins record dispatch, unmatched-record…

原文语言：英语

2026-05-04

已展示 6 / 6 个已收集 Skill。

用 AI 助手安装

复制这段 Prompt，发给你正在使用的 AI 助手。

Follow https://skillsmp.com/skill-install/prompt.md to install Agent Skills from https://github.com/webiny/data-transfer.