Run any Skill in Manus with one click

python-data-pipeline-designer

Stars2

Forks1

UpdatedJanuary 25, 2026 at 18:01

Design ETL workflows with data validation using tools like Pandas, Dask, or PySpark. Use when building robust data processing systems in Python.

Installation

Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.

Run Skill in Manus

Source

jorgealves

jorgealves/agent_skills

View GitHub Repository View Creator Repositories

Download

Run Skill in Manus

Related occupationsSOC

Based on SOC occupation classification

Data ScientistsComputer and Mathematical Occupations·SOC 15-2051

File Explorer

2 files

SKILL.md

readonly

name	python-data-pipeline-designer
description	Design ETL workflows with data validation using tools like Pandas, Dask, or PySpark. Use when building robust data processing systems in Python.

Python Data Pipeline Designer

Purpose and Intent

Design ETL workflows with data validation using tools like Pandas, Dask, or PySpark. Use when building robust data processing systems in Python.

When to Use

Project Setup: When initializing a new Python project.
Continuous Integration: As part of automated build and test pipelines.
Legacy Refactoring: When updating older Python codebases to modern standards.

When NOT to Use

Non-Python Projects: This tool is specialized for the Python ecosystem.

Error Conditions and Edge Cases

Missing Requirements: If the project lacks a requirements.txt or pyproject.toml.
Incompatible Versions: If the project uses a Python version not supported by the tools.

Security and Data-Handling Considerations

All analysis is performed locally.
No source code or credentials are ever transmitted externally.

More from this repository

same repository

module-learning-path-generator

jorgealves/agent_skills

Generates structured, career-focused modular curriculums for software engineering students. Use when designing new educational modules or tailoring learning journeys to specific career roles.

2026-01-252

module-project-generator

jorgealves/agent_skills

Generates end-to-end student projects that reinforce specific modular learning objectives. Use to create professional-grade portfolio pieces and assessment tasks for engineering mentees.

2026-01-252

pedagogical-code-grader

jorgealves/agent_skills

Evaluates student code submissions based on conceptual mastery rather than just correctness. Use to provide high-quality educational feedback on architectural patterns and programming logic.

2026-01-252

pii-sanitizer

jorgealves/agent_skills

Detects and redacts Personally Identifiable Information (PII) like emails, phone numbers, and credit cards. Use when cleaning logs, datasets, or communications to comply with GDPR/CCPA privacy standards.

2026-01-252

poetry-uv-advisor

jorgealves/agent_skills

Optimize pyproject.toml and resolve complex dependency trees using modern tools like Poetry or uv. Use to modernize Python project management.

2026-01-252

prompt-injection-scanner

jorgealves/agent_skills

Audits agent skill instructions and system prompts for vulnerabilities to prompt hijacking and indirect injection. Use when designing new agent skills or before deploying agents to public environments where users provide untrusted input.

2026-01-252

name	python-data-pipeline-designer
description	Design ETL workflows with data validation using tools like Pandas, Dask, or PySpark. Use when building robust data processing systems in Python.

Python Data Pipeline Designer

Purpose and Intent

Design ETL workflows with data validation using tools like Pandas, Dask, or PySpark. Use when building robust data processing systems in Python.

When to Use

Project Setup: When initializing a new Python project.
Continuous Integration: As part of automated build and test pipelines.
Legacy Refactoring: When updating older Python codebases to modern standards.

When NOT to Use

Non-Python Projects: This tool is specialized for the Python ecosystem.

Error Conditions and Edge Cases

Missing Requirements: If the project lacks a requirements.txt or pyproject.toml.
Incompatible Versions: If the project uses a Python version not supported by the tools.

Security and Data-Handling Considerations

All analysis is performed locally.
No source code or credentials are ever transmitted externally.