AI4S_Data_Agent_Swarm

Designs and builds ETL/ELT data pipelines. Takes data sources, destination, transformation requirements. Generates pipeline code (Python/SQL), scheduling config, error handling, monitoring setup, and data quality checks. Outputs data-pipeline-spec.md + implementation files.

Review AI4S generated data for structure, scientific consistency, and hallucination risk.

Use MinerU to parse scientific PDFs into structured JSON for AI4S data generation.

Coordinate crawler, parser, synthesizer, and reviewer agents for AI4S data production.

Generate Sci-Evo style AI4S training data from structured paper content.