AI4S_Data_Agent_Swarm
AI4S_Data_Agent_Swarm contains 5 collected skills from GitHub-Ninghai, with repository-level occupation coverage and site-owned skill detail pages.
Skills in this repository
Designs and builds ETL/ELT data pipelines. Takes data sources, destination, transformation requirements. Generates pipeline code (Python/SQL), scheduling config, error handling, monitoring setup, and data quality checks. Outputs data-pipeline-spec.md + implementation files.
Review AI4S generated data for structure, scientific consistency, and hallucination risk.
Use MinerU to parse scientific PDFs into structured JSON for AI4S data generation.
Coordinate crawler, parser, synthesizer, and reviewer agents for AI4S data production.
Generate Sci-Evo style AI4S training data from structured paper content.