data-processing

name	data_processing
description	Process and analyze structured data. Use when working with CSV, JSON, or other structured data formats for transformation, filtering, or analysis.

Data Processing Skill

This skill enables you to process, transform, and analyze structured data in various formats including CSV, JSON, and text files.

When to Use This Skill

Use this skill when:

• Reading or parsing CSV, JSON, or structured data files
• Transforming data between formats
• Filtering or sorting data records
• Calculating statistics or aggregations
• Generating summaries or reports from data
• Handling large datasets efficiently

Capabilities

• Read and parse CSV, JSON, and other structured formats
• Transform data between formats
• Filter and sort data
• Calculate statistics and aggregations
• Generate summaries and reports
• Handle large datasets efficiently

Guidelines

1. First understand the data structure by reading a sample
2. Use appropriate parsing for each format:
   • CSV: Split by delimiter, handle quoted fields
   • JSON: Parse with JSON library or tools
   • Fixed-width: Extract by character positions
3. For large files, read in chunks or use line-based processing
4. Validate data before processing
5. Report data quality issues (missing values, format errors)
6. Provide summary statistics when appropriate

Common Operations

Data Filtering

• Filter rows by condition
• Select specific columns
• Remove duplicates

Data Transformation

• Convert between formats
• Rename columns
• Calculate derived fields