file-processing

name	file-processing
description	Data file processing utilities for CSV, JSON, and text files. Provides helpers for reading, transforming, and validating structured data.

File Processing Skill

This skill provides utilities and guidance for building robust file processing applications.

Purpose

Use this skill when your task involves:

• Reading and parsing CSV, JSON, or text files
• Data validation and cleaning
• File format conversions
• Batch processing of multiple files
• Generating reports from data files

Key Capabilities

1. Data Reading

• CSV parsing with header detection
• JSON file handling (single object or array)
• Text file processing line-by-line
• Error handling for malformed files

2. Data Validation

• Check for required fields
• Validate data types
• Handle missing values
• Report data quality issues

3. Data Transformation

• Filter rows based on conditions
• Calculate statistics (sum, avg, count)
• Format conversions
• Data aggregation

4. Output Generation

• Write processed data to new files
• Generate summary reports
• Create multiple output formats

Best Practices

Project Structure for File Processing

project/
├── main.py              # Entry point with CLI
├── file_reader.py       # File I/O operations
├── data_processor.py    # Core processing logic
├── validator.py         # Data validation
├── config.py            # Configuration constants
└── utils.py             # Helper functions

Error Handling Pattern

def ():
    
    :
          os.path.exists(filepath):
             FileNotFoundError()

         (filepath, , encoding=)  f:
             f.read()
     Exception  e:
        ()