원클릭으로
data-loader
Data loading stage — parses CSV and JSON files into normalized records with configurable delimiters and encoding detection.
Codex 또는 Claude로 설치 이 Prompt를 복사해 Codex, Claude 또는 다른 어시스턴트에 붙여 넣으면 Skill 페이지를 검토하고 설치를 진행할 수 있습니다.
메뉴
Data loading stage — parses CSV and JSON files into normalized records with configurable delimiters and encoding detection.
Codex 또는 Claude로 설치 이 Prompt를 복사해 Codex, Claude 또는 다른 어시스턴트에 붙여 넣으면 Skill 페이지를 검토하고 설치를 진행할 수 있습니다.
Validate tabular data against configurable business rules — range checks, cross-column constraints, referential integrity against lookup tables, and temporal consistency.
Load and parse CSV files into structured data frames with configurable encoding, delimiter, and date parsing options.
Export pandas DataFrames or processed datasets to well-formatted CSV files with configurable encoding, delimiter, quoting, and column ordering.
Aggregate tabular data by one or more dimensions with configurable metrics — sum, mean, count, min, max, median. Supports multi-level grouping and pivot table generation.
Comprehensive data cleaning toolkit — handles missing values, duplicate removal, type coercion, whitespace trimming, and outlier detection in a single pass over the dataset.
Identify and remove duplicate records from tabular datasets using exact-match, fuzzy-match, or composite-key-based deduplication strategies.
SOC 직업 분류 기준
| name | data-loader |
| description | Data loading stage — parses CSV and JSON files into normalized records with configurable delimiters and encoding detection. |
| version | 1.0.0 |
The loading stage of the report-generator-pipeline. Handles reading raw data files (CSV or JSON) and converting them into a unified list-of-dicts format for downstream processing.
CSV parsing supports comma (,) and tab (\t) delimiters with configurable encoding.
JSON parsing handles both standard JSON arrays and JSON Lines format.
| Directory | Script | Description |
|---|---|---|
csv-parser/ | parser.py | Parse CSV with comma/tab delimiters and encoding |
json-parser/ | parser.py | Parse JSON arrays and JSON Lines files |
--input / -i: Path to data file (required)--delimiter / -d: CSV delimiter: , or \t (default: ,; ignored for JSON)--encoding / -e: File encoding (default: utf-8)--output / -o: Output directory for parsed resultparsed_data.json: List of record dicts in JSON formatThe CSV parser supports two delimiter types:
,): Standard CSV format\t): Tab-separated values (TSV)Other delimiters are not currently supported. If you need pipe-delimited or semicolon-delimited files, pre-convert them to CSV before loading.