القائمة
Data loading stage — parses CSV and JSON files into normalized records with configurable delimiters and encoding detection.
التثبيت باستخدام Codex أو Claude انسخ هذا Prompt والصقه في Codex أو Claude أو مساعد آخر ليراجع صفحة Skill ويثبّتها لك.
استنادا إلى تصنيف SOC المهني
Validate tabular data against configurable business rules — range checks, cross-column constraints, referential integrity against lookup tables, and temporal consistency.
Load and parse CSV files into structured data frames with configurable encoding, delimiter, and date parsing options.
Export pandas DataFrames or processed datasets to well-formatted CSV files with configurable encoding, delimiter, quoting, and column ordering.
Aggregate tabular data by one or more dimensions with configurable metrics — sum, mean, count, min, max, median. Supports multi-level grouping and pivot table generation.
Comprehensive data cleaning toolkit — handles missing values, duplicate removal, type coercion, whitespace trimming, and outlier detection in a single pass over the dataset.
Identify and remove duplicate records from tabular datasets using exact-match, fuzzy-match, or composite-key-based deduplication strategies.
| name | data-loader |
| description | Data loading stage — parses CSV and JSON files into normalized records with configurable delimiters and encoding detection. |
| version | 1.0.0 |
The loading stage of the report-generator-pipeline. Handles reading raw data files (CSV or JSON) and converting them into a unified list-of-dicts format for downstream processing.
CSV parsing supports comma (,) and tab (\t) delimiters with configurable encoding.
JSON parsing handles both standard JSON arrays and JSON Lines format.
| Directory | Script | Description |
|---|---|---|
csv-parser/ | parser.py | Parse CSV with comma/tab delimiters and encoding |
json-parser/ | parser.py | Parse JSON arrays and JSON Lines files |
--input / -i: Path to data file (required)--delimiter / -d: CSV delimiter: , or \t (default: ,; ignored for JSON)--encoding / -e: File encoding (default: utf-8)--output / -o: Output directory for parsed resultparsed_data.json: List of record dicts in JSON formatThe CSV parser supports two delimiter types:
,): Standard CSV format\t): Tab-separated values (TSV)Other delimiters are not currently supported. If you need pipe-delimited or semicolon-delimited files, pre-convert them to CSV before loading.