| name | document-rag-pipeline-architecture |
| description | Sub-skill of document-rag-pipeline: Architecture. |
| version | 1.1.0 |
| category | data |
| type | reference |
| scripts_exempt | true |
Architecture
Architecture
Document Folder
โ
โผ
โโโโโโโโโโโโโโโโโโโโโโโ
โ 1. Build Inventory โ SQLite catalog of all files
โโโโโโโโโโโโฌโโโโโโโโโโโ
โผ
โโโโโโโโโโโโโโโโโโโโโโโ
โ 2. Extract Text โ PyMuPDF for regular PDFs
โโโโโโโโโโโโฌโโโโโโโโโโโ
โผ
โโโโโโโโโโโโโโโโโโโโโโโ
โ 3. OCR Scanned PDFs โ Tesseract + pytesseract
โโโโโโโโโโโโฌโโโโโโโโโโโ
โผ
โโโโโโโโโโโโโโโโโโโโโโโ
โ 4. Chunk Text โ 1000 chars, 200 overlap
โโโโโโโโโโโโฌโโโโโโโโโโโ
โผ
โโโโโโโโโโโโโโโโโโโโโโโ
โ 5. Generate Embeds โ sentence-transformers
โโโโโโโโโโโโฌโโโโโโโโโโโ
โผ
โโโโโโโโโโโโโโโโโโโโโโโ
โ 6. Semantic Search โ Cosine similarity
โโโโโโโโโโโโโโโโโโโโโโโ