Run any Skill in Manus with one click

pipeline-context

Load context for pipeline, cron, Lambda, OCR, and translation work. Use when starting any pipeline monitoring, debugging, or processing task.

Run Skill in Manus

Overview

Load context for pipeline, cron, Lambda, OCR, and translation work. Use when starting any pipeline monitoring, debugging, or processing task.

Install command

npx skills add https://github.com/Embassy-of-the-Free-Mind/sourcelibrary-v2 --skill pipeline-context

Copy and paste this command into Claude Code to install the skill

Source

Embassy-of-the-Free-Mind/sourcelibrary-v2

Stars3

Forks3

UpdatedMay 17, 2026 at 07:41

SKILL.md

readonly

name	pipeline-context
description	Load context for pipeline, cron, Lambda, OCR, and translation work. Use when starting any pipeline monitoring, debugging, or processing task.

Pipeline Context

Read these files before proceeding with pipeline work:

memory/pipeline-ops.md — Emergency controls, worker architecture, operational details
memory/lessons-learned.md — Operational postmortems and patterns
.claude/docs/pipeline.md — Full processing pipeline (states, crons, prompts, costs)
.claude/docs/worker-architecture.md — Lambda worker details
.claude/docs/page-lifecycle.md — Page processing states

Critical Rules

Model selection: prefer getModelForBook(book) from src/lib/types/ai-models.ts over hardcoding. It routes BPH books and non-Latin-script languages to gemini-3-flash-preview (full quality) and everything else to gemini-3.1-flash-lite-preview (50% cheaper, comparable quality on Latin-script). Enrich-worker uses gemini-3.1-flash-lite-preview for all phases (summary+index, chapters, quality scoring, collection assignment). Never use anything below Gemini v3 — gemini-2.x is deprecated.
NEVER use Gemini Batch API for translation — use Lambda workers (SQS FIFO)
Any script overwriting ocr.data or translation.data MUST call createRevision() first
MongoDB Atlas saturates at ~40 concurrent Lambda jobs — global backpressure limit
Emergency stop: system_config._id: 'processing_control', set paused: true

Audit Trail

All AI calls logged to gemini_usage collection via logGeminiCall() in src/lib/gemini-logger.ts.

Book history timeline: GET /api/books/[id]/history (assembles from 6 collections)
Dashboard: GET /api/admin/processing-dashboard?provider=ia
Error classification: src/lib/errors.ts → classifyError(error)
cost_tracking collection is DEPRECATED — use gemini_usage for all cost queries

Staleness Check

After reading the memory files above, flag anything that contradicts what you observe in the codebase:

File paths or function names that no longer exist
Behavioral claims that don't match the current code
Stats or counts with dates older than 14 days — note as potentially stale
If you find contradictions, update the memory file immediately and tell the user what changed.

Also Relevant

Batch processing (Gemini Batch API): .claude/docs/batch-processing.md
Observability & audit trail: .claude/docs/observability.md
First translation identification: .claude/docs/first-translation-system.md

More from this repository

same repository

curator

Embassy-of-the-Free-Mind/sourcelibrary-v2

Autonomous curator for Source Library. Discover, evaluate, and import historical texts from digital archives. Assigns books to collections. Outputs batch import scripts for efficient acquisition.

2026-05-183

batch-translate

Embassy-of-the-Free-Mind/sourcelibrary-v2

Batch process books through the complete pipeline - generate cropped images for split pages, OCR all pages, then translate with context. Use when asked to process, OCR, translate, or batch process one or more books.

2026-05-173

library-curator

Embassy-of-the-Free-Mind/sourcelibrary-v2

Autonomous curator for Source Library - discover, evaluate, and import historical texts in alchemy, Hermetica, Kabbalah, Rosicrucianism, and early modern knowledge. Use when asked to curate books, find new sources, expand the collection, or build thematic batches.

2026-05-173

curate-collection

Embassy-of-the-Free-Mind/sourcelibrary-v2

Populate a collection page with editorial content — expanded description, highlighted books, gallery images, sourced quotes. Also audits existing collections for staleness, broken links, and missing content. Use when a collection exists but needs its content built out, or when auditing collection quality.

2026-04-243

qa-eval

Embassy-of-the-Free-Mind/sourcelibrary-v2

Run OCR and translation quality evaluations across scripts and languages. Produces research-grade reports with MCR, cross-model agreement, embedding-space hallucination detection, and corpus readiness scores.

2026-04-233

status

Embassy-of-the-Free-Mind/sourcelibrary-v2

Quick canon + pipeline health check. Use when asked "how's it going?", "status?", "how's the db?", or any quick health check. Lighter than /progress — focuses on mission metrics, not job debugging.

2026-04-143

Source

Embassy-of-the-Free-Mind

Embassy-of-the-Free-Mind/sourcelibrary-v2

View GitHub Repository View Creator Repositories

Install command

Download

Run Skill in Manus

Useful forSOC

Software DevelopersComputer and Mathematical Occupations15-1252L4

name	pipeline-context
description	Load context for pipeline, cron, Lambda, OCR, and translation work. Use when starting any pipeline monitoring, debugging, or processing task.

Pipeline Context

Read these files before proceeding with pipeline work:

memory/pipeline-ops.md — Emergency controls, worker architecture, operational details
memory/lessons-learned.md — Operational postmortems and patterns
.claude/docs/pipeline.md — Full processing pipeline (states, crons, prompts, costs)
.claude/docs/worker-architecture.md — Lambda worker details
.claude/docs/page-lifecycle.md — Page processing states

Critical Rules

Model selection: prefer getModelForBook(book) from src/lib/types/ai-models.ts over hardcoding. It routes BPH books and non-Latin-script languages to gemini-3-flash-preview (full quality) and everything else to gemini-3.1-flash-lite-preview (50% cheaper, comparable quality on Latin-script). Enrich-worker uses gemini-3.1-flash-lite-preview for all phases (summary+index, chapters, quality scoring, collection assignment). Never use anything below Gemini v3 — gemini-2.x is deprecated.
NEVER use Gemini Batch API for translation — use Lambda workers (SQS FIFO)
Any script overwriting ocr.data or translation.data MUST call createRevision() first
MongoDB Atlas saturates at ~40 concurrent Lambda jobs — global backpressure limit
Emergency stop: system_config._id: 'processing_control', set paused: true

Audit Trail

All AI calls logged to gemini_usage collection via logGeminiCall() in src/lib/gemini-logger.ts.

Book history timeline: GET /api/books/[id]/history (assembles from 6 collections)
Dashboard: GET /api/admin/processing-dashboard?provider=ia
Error classification: src/lib/errors.ts → classifyError(error)
cost_tracking collection is DEPRECATED — use gemini_usage for all cost queries

Staleness Check

After reading the memory files above, flag anything that contradicts what you observe in the codebase:

File paths or function names that no longer exist
Behavioral claims that don't match the current code
Stats or counts with dates older than 14 days — note as potentially stale
If you find contradictions, update the memory file immediately and tell the user what changed.

Also Relevant

Batch processing (Gemini Batch API): .claude/docs/batch-processing.md
Observability & audit trail: .claude/docs/observability.md
First translation identification: .claude/docs/first-translation-system.md