pipeline-context

スター13

フォーク2

更新日2026年5月17日 07:41

Load context for pipeline, cron, Lambda, OCR, and translation work. Use when starting any pipeline monitoring, debugging, or processing task.

インストール

Codex または Claude でインストールこの Prompt をコピーして Codex、Claude、または他のアシスタントに貼り付けると、Skill ページを確認してインストールできます。

ソース

Embassy-of-the-Free-Mind

Embassy-of-the-Free-Mind/sourcelibrary-v2

GitHub リポジトリを開く Creator のリポジトリを見る

ダウンロード

Pipeline Context

Read these files before proceeding with pipeline work:

memory/pipeline-ops.md — Emergency controls, worker architecture, operational details
memory/lessons-learned.md — Operational postmortems and patterns
.claude/docs/pipeline.md — Full processing pipeline (states, crons, prompts, costs)
.claude/docs/worker-architecture.md — Lambda worker details
.claude/docs/page-lifecycle.md — Page processing states

Critical Rules

Model selection: prefer getModelForBook(book) from src/lib/types/ai-models.ts over hardcoding. It routes BPH books and non-Latin-script languages to gemini-3-flash-preview (full quality) and everything else to gemini-3.1-flash-lite-preview (50% cheaper, comparable quality on Latin-script). Enrich-worker uses gemini-3.1-flash-lite-preview for all phases (summary+index, chapters, quality scoring, collection assignment). Never use anything below Gemini v3 — gemini-2.x is deprecated.
NEVER use Gemini Batch API for translation — use Lambda workers (SQS FIFO)
Any script overwriting ocr.data or translation.data MUST call createRevision() first
MongoDB Atlas saturates at ~40 concurrent Lambda jobs — global backpressure limit
Emergency stop: system_config._id: 'processing_control', set paused: true

Audit Trail

All AI calls logged to gemini_usage collection via logGeminiCall() in src/lib/gemini-logger.ts.

Book history timeline: GET /api/books/[id]/history (assembles from 6 collections)
Dashboard: GET /api/admin/processing-dashboard?provider=ia
Error classification: src/lib/errors.ts → classifyError(error)
cost_tracking collection is DEPRECATED — use gemini_usage for all cost queries

Staleness Check

After reading the memory files above, flag anything that contradicts what you observe in the codebase:

File paths or function names that no longer exist
Behavioral claims that don't match the current code
Stats or counts with dates older than 14 days — note as potentially stale
If you find contradictions, update the memory file immediately and tell the user what changed.

Also Relevant

Batch processing (Gemini Batch API): .claude/docs/batch-processing.md
Observability & audit trail: .claude/docs/observability.md
First translation identification: .claude/docs/first-translation-system.md

このリポジトリの他の Skills

同じリポジトリ

qa-eval

Embassy-of-the-Free-Mind/sourcelibrary-v2

Run OCR and translation quality evaluations across scripts and languages. Produces research-grade reports with MCR, cross-model agreement, embedding-space hallucination detection, and corpus readiness scores.

2026-07-1913

glass-bead-game

Embassy-of-the-Free-Mind/sourcelibrary-v2

Run a Glass Bead Game session — a parlor game played against the Source Library corpus. Players connect verified passages from different books, times, and traditions into a growing string of 'beads,' with Claude as librarian, verifier, and scribe. Trigger when the user says 'glass bead game,' 'let's play beads,' or asks to start/resume/publish a game session. Claude runs the search-verify-display loop; humans do the noticing, choosing, and judging.

2026-07-1813

ft-verify

Embassy-of-the-Free-Mind/sourcelibrary-v2

Stage-2 verification of first-translation flips using INDEPENDENT Claude subagents (subscription, not API key) with full evidence capture. Use to verify proposed badge changes (demotes/promotes) before writing any public claim — the binding step that catches AI-fabricated priors. Each subagent reports its actual search queries + sources, persisted to the first_translation_attempts provenance log.

2026-07-1313

feedback

Embassy-of-the-Free-Mind/sourcelibrary-v2

Triage and respond to the user-feedback queue — pull open feedback, detect items already fixed but never marked, route translation-requests and metadata-corrections, mark items resolved, and (on approval) email submitters. Use when asked to check/triage/answer/clear feedback, "what are people saying?", or "respond to feedback."

2026-07-0613

promote-lessons

Embassy-of-the-Free-Mind/sourcelibrary-v2

Sweep Claude's private per-machine memory for team-relevant operational knowledge and propose moving it into the shared repo (or the private ops repo) as draft PRs. Use to promote lessons that accreted privately, or run on a schedule. Never auto-merges; never leaks.

2026-06-3013

metrics

Embassy-of-the-Free-Mind/sourcelibrary-v2

One-shot audience & usage report — signups, DAU/MAU, time on-site, traffic, top content, search behavior, referrers, countries, and user journeys. Use when asked "what's our usage?", "how many signups?", "time on site?", "traffic?", or any audience/engagement metrics question.

2026-06-2813

Pipeline Context

Read these files before proceeding with pipeline work:

memory/pipeline-ops.md — Emergency controls, worker architecture, operational details

memory/lessons-learned.md — Operational postmortems and patterns

.claude/docs/pipeline.md — Full processing pipeline (states, crons, prompts, costs)

.claude/docs/worker-architecture.md — Lambda worker details

.claude/docs/page-lifecycle.md — Page processing states

Critical Rules

Model selection: prefer getModelForBook(book) from src/lib/types/ai-models.ts over hardcoding. It routes BPH books and non-Latin-script languages to gemini-3-flash-preview (full quality) and everything else to gemini-3.1-flash-lite-preview (50% cheaper, comparable quality on Latin-script). Enrich-worker uses gemini-3.1-flash-lite-preview for all phases (summary+index, chapters, quality scoring, collection assignment). Never use anything below Gemini v3 — gemini-2.x is deprecated.

NEVER use Gemini Batch API for translation — use Lambda workers (SQS FIFO)

Any script overwriting ocr.data or translation.data MUST call createRevision() first

MongoDB Atlas saturates at ~40 concurrent Lambda jobs — global backpressure limit

Emergency stop: system_config._id: 'processing_control', set paused: true

Audit Trail

All AI calls logged to gemini_usage collection via logGeminiCall() in src/lib/gemini-logger.ts.

Book history timeline: GET /api/books/[id]/history (assembles from 6 collections)

Dashboard: GET /api/admin/processing-dashboard?provider=ia

Error classification: src/lib/errors.ts → classifyError(error)

cost_tracking collection is DEPRECATED — use gemini_usage for all cost queries

Staleness Check

After reading the memory files above, flag anything that contradicts what you observe in the codebase:

File paths or function names that no longer exist

Behavioral claims that don't match the current code

Stats or counts with dates older than 14 days — note as potentially stale

If you find contradictions, update the memory file immediately and tell the user what changed.

Also Relevant

Batch processing (Gemini Batch API): .claude/docs/batch-processing.md

Observability & audit trail: .claude/docs/observability.md

First translation identification: .claude/docs/first-translation-system.md

name	pipeline-context
description	Load context for pipeline, cron, Lambda, OCR, and translation work. Use when starting any pipeline monitoring, debugging, or processing task.