| name | open-files-corpus-reader |
| description | Read, extract, classify, and audit large open-files corpora across text, PDF, Office, image, audio, video, archive, raw/design, and unknown MIME types. Use when Codewith needs to inspect migrated Google Drive files, build extraction coverage, decide which tools or AI passes are required, create redacted corpus reports, or prepare semantic classification without exposing private filenames, object keys, or file contents. |
Open Files Corpus Reader
Core Rule
Treat open-files as the source-of-truth byte layer. Read through open-files scheme refs, files CLI/MCP, or canonical S3 mappings. Do not paste private filenames, object keys, extracted text, OCR text, transcripts, ACL payloads, or row payloads into user-facing output unless the user explicitly approves that disclosure.
Workflow
-
Audit coverage first.
- Run
scripts/mime_coverage_audit.py from this skill for redacted counts.
- Run
scripts/build_corpus_map.py --output-dir <private-artifacts/corpus-map> for the full public aggregate plus private worker map.
- Run
scripts/provider_inventory.py --include-vault when provider/key routing matters.
- Report only MIME/category/count/bytes/owner/status aggregates.
- Use
files organize stats --json and files organize apply-drive-policy --json to verify metadata state.
-
Choose the extraction lane.
- Text-like files: use existing
files extract-text / files extract-snapshot.
- PDF: use
scripts/extract_pdf_text.py for bounded pdftotext, then AI summarize/classify the extracted artifact.
- Office/OpenDocument: use
scripts/extract_office_text.py for LibreOffice text conversion plus optional structured block/table sidecar, then AI summarize/classify.
- Images/scans: use
scripts/extract_image_ocr.py for bounded OCR artifacts when tesseract is available; otherwise write explicit OCR/vision/human-review routing and optional private vision-request artifacts for approved provider passes.
- Audio/video: require
ffmpeg plus transcription/keyframe extraction; use metadata-only until available.
- Archives: use
scripts/archive_inventory.py first, then recursively classify allowed children.
- RAW/PSD/design/proprietary binaries: metadata, preview, sidecar, or AI vision if available.
-
Extract bounded artifacts.
- Limit bytes/pages/duration.
- Store extracted text/snapshots as derived artifacts, never as the canonical source.
- Preserve
source_ref, revision id, checksum, extractor version, and status.
- Index bounded search text through
files search-index add; do not write search tables directly.
-
Classify with AI only after extraction.
- Give the model a small redacted excerpt or summary, not whole private files.
- Ask for owner, document kind, date, entity, sensitivity, suggested name, confidence, and reason.
- Mark uncertain results for human review instead of forcing a name.
-
Keep outputs reversible.
- Do not rename S3 keys.
- Propose or update metadata fields such as
target_path, canonical_name, labels, classification, and review notes.
- Keep legacy/import buckets readable until final audit and rollback windows close.
Approval Notes
For approved plan regeneration, pass private operator approval JSON with
--approval-note-file. Do not place raw approval-note text in command lines,
task comments, reviewer packets, or public summaries. Approved planners and
validators should preserve only hash attestations in generated plans.
Search-index, large-file, and LLM campaign runners must pass the plan approval
attestation into global_execution_preflight.py. Explicit canary or scale
execution is invalid unless the plan is approved, an approval note is present,
and the approval-note SHA-256 attestation is valid. If the readiness gate is
present but that token is missing or invalid, the aggregate preflight must
return canary_approval_token_required or scale_approval_token_required with
allowed=false; canary caps alone are never sufficient.
Search-index canary and scale runs must also emit post-run CLI search probe
evidence before they can be treated as verified. The probe may use private
query strings stored only in private artifacts, but public summaries must expose
only query/result hashes, counts, latency stats, and whether the expected
indexed file was found through files search --scope content. Verifiers and
scale-readiness gates should fail closed if this probe is missing, slow, or
unmatched.
The replacement-readiness verifier recomputes current source artifact
bytes/hashes by default. operator_approval_blocker_report and
adversarial_review_results are known cyclic sources: the blocker report
consumes replacement verification while the replacement gate consumes the
blocker report, and adversarial results attest to a packet that snapshots the
replacement gate. Treat those labels as allowed cyclic warnings, not freshness
failures, unless running an explicitly strict audit.
Search-index, large-file, and extraction-worker approval packets must carry
source artifact hashes plus redaction_check/approval_packet_checks; packet
generation should fail closed if sensitive markers appear, even when the source
plan validation is otherwise complete.
Extraction-worker image evidence must also carry no-network Docker runtime
policy proof for docker run smoke/inventory commands: network mode none, no
provider/S3/Google Drive/DB egress, no corpus mounts, read-only rootfs, dropped
capabilities, no-new-privileges, and hashed command logs only. Treat stale
worker-image verification without that policy as blocked until regenerated.
The extraction tool remediation packet must carry packet_checks,
packet_errors, source artifact hashes, redaction status, and non-mutation
attestation. Treat it as invalid if required aggregate inputs are missing,
unhashed, or redaction fails.
The operator-approval blocker-report verifier also recomputes current
bytes/hashes for its seven file source artifacts by default, including the
extraction lane readiness verification. It also reruns the live
todos ready --json input as aggregate counts by default and compares ready
total, approval, media, non-approval non-media, and Drive/ACL approval counts
without storing task payloads.
The Drive approval queue builder writes the aggregate-only Drive/ACL
organization approval queue. It records ready-todo categories, row-count hints,
approval-prep doc hashes, and non-mutation/redaction attestations without Drive
row payloads, private filenames, ACL payloads, object keys, or source refs.
Verify it with verify_drive_approval_queue.py; the verifier recomputes
current approval-prep doc hashes and live ready-todo semantics before the final
operator approval evidence bundle can pass.
Drive approval-note templates are private fill-in artifacts, not approvals.
Build them from the verified Drive approval queue with
build_drive_approval_note_templates.py, validate completed private notes with
validate_drive_approval_notes.py, and verify packet/summary freshness with
verify_drive_approval_notes.py. The summary must expose only decision IDs,
hashes, status, counts, source doc hashes, and aggregate context; approval-note
text, row payloads, ACL payloads, filenames, object keys, and source refs must
stay private.
The stage-dependency verifier recomputes current bytes/hashes for its nine
aggregate source artifacts by default, including Drive approval-note summary
and verification artifacts. When stage or replacement verifiers gain new
critical gates, propagate those gates into the operator blocker report builder
so the safe-next-step report does not hide upstream freshness status.
The operator approval evidence bundle verifier is the final aggregate check for
the approval-safe chain. Run it after dashboard, approval request, stage,
adversarial, replacement, Drive approval queue, Drive approval-note, and
blocker artifacts are refreshed. It reruns the lower-level verifiers
in-process, including approval intake and post-approval command plan/run
freshness checks, allows only the known replacement cyclic warnings, scans all
refreshed aggregate artifacts/prompts/results for sensitive markers, and can
require that the safe next step is operator approval.
The search-index/readiness reconciliation verifier emits source artifact hashes
for the search-index plan and extraction readiness gate, plus a formal
redaction check. Treat reconciliation output as invalid if those source hashes
or redaction gates are missing.
The extraction lane readiness verifier recomputes current source artifact
bytes/hashes and can rebuild the aggregate gate from the corpus map, tool
inventory, smoke summary, optional worker inventory, and deferred media summary.
Run it after extraction_lane_readiness_gate.py and before stage, replacement,
adversarial, or final evidence-bundle refreshes.
The operator approval request packet records source artifact hashes for the
extraction approval dashboard and approval-notes summary. Its verifier
recomputes those source bytes/hashes by default, and the blocker report should
forward that freshness gate in approval-request critical evidence.
The extraction approval dashboard must carry dashboard_checks,
dashboard_errors, redaction_check, source artifact hashes, and a
non-mutation attestation. Verify it with
verify_extraction_approval_dashboard.py before rebuilding approval templates,
stage gates, replacement gates, adversarial packets, or blocker reports.
The operator approval intake verifier maps validated approval-note status to
the matching ready canary tasks without granting approval or launching work. It
also consumes Drive approval-note summary/verification as a global unlock gate:
canary tasks must stay locked until both extraction/index/LLM approval notes
and Drive organization approval notes are valid. Run it after
validate_operator_approval_notes.py, validate_drive_approval_notes.py, and
verify_drive_approval_notes.py and before any approved canary execution. It
must stay aggregate-only and expose only decision IDs, hash attestations,
counts, tags, and short task IDs.
The post-approval canary command planner consumes approval intake, Drive
approval-note summary/verification, and dashboard command maps, then emits only
command refs, hashes, byte counts, mutation class, and execution ordering. It
never copies raw commands or runs them. Treat blocked_no_unlocked_decisions
or blocked_drive_approval_notes as expected states until valid operator and
Drive approval notes exist. Verify it with
verify_post_approval_canary_command_plan.py before using the command refs for
any approved canary execution.
Post-approval command plans and runner summaries must also carry a current
operator-approval blocker report source artifact plus an aggregate
safe-next-step snapshot. Plan verification and dry-run/execution runners should
fail closed if that blocker report is missing, stale, invalid, or not at the
expected operator-approval step before approvals are granted.
The post-approval canary runner defaults to dry-run and must refuse execution
unless the command plan verifier is ok, the plan status is
ready_for_operator_execution, current Drive approval notes are approved and
verified, command refs resolve to current dashboard commands, and hashes match.
Raw commands and command logs must stay out of public summaries; execution logs
belong under private artifacts only. Verify the run summary with
verify_post_approval_canary_command_run.py.
When approval, stage, replacement, or adversarial packet sources change,
regenerate the adversarial review packet and rerun both reviewer agents. The
adversarial packet verifier recomputes current source hashes; reviewer results
must carry matching packet/schema/prompt input attestations before replacement
readiness can treat the adversarial review as fresh.
Useful Commands
python3 .codewith/skills/open-files-corpus-reader/scripts/mime_coverage_audit.py
python3 .codewith/skills/open-files-corpus-reader/scripts/provider_inventory.py --include-vault
python3 .codewith/skills/open-files-corpus-reader/scripts/extraction_tool_inventory.py
python3 .codewith/skills/open-files-corpus-reader/scripts/build_extraction_tool_remediation_packet.py --tool-inventory <private-artifacts/extraction-tool-inventory.json> --lane-readiness-gate <private-artifacts/extraction-lane-readiness-gate.json> --worker-approval-packet <private-artifacts/extraction-worker-image-approval-packet.json> --output <private-artifacts/extraction-tool-remediation-packet.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/verify_extraction_worker_image.py --output <private-artifacts/extraction-worker-image-verification.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/build_extraction_worker_image_approval_packet.py --verification <private-artifacts/extraction-worker-image-verification.json> --output <private-artifacts/extraction-worker-image-approval-packet.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/validate_operator_approval_notes.py --notes-dir <private-artifacts/operator-approvals> --approval-request-packet <private-artifacts/operator-approvals/approval-request-packet.json> --output <private-artifacts/operator-approvals/approval-notes-summary.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/verify_operator_approval_intake.py --approval-notes-summary <private-artifacts/operator-approvals/approval-notes-summary.json> --approval-request-packet <private-artifacts/operator-approvals/approval-request-packet.json> --approval-request-verification <private-artifacts/operator-approvals/approval-request-packet-verification.json> --drive-approval-notes-summary <private-artifacts/drive-approval/drive-approval-notes-summary.json> --drive-approval-notes-verification <private-artifacts/drive-approval/drive-approval-notes-verification.json> --dashboard <private-artifacts/extraction-approval-dashboard.json> --blocker-report <private-artifacts/operator-approval-blocker-report.json> --output <private-artifacts/operator-approvals/approval-intake-readiness.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/build_post_approval_canary_command_plan.py --intake <private-artifacts/operator-approvals/approval-intake-readiness.json> --dashboard <private-artifacts/extraction-approval-dashboard.json> --drive-approval-notes-summary <private-artifacts/drive-approval/drive-approval-notes-summary.json> --drive-approval-notes-verification <private-artifacts/drive-approval/drive-approval-notes-verification.json> --operator-approval-blocker-report <private-artifacts/operator-approval-blocker-report.json> --output <private-artifacts/operator-approvals/post-approval-canary-command-plan.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/verify_post_approval_canary_command_plan.py --plan <private-artifacts/operator-approvals/post-approval-canary-command-plan.json> --intake <private-artifacts/operator-approvals/approval-intake-readiness.json> --dashboard <private-artifacts/extraction-approval-dashboard.json> --drive-approval-notes-summary <private-artifacts/drive-approval/drive-approval-notes-summary.json> --drive-approval-notes-verification <private-artifacts/drive-approval/drive-approval-notes-verification.json> --operator-approval-blocker-report <private-artifacts/operator-approval-blocker-report.json> --output <private-artifacts/operator-approvals/post-approval-canary-command-plan-verification.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/run_post_approval_canary_command_plan.py --plan <private-artifacts/operator-approvals/post-approval-canary-command-plan.json> --plan-verification <private-artifacts/operator-approvals/post-approval-canary-command-plan-verification.json> --dashboard <private-artifacts/extraction-approval-dashboard.json> --drive-approval-notes-summary <private-artifacts/drive-approval/drive-approval-notes-summary.json> --drive-approval-notes-verification <private-artifacts/drive-approval/drive-approval-notes-verification.json> --operator-approval-blocker-report <private-artifacts/operator-approval-blocker-report.json> --output <private-artifacts/operator-approvals/post-approval-canary-command-run-summary.json> --log-dir <private-artifacts/operator-approvals/post-approval-canary-command-logs>
python3 .codewith/skills/open-files-corpus-reader/scripts/verify_post_approval_canary_command_run.py --run-summary <private-artifacts/operator-approvals/post-approval-canary-command-run-summary.json> --plan <private-artifacts/operator-approvals/post-approval-canary-command-plan.json> --plan-verification <private-artifacts/operator-approvals/post-approval-canary-command-plan-verification.json> --dashboard <private-artifacts/extraction-approval-dashboard.json> --drive-approval-notes-summary <private-artifacts/drive-approval/drive-approval-notes-summary.json> --drive-approval-notes-verification <private-artifacts/drive-approval/drive-approval-notes-verification.json> --operator-approval-blocker-report <private-artifacts/operator-approval-blocker-report.json> --output <private-artifacts/operator-approvals/post-approval-canary-command-run-verification.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/build_operator_approval_note_templates.py --dashboard <private-artifacts/extraction-approval-dashboard.json> --approval-notes-summary <private-artifacts/operator-approvals/approval-notes-summary.json> --output-dir <private-artifacts/operator-approvals/templates> --packet-output <private-artifacts/operator-approvals/approval-request-packet.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/verify_operator_approval_request_packet.py --packet <private-artifacts/operator-approvals/approval-request-packet.json> --output <private-artifacts/operator-approvals/approval-request-packet-verification.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/build_extraction_approval_dashboard.py --output <private-artifacts/extraction-approval-dashboard.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/verify_extraction_approval_dashboard.py --dashboard <private-artifacts/extraction-approval-dashboard.json> --output <private-artifacts/extraction-approval-dashboard-verification.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/build_drive_approval_queue.py --output <private-artifacts/drive-approval/drive-approval-queue.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/verify_drive_approval_queue.py --queue <private-artifacts/drive-approval/drive-approval-queue.json> --output <private-artifacts/drive-approval/drive-approval-queue-verification.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/build_drive_approval_note_templates.py --queue <private-artifacts/drive-approval/drive-approval-queue.json> --queue-verification <private-artifacts/drive-approval/drive-approval-queue-verification.json> --output-dir <private-artifacts/drive-approval/templates> --packet-output <private-artifacts/drive-approval/drive-approval-request-packet.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/validate_drive_approval_notes.py --notes-dir <private-artifacts/drive-approval> --drive-request-packet <private-artifacts/drive-approval/drive-approval-request-packet.json> --output <private-artifacts/drive-approval/drive-approval-notes-summary.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/verify_drive_approval_notes.py --packet <private-artifacts/drive-approval/drive-approval-request-packet.json> --notes-summary <private-artifacts/drive-approval/drive-approval-notes-summary.json> --output <private-artifacts/drive-approval/drive-approval-notes-verification.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/build_operator_approval_blocker_report.py --dashboard <private-artifacts/extraction-approval-dashboard.json> --adversarial-verification <private-artifacts/adversarial-review/adversarial-review-verification.json> --approval-request-packet <private-artifacts/operator-approvals/approval-request-packet.json> --approval-request-verification <private-artifacts/operator-approvals/approval-request-packet-verification.json> --stage-verification <private-artifacts/stage-dependency-verification.json> --replacement-verification <private-artifacts/replacement-readiness-verification.json> --extraction-readiness-verification <private-artifacts/extraction-lane-readiness-verification.json> --output <private-artifacts/operator-approval-blocker-report.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/verify_operator_approval_blocker_report.py --report <private-artifacts/operator-approval-blocker-report.json> --output <private-artifacts/operator-approval-blocker-report-verification.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/verify_operator_approval_evidence_bundle.py --output <private-artifacts/operator-approval-evidence-bundle-verification.json> --require-operator-approval-required
python3 .codewith/skills/open-files-corpus-reader/scripts/build_corpus_map.py --output-dir <private-artifacts/corpus-map>
python3 .codewith/skills/open-files-corpus-reader/scripts/extraction_smoke_matrix.py --limit-per-lane-bucket 1 --files-command 'bun run src/cli/index.tsx'
python3 .codewith/skills/open-files-corpus-reader/scripts/extraction_lane_readiness_gate.py --corpus-map <private-artifacts/corpus-map/corpus-map-public.json> --tool-inventory <private-artifacts/extraction-tool-inventory.json> --smoke-summary <private-artifacts/extraction-smoke-summary.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/extraction_lane_readiness_gate.py --corpus-map <private-artifacts/corpus-map/corpus-map-public.json> --tool-inventory <private-artifacts/extraction-tool-inventory.json> --worker-tool-inventory <private-artifacts/extraction-worker-tool-inventory.json> --smoke-summary <private-artifacts/extraction-smoke-summary.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/verify_extraction_lane_readiness_gate.py --gate <private-artifacts/extraction-lane-readiness-gate.json> --corpus-map <private-artifacts/corpus-map/corpus-map-public.json> --tool-inventory <private-artifacts/extraction-tool-inventory.json> --worker-tool-inventory <private-artifacts/extraction-worker-tool-inventory.json> --smoke-summary <private-artifacts/extraction-smoke-summary.json> --deferred-media-summary <private-artifacts/deferred-media-completion-summary.json> --output <private-artifacts/extraction-lane-readiness-verification.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/plan_search_index_population.py --output-dir <private-artifacts/search-index-plan>
python3 .codewith/skills/open-files-corpus-reader/scripts/plan_search_index_population.py --output-dir <private-artifacts/search-index-nonmedia-plan> --exclude-lanes needs_transcription,needs_video_pipeline
python3 .codewith/skills/open-files-corpus-reader/scripts/validate_search_index_population_plan.py --plan <private-artifacts/search-index-plan/search-index-population-plan.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/build_search_index_approval_packet.py --plan <private-artifacts/search-index-plan/search-index-population-plan.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/verify_search_index_readiness_reconciliation.py --plan <private-artifacts/search-index-plan/search-index-population-plan.json> --readiness-gate <private-artifacts/extraction-lane-readiness-gate.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/build_duplicate_preserve_attestation.py --plan <private-artifacts/search-index-plan/search-index-population-plan.json> --db <files.db> --output <private-artifacts/search-index-plan/duplicate-preserve-attestation.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/build_stage_dependency_gate.py --extraction-readiness-gate <private-artifacts/extraction-lane-readiness-gate.json> --extraction-readiness-verification <private-artifacts/extraction-lane-readiness-verification.json> --deferred-media-summary <private-artifacts/deferred-media-completion-summary.json> --search-index-runtime-summary <private-artifacts/search-index-unapproved-execute-summary.json> --llm-provider-readiness <private-artifacts/campaign/provider-readiness.json> --llm-campaign-results-summary <private-artifacts/campaign-results-summary.json> --duplicate-preserve-attestation <private-artifacts/duplicate-preserve-attestation.json> --extraction-approval-dashboard <private-artifacts/extraction-approval-dashboard.json> --drive-approval-notes-summary <private-artifacts/drive-approval/drive-approval-notes-summary.json> --drive-approval-notes-verification <private-artifacts/drive-approval/drive-approval-notes-verification.json> --output <private-artifacts/stage-dependency-gate.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/verify_stage_dependency_gate.py --gate <private-artifacts/stage-dependency-gate.json> --output <private-artifacts/stage-dependency-verification.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/build_replacement_readiness_gate.py --stage-dependency-gate <private-artifacts/stage-dependency-gate.json> --extraction-readiness-gate <private-artifacts/extraction-lane-readiness-gate.json> --extraction-readiness-verification <private-artifacts/extraction-lane-readiness-verification.json> --deferred-media-summary <private-artifacts/deferred-media-completion-summary.json> --extraction-approval-dashboard <private-artifacts/extraction-approval-dashboard.json> --approval-notes-summary <private-artifacts/operator-approvals/approval-notes-summary.json> --drive-approval-notes-summary <private-artifacts/drive-approval/drive-approval-notes-summary.json> --drive-approval-notes-verification <private-artifacts/drive-approval/drive-approval-notes-verification.json> --operator-approval-blocker-report <private-artifacts/operator-approval-blocker-report.json> --search-index-runtime-summary <private-artifacts/search-index-unapproved-execute-summary.json> --llm-campaign-results-summary <private-artifacts/campaign-results-summary.json> --adversarial-review-results <private-artifacts/adversarial-review/adversarial-review-results-verification.json> --output <private-artifacts/replacement-readiness-gate.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/verify_replacement_readiness_gate.py --gate <private-artifacts/replacement-readiness-gate.json> --output <private-artifacts/replacement-readiness-verification.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/run_search_index_population_plan.py --plan <private-artifacts/search-index-plan/search-index-population-plan.json> --files-command 'bun run src/cli/index.tsx'
python3 .codewith/skills/open-files-corpus-reader/scripts/verify_search_index_population_run.py --plan <private-artifacts/search-index-plan/search-index-population-plan.json> --run-dir <private-artifacts/search-index-plan/search-index-run>
python3 .codewith/skills/open-files-corpus-reader/scripts/plan_large_file_extraction.py --output-dir <private-artifacts/large-files>
python3 .codewith/skills/open-files-corpus-reader/scripts/validate_large_file_extraction_plan.py --plan <private-artifacts/large-files/large-file-extraction-plan.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/build_large_file_approval_packet.py --plan <private-artifacts/large-files/large-file-extraction-plan.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/run_large_file_extraction_plan.py --plan <private-artifacts/large-files/large-file-extraction-plan.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/verify_large_file_extraction_run.py --plan <private-artifacts/large-files/large-file-extraction-plan.json> --run-dir <private-artifacts/large-files/large-file-run>
python3 .codewith/skills/open-files-corpus-reader/scripts/collect_large_file_review_manifest.py --run-dir <private-artifacts/large-files/large-file-run> --output <private-artifacts/large-files/review-jobs.jsonl>
python3 .codewith/skills/open-files-corpus-reader/scripts/extract_artifact_for_file.py <file-id> --artifact-dir <private-artifacts/run>
python3 .codewith/skills/open-files-corpus-reader/scripts/extract_pdf_text.py <local.pdf> --output <private-artifacts/file.txt> --max-pages 20
python3 .codewith/skills/open-files-corpus-reader/scripts/extract_office_text.py <local.docx> --output <private-artifacts/file.txt> --structured-output <private-artifacts/file.office.structured.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/extract_image_ocr.py <local-image> --output <private-artifacts/image-ocr.json> --vision-request-output <private-artifacts/image-vision-request.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/archive_inventory.py <local.zip> --output <private-artifacts/archive.json>
python3 .codewith/skills/open-files-corpus-reader/scripts/inspect_file_metadata.py <local-file> --kind image --output <private-artifacts/metadata.json>
files organize stats --json
files organize apply-drive-policy --json
files extract-text <file-id> --json
files extract-snapshot <file-id> --json
files search-index add <file-id> --kind extraction_summary --extractor <name> --text-file <private-artifact.txt>
files search-index stats --json
files search <query> --scope content --json
References
references/extractor-matrix.md: extraction lanes, required tools, and fallback behavior.
