web

name

web

description

This skill should be used for any web content operation: fetching URLs, searching the web, scraping JavaScript-heavy pages, crawling multi-page sites, mapping site URLs, taking screenshots, rendering pages as PDF, extracting structured data, reranking search results, and fact-checking claims against live web sources. This skill covers tasks like "read this page", "search for X", "crawl the docs at Y", "is Z true?", "find all pages on this domain", "take a screenshot of this URL", "save this page as a PDF", "list all links on this site", "get me structured data from this URL", "discover all URLs on this domain", or "what does this sitemap contain?".

Web Content Operations

All web operations use shell scripts in ${CLAUDE_PLUGIN_ROOT}/scripts/. Output goes to .claude-crawl/ in the project root to protect the context window from large content.

Before any operation: mkdir -p .claude-crawl/{reads,searches,crawls,extractions,reranks,ground,screenshots,pdfs}

WebFetch calls are automatically intercepted and routed through Jina Reader for cleaner markdown output. Set CLAUDE_CRAWL_NO_INTERCEPT=1 to disable this behavior and use WebFetch directly. Run check-auth.sh --verbose to see which services are available.

Routing Table

Choose the right tool based on what you have and what you need:

HAVE                      NEED                        USE
─────────────────────────────────────────────────────────────────────
Topic/question            Search results              jina-search.sh or fc-search.sh
URL, static page          Clean markdown              jina-read.sh
URL, JS-heavy/SPA         Rendered content            fc-scrape.sh
URL, need visual capture  Screenshot or PDF           cf-page.sh --format screenshot|pdf
URL, need structured data JSON extraction (AI)        cf-page.sh --format json --ai-prompt "..."
Domain                    All URLs on site            fc-map.sh
Multiple URLs, bulk       Multi-page content          cf-crawl-start.sh or fc-crawl.sh
Statement/claim           Fact verification           jina-ground.sh
Multiple results          Ranked by relevance         jina-rerank.sh