Menu
Scrape web pages to clean markdown with optional AI summaries
Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.
Based on SOC occupation classification
Session-end memory discipline. Detects which projects were touched, writes updates to WORKBENCH.md (volatile state) + skills + persistent memory, and proposes CLAUDE.md edits. Two-tier โ obvious low-blast-radius writes are applied automatically and reported; evergreen/destructive changes ask first. Use when the user says "/wrap", "wrap up", "end of session", "let's close out", or when the session is clearly winding down.
When the user is writing the story portion of a launch video or demo and needs the framing where the founder pretends to BE the ICP experiencing the problem, then uses the product on-camera. Also use when the user mentions "demo story", "show don't tell", "day-in-the-life demo", "roleplay demo", "founder as customer", or "first person launch video". This is the story frame, not the full script.
When the user needs a 3-5 word opening hook for a product launch video โ the first second of on-screen text or voice that stops the scroll. Also use when the user mentions "hook for my video", "first second", "opening line", "tagline", "one-liner for launch", or "catchphrase". Produces 10+ hook candidates, not one answer.
When a user wants to grow an X (Twitter) account from zero before a product launch, or asks how to get first followers, warm up the algorithm, hit ~500-1,000 followers, or prepare an account to make a launch video land. Also use when the user mentions "new X account", "warm up my Twitter", "first 1000 followers", "building in public strategy", "X growth", or "engagement before launch".
When the user is planning, scripting, or editing a product launch video for X (Twitter) and needs the structure. Also use when the user mentions "launch video", "demo video", "product launch on X", "60 second demo", "how to structure a launch", or "my launch video isn't working". Produces a beat-by-beat timing sheet, not copy.
When the user has X (Twitter) content that performed well and wants to relay it to LinkedIn 1-2 weeks later with reframing. Also use when the user mentions "repost to LinkedIn", "LinkedIn version of my tweet", "X to LinkedIn", "delayed repost", "LinkedIn for non-tech audience", or "LinkedIn relay". Also use when the user's ICP is non-tech and X is secondary โ LinkedIn is the primary channel and this skill produces the content.
| name | web-scrape |
| description | Scrape web pages to clean markdown with optional AI summaries |
| version | 0.1.0 |
| tools | ["Bash"] |
Fetches web pages, converts HTML to clean markdown, with optional AI summarization.
# Scrape a single URL
bun run web-scrape/scripts/scrape.ts --url "https://example.com/article"
# Scrape with AI summary
bun run web-scrape/scripts/scrape.ts --url "https://example.com/article" --summarize
# Batch scrape from file (one URL per line)
bun run web-scrape/scripts/scrape.ts --file urls.txt
# Batch scrape with summaries
bun run web-scrape/scripts/scrape.ts --file urls.txt --summarize
GEMINI_API_KEY environment variable (only for --summarize)output/scraped/ by defaultMarkdown file with YAML frontmatter (title, author, source, word count) and clean article content. The --summarize flag prepends bullet-point summary + topic tags.
<article> or <main> content when available