一键导入
web-scrape
Scrape web pages to clean markdown with optional AI summaries
用 Codex 或 Claude 帮你安装 复制这段 Prompt,粘贴到 Codex、Claude 或其他助手里,让它检查 Skill 页面并帮你完成安装。
菜单
Scrape web pages to clean markdown with optional AI summaries
用 Codex 或 Claude 帮你安装 复制这段 Prompt,粘贴到 Codex、Claude 或其他助手里,让它检查 Skill 页面并帮你完成安装。
基于 SOC 职业分类
Session-end memory discipline. Detects which projects were touched, writes updates to WORKBENCH.md (volatile state) + skills + persistent memory, and proposes CLAUDE.md edits. Two-tier — obvious low-blast-radius writes are applied automatically and reported; evergreen/destructive changes ask first. Use when the user says "/wrap", "wrap up", "end of session", "let's close out", or when the session is clearly winding down.
When the user is writing the story portion of a launch video or demo and needs the framing where the founder pretends to BE the ICP experiencing the problem, then uses the product on-camera. Also use when the user mentions "demo story", "show don't tell", "day-in-the-life demo", "roleplay demo", "founder as customer", or "first person launch video". This is the story frame, not the full script.
When the user needs a 3-5 word opening hook for a product launch video — the first second of on-screen text or voice that stops the scroll. Also use when the user mentions "hook for my video", "first second", "opening line", "tagline", "one-liner for launch", or "catchphrase". Produces 10+ hook candidates, not one answer.
When a user wants to grow an X (Twitter) account from zero before a product launch, or asks how to get first followers, warm up the algorithm, hit ~500-1,000 followers, or prepare an account to make a launch video land. Also use when the user mentions "new X account", "warm up my Twitter", "first 1000 followers", "building in public strategy", "X growth", or "engagement before launch".
When the user is planning, scripting, or editing a product launch video for X (Twitter) and needs the structure. Also use when the user mentions "launch video", "demo video", "product launch on X", "60 second demo", "how to structure a launch", or "my launch video isn't working". Produces a beat-by-beat timing sheet, not copy.
When the user has X (Twitter) content that performed well and wants to relay it to LinkedIn 1-2 weeks later with reframing. Also use when the user mentions "repost to LinkedIn", "LinkedIn version of my tweet", "X to LinkedIn", "delayed repost", "LinkedIn for non-tech audience", or "LinkedIn relay". Also use when the user's ICP is non-tech and X is secondary — LinkedIn is the primary channel and this skill produces the content.
| name | web-scrape |
| description | Scrape web pages to clean markdown with optional AI summaries |
| version | 0.1.0 |
| tools | ["Bash"] |
Fetches web pages, converts HTML to clean markdown, with optional AI summarization.
# Scrape a single URL
bun run web-scrape/scripts/scrape.ts --url "https://example.com/article"
# Scrape with AI summary
bun run web-scrape/scripts/scrape.ts --url "https://example.com/article" --summarize
# Batch scrape from file (one URL per line)
bun run web-scrape/scripts/scrape.ts --file urls.txt
# Batch scrape with summaries
bun run web-scrape/scripts/scrape.ts --file urls.txt --summarize
GEMINI_API_KEY environment variable (only for --summarize)output/scraped/ by defaultMarkdown file with YAML frontmatter (title, author, source, word count) and clean article content. The --summarize flag prepends bullet-point summary + topic tags.
<article> or <main> content when available