Menu
智能网页抓取器（HTTP + Puppeteer）。统一使用 Sync Your Cookie 格式管理 cookie，支持 Cloudflare KV 自动同步。
The review-first prompt is selected by default. You can switch to a direct command or download a local copy.
Read SKILL.md and any companion files shown by SkillsMP before deciding whether to install.
Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.
A direct command skips the review prompt. Inspect the source before running it.
npx skills add https://github.com/kaiye/skills --skill page-fetcherThe command stays on one line. Scroll horizontally to inspect it before copying.
Prefer a local copy? Download the files currently available to SkillsMP.
Based on SOC occupation classification
Showing SKILL.md
| name | page-fetcher |
| description | 智能网页抓取器（HTTP + Puppeteer）。统一使用 Sync Your Cookie 格式管理 cookie，支持 Cloudflare KV 自动同步。 |
| allowed-tools | Bash, Read, Write, Grep, Glob |
智能网页抓取器，支持轻量 HTTP 和 Puppeteer + Cookie 两种模式。
page-fetcher/
├── scripts/
│ ├── read.js # 轻量 HTTP 抓取
│ ├── read-spa.js # Puppeteer 抓取（需 cookie）
│ ├── sync-cookies-from-kv.js # 从 Cloudflare KV 拉取 cookie
│ └── import-cookie.js # 导入其他格式 cookie
├── cookies/
│ └── sync-your-cookie.json # 统一 cookie 存储（Sync Your Cookie 格式）
├── pages/ # 抓取结果缓存
└── rules.json # 域名规则（选择器 + UA）
安装扩展
配置 Cloudflare KV
~/.openclaw/workspace/.secrets/cloudflare-kv.md）同步流程
node $SKILL_DIR/scripts/sync-cookies-from-kv.js
如果没有 Sync Your Cookie 扩展，可以通过其他方式导出 cookie 并导入：
node $SKILL_DIR/scripts/import-cookie.js <cookie-file>
支持的格式：
{domain, cookies, localStorage}（自动转换）自动云端同步：
node $SKILL_DIR/scripts/read.js "https://example.com/..."
适用于静态页面，不执行 JS。
node $SKILL_DIR/scripts/read-spa.js "https://example.com/..."
自动从 cookies/sync-your-cookie.json 读取对应域名的 cookie。
rules.json 示例：
{
"mp.weixin.qq.com": {
"ua": "Mozilla/5.0 ...",
"selector": ".rich_media_wrp",
"strategy": "article"
},
"wx.zsxq.com": {
"strategy": "article"
}
}
ua：可选，自定义 User-Agentselector：可选，CSS 选择器（仅支持 .class 和 #id）strategy：可选，html2md4llm 策略（article / list）cd $SKILL_DIR
npm install puppeteer-core html2md4llm zod
pages/<domain>-<timestamp>.md（Puppeteer 模式）统一使用 Sync Your Cookie 格式：
{
"updateTime": 1772508093149,
"createTime": 1772508093149,
"domainCookieMap": {
"example.com": {
"updateTime": 1772508093149,
"createTime": 1772508093149,
"cookies": [
{
"name": "...",
"value": "...",
"domain": "...",
"path": "/",
"secure": false,
"httpOnly": false,
"sameSite": "unspecified",
优势：
cookies/sync-your-cookie.jsonsync-your-cookie.json 不存在，会 fallback 到旧格式 <domain>_cookies.json