Run any Skill in Manus with one click

page-scraping-tools

Stars1

Forks0

UpdatedMay 6, 2026 at 08:49

Use when: extracting page information, scraping static HTML, comparing rendered page text, using Scrapling, using Skyvern, or deciding between lightweight scraping and browser automation.

Installation

Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.

Run Skill in Manus

Source

sievepub-2000

sievepub-2000/octocode

View GitHub Repository View Creator Repositories

Download

Run Skill in Manus

Related occupationsSOC

Based on SOC occupation classification

Software DevelopersComputer and Mathematical Occupations·SOC 15-1252

SKILL.md

readonly

name	page-scraping-tools
description	Use when: extracting page information, scraping static HTML, comparing rendered page text, using Scrapling, using Skyvern, or deciding between lightweight scraping and browser automation.

Page Scraping Tools

Installed tooling in the workspace Python environment:

scrapling for lightweight page scraping and resilient HTML extraction.
skyvern for heavier browser automation when installed and configured.

Decision rule:

Use scrapling first for static pages, docs, article extraction, and simple DOM queries.
Use Playwright/browser tools for WebUI validation that needs real rendering or screenshots.
Use skyvern only for workflow automation across interactive pages, logins, or multi-step browser tasks.
Run privacy-filter before sharing scraped content externally.

Python environment:

c:/Users/周浩/vscode-workspace/octocode/.venv/Scripts/python.exe

More from this repository

same repository

matt-pocock-engineering

sievepub-2000/octocode

Use when: applying Matt Pocock engineering skills for diagnosis, TDD, architecture improvement, issue breakdown, PRD creation, or rigorous TypeScript/codebase analysis.

2026-05-061

mattpocock-improve-codebase-architecture

sievepub-2000/octocode

Find deepening opportunities in a codebase, informed by the domain language in CONTEXT.md and the decisions in docs/adr/. Use when the user wants to improve architecture, find refactoring opportunities, consolidate tightly-coupled modules, or make a codebase more testable and AI-navigable.

2026-05-061

mattpocock-setup-matt-pocock-skills

sievepub-2000/octocode

Sets up an `## Agent skills` block in AGENTS.md/CLAUDE.md and `docs/agents/` so the engineering skills know this repo's issue tracker (GitHub or local markdown), triage label vocabulary, and domain doc layout. Run before first use of `to-issues`, `to-prd`, `triage`, `diagnose`, `tdd`, `improve-codebase-architecture`, or `zoom-out` — or if those skills appear to be missing context about the issue tracker, triage labels, or domain docs.

2026-05-061

mattpocock-to-issues

sievepub-2000/octocode

Break a plan, spec, or PRD into independently-grabbable issues on the project issue tracker using tracer-bullet vertical slices. Use when user wants to convert a plan into issues, create implementation tickets, or break down work into issues.

2026-05-061

mattpocock-to-prd

sievepub-2000/octocode

Turn the current conversation context into a PRD and publish it to the project issue tracker. Use when user wants to create a PRD from the current context.

2026-05-061

openai-plugins

sievepub-2000/octocode

Use when: working with OpenAI Codex plugins, plugin marketplaces, plugin manifests, plugin-bundled skills, or the openai/plugins repository. Helps inspect .codex-plugin/plugin.json, .agents/plugins/marketplace.json, and installed Codex plugin cache.

2026-05-061

Run any Skill with one click