| name | scrapling-0-4-7 |
| description | Web scraping tool that converts web pages to Markdown using Scrapling v0.4.7's CLI. Use when extracting content from URLs, converting web pages to readable Markdown for AI context or documentation, scraping JS-rendered pages with browser automation, or bypassing anti-bot protections with stealthy fetching. |
| license | MIT |
| author | Tangled <noreply@tangledgroup.com> |
| version | 0.1.0 |
| tags | ["web-search","web scrape","web scraping","browser automation"] |
| category | web |
| external_references | ["https://scrapling.readthedocs.io/en/latest/","https://github.com/D4Vinci/Scrapling/tree/v0.4.7"] |
Scrapling 0.4.7
Overview
Scrapling is an adaptive web scraping framework that provides a powerful CLI (scrapling extract) for downloading and extracting content from websites without writing code. The CLI supports plain HTTP requests, browser-based fetching (for JavaScript-rendered pages), and stealth mode (for anti-bot bypass).
Output format is determined by the output file extension: .md converts HTML to Markdown, .txt extracts clean text, and .html saves raw HTML.
This skill covers the uvx 'scrapling[shell]' CLI workflow for converting web pages to Markdown — either returned inline or saved to a file.
When to Use
- A user provides a bare URL (e.g.,
https://example.com) — scrape it and return Markdown
- Extracting webpage content as clean Markdown for AI context, documentation, or notes
- Scraping JavaScript-rendered pages that require browser automation
- Bypassing Cloudflare or other anti-bot protections with stealthy fetching
- Targeting specific page sections with CSS selectors
Default Workflow
The default behavior is: user provides a URL → scrape it → return Markdown inline.
Default flags: Every command includes --ai-targeted (strips noise for clean AI-ready output). The get mode additionally includes --impersonate safari (Safari browser headers for better compatibility and lower detection). These defaults apply unless the user explicitly requests different behavior.
Use scripts/scrape.sh (Execute) — a wrapper that handles the temp-file workflow automatically (creates .md temp file, runs scrapling, outputs to stdout, cleans up):
bash scripts/scrape.sh 'https://example.com'
When saving to a specific file:
bash scripts/scrape.sh -o '/path/to/output.md' 'https://example.com'
Fetch Modes
Three fetch modes are available. Default is get when no mode is specified.
get (alias: simple-fetch)
Plain HTTP request. Fastest option, works for static pages. Default flags: --impersonate safari --ai-targeted.
Common options:
-s, --css-selector TEXT — Extract specific content via CSS selector
