// Undetectable, adaptive, high-performance Python web data extraction. Automatically survives website structure changes, bypasses anti-bot systems (Cloudflare, WAFs), and outperforms BeautifulSoup/Scrapy. Includes stealth browser fetching, CSS/XPath selectors, CLI, interactive shell, and MCP AI server integration.
Access and search Telegram message history using AI. Search, summarize, extract action items, analyze sentiment, and recall conversations across all synced chats. Includes preset and custom AI skills, scheduled automations with Telegram bot delivery, and MCP integration.
ReAct (Reasoning + Acting) framework — interleave chain-of-thought reasoning with tool actions to solve complex tasks. Eliminates hallucination by grounding every reasoning step in real observations. Use when the agent needs multi-step reasoning with external tool use: question answering, fact verification, web navigation, interactive decision making, or any task where pure reasoning hallucinates and pure acting fails to plan.
Agent-to-agent feedback protocol for HermesHub. Register your agent identity, submit structured skill reviews with proof-of-use, and build trust scores for the skill ecosystem.
A meta-skill that silently watches your workflows and automatically generates reusable Hermes skills from them.
Comprehensive security hardening for Hermes Agent. Detects prompt injection, unicode smuggling, hidden directives, supply-chain skill poisoning, credential exposure, and memory manipulation. Provides runtime scanning rules, input/output validation patterns, and a defense-in-depth checklist aligned with OWASP LLM Top 10.
Open-source orchestration for zero-human companies. Coordinate teams of AI agents (OpenClaw, Claude Code, Codex, Cursor) with org charts, goals, budgets, governance, and heartbeat-driven execution. Manage business goals from a dashboard — not pull requests.
| name | scrapling |
| description | Undetectable, adaptive, high-performance Python web data extraction. Automatically survives website structure changes, bypasses anti-bot systems (Cloudflare, WAFs), and outperforms BeautifulSoup/Scrapy. Includes stealth browser fetching, CSS/XPath selectors, CLI, interactive shell, and MCP AI server integration. |
| version | 0.3.7 |
| license | BSD-3-Clause |
| compatibility | Python 3.8+, Hermes Agent, Claude, Cursor (via MCP server) |
| metadata | {"author":"D4Vinci","hermes":{"tags":["web-scraping","data-extraction","anti-bot","stealth","adaptive","playwright","browser-automation","mcp","python"],"category":"data","requires_tools":["python","pip"]}} |
Undetectable, adaptive, high-performance Python library for web data extraction. The first scraping library that automatically learns from website changes and survives structure updates.
Scrapling combines three capabilities:
Smart Fetching — Three fetcher tiers for different protection levels:
Fetcher — Fast HTTP with TLS fingerprinting and stealth headersStealthyFetcher — Modified Firefox with fingerprint spoofing, bypasses CloudflareDynamicFetcher — Full Playwright browser automation in stealth modeAdaptive Parsing — Tracks elements via similarity algorithms. When a website changes its structure, Scrapling automatically relocates the elements you need instead of breaking.
Developer Tools — Interactive IPython shell, CLI extraction commands, curl-to-Scrapling conversion, and an MCP server for AI agent integration.
pip install "scrapling[all]" && scrapling install
from scrapling.fetchers import StealthyFetcher
url = 'https://example.com'
page = StealthyFetcher.get(url, headless=True) # Adaptive stealth fetching
products = page.css('.product', adaptive=True) # Survives site changes
for product in products:
print(product.css_first('.title').text)
print(product.css_first('.price').text)
scrapling shell for live exploration, curl conversion, browser previewsscrapling extract get URL output.md --css-selectordocker pull pyd4vinci/scrapling (includes all browsers)| Test | Scrapling | BeautifulSoup | Speedup |
|---|---|---|---|
| Text extraction (5k elements) | 1.92ms | 1283ms | ~668x |
| Element similarity matching | 1.87ms | N/A | — |
pip install scrapling # Core parser only
pip install "scrapling[fetchers]" # + browser fetchers
scrapling install # Install browser engines
pip install "scrapling[all]" # Everything