메뉴
Scrape the web over the iii bus with Scrapling — fast HTTP fetch with TLS impersonation, a Camoufox anti-bot browser (Cloudflare bypass), full Playwright rendering, screenshots, and CSS/XPath/regex/adaptive extraction.
Codex 또는 Claude로 설치 이 Prompt를 복사해 Codex, Claude 또는 다른 어시스턴트에 붙여 넣으면 Skill 페이지를 검토하고 설치를 진행할 수 있습니다.
SOC 직업 분류 기준
| name | scrapling |
| description | Scrape the web over the iii bus with Scrapling — fast HTTP fetch with TLS impersonation, a Camoufox anti-bot browser (Cloudflare bypass), full Playwright rendering, screenshots, and CSS/XPath/regex/adaptive extraction. |
The scrapling worker puts Scrapling on
the iii bus. Three fetch tiers share one output shape: scrapling::fetch (fast
HTTP, curl_cffi TLS impersonation), scrapling::stealthy-fetch (Camoufox stealth
browser — solves Cloudflare/Turnstile, hardens WebRTC/canvas), and
scrapling::dynamic-fetch (Playwright/Chromium — JS rendering, waits, XHR
capture). Every fetch can extract in the same call by passing a selectors list,
and can fan out over a urls array. Parsing is also exposed standalone
(extract, css, xpath, regex, find-similar) for HTML you already have.
Fetches return {status, url, headers, cookies, encoding} plus extracted (when
selectors given) and html (when include_html: true). A bulk call returns
{results: [...]}.
scrapling::fetch with url
and selectors: [{name, css, all?}].scrapling::stealthy-fetch with
solve_cloudflare: true.scrapling::dynamic-fetch with
wait_selector, network_idle, or capture_xhr.scrapling::screenshot (fetcher: dynamic|stealthy,
full_page?).scrapling::extract /
scrapling::css / scrapling::xpath / scrapling::regex.scrapling::find-similar
with an anchor CSS selector.urls: [...] to any fetch function.scrapling install in the image.page_action/page_setup callbacks,
proxy rotators, session objects, the Spider crawl layer) are intentionally not
exposed. Pass a single proxy string, not a rotator.{name, css|xpath|regex, attr?, html?, all?} — attr
pulls an attribute, html pulls inner HTML, otherwise text; all returns a
list.scrapling::fetch — HTTP get/post/put/delete; url|urls, method,
headers, impersonate, selectors, include_html.scrapling::stealthy-fetch — Camoufox anti-bot fetch; solve_cloudflare,
block_webrtc, wait_selector, selectors, bulk.scrapling::dynamic-fetch — Playwright fetch; network_idle, wait_selector,
real_chrome, cdp_url, capture_xhr, selectors, bulk.scrapling::screenshot — page as image content blocks; fetcher, full_page, format.scrapling::extract — parse html with a selectors list → named map.scrapling::css — one CSS query over html; first?, attr?.scrapling::xpath — one XPath query over html; first?, attr?.scrapling::regex — regex over the visible text of html; first?.scrapling::find-similar — anchor element + structurally similar elements.Run Unix commands and structured filesystem ops from the iii engine: exec, background jobs, and a structured fs (ls/stat/mkdir/rm/chmod/mv/grep/sed/ read/write, jailed only if fs.host_roots is configured), all forwardable into a sandbox microVM.
Shared, adapter-backed key/value store addressed by scope and key, with a reactive `state` trigger so other functions can run on every create, update, or delete without polling.
Durable topic queues for iii: subscribe functions to topics, publish work asynchronously, retry failed deliveries with backoff, and inspect/redrive dead-lettered messages.
Mint isolated git worktrees for parallel agent work, track ownership in a cross-agent registry, and land finished branches back onto a target with a queued rebase, test gate, and atomic fast-forward merge.
Connect this engine to another iii engine over a long-lived WebSocket so functions call across the boundary. Wire stable ids with `forward:`/`expose:`; `bridge.invoke` is the ad-hoc escape hatch.
Drive Devin over the iii bus. Run the local Devin CLI agent (SWE-1.6) with the iii runtime context so it discovers and operates your mesh, or start and steer autonomous Devin cloud sessions through the REST API, with a passthrough to any Devin v1/v3 endpoint.