Instalar com Codex ou Claude Copie este prompt, cole no Codex, Claude ou outro assistente e deixe que ele revise a página da skill e instale para você.
Um comando direto ignora o prompt de revisão. Verifique a origem antes de executá-lo.
An API token lets your applications securely interact with MrScraper APIs and rerun scrapers created in the dashboard.
Follow these steps in the dashboard:
Click your User Profile at the top-right corner.
Select API Tokens.
Click New Token.
Enter a name and set an expiration date.
Click Create.
Copy the new token and store it securely as MRSCRAPER_API_TOKEN.
Use it in requests through the x-api-token header.
Security rule:
Never expose tokens in client-side code (browser/mobile app bundles).
Store tokens in environment variables or server-side secret managers.
Notes from the auth docs:
The API key works for all V3 Platform endpoints.
The same key can be used for endpoints on sync.scraper.mrscraper.com.
For access to endpoints on other hosts, contact support@mrscraper.com.
Install and Runtime
No local install step is required by this skill document.
No bundled scripts/ are required.
Calls are direct HTTPS requests to the two base URLs above.
Data and Scope
Data is sent only to api.app.mrscraper.com and api.mrscraper.com.
Responses may contain extracted page content and scrape metadata.
This skill does not define hidden persistence or background jobs.
Never expose tokens in logs, commits, or output.
Endpoints
1. Unblocker
Method: GET
URL: https://api.mrscraper.com
Auth: token query parameter
Opens a target URL through stealth browsing and IP rotation, then returns HTML. Use this when direct access is blocked by captcha or anti-bot protections.
{"id":"497f6eca-6276-4993-bfeb-53cbbbba6f08","createdAt":"2019-08-24T14:15:22Z","createdById":"e13e432a-5323-4484-a91d-b5969bc564d9","updatedAt":"2019-08-24T14:15:22Z","updatedById":"d8bc6076-4141-4a88-80b9-0eb31643066f","deletedAt":"2019-08-24T14:15:22Z","deletedById":"8ef578ad-7f1e-4656-b48b-b1b4a9aaa1cb","userId":"2c4a230c-5085-4924-a3e1-25fb4fc5965b","scraperId":"6695bf87-aaa6-46b0-b1ee-88586b222b0b","type":"AI","url":"http://example.com","status":"Finished","error":"string","tokenUsage":0,"runtime":0,"data":{},// MAIN SCRAPED DATA"htmlPath":"string","recordingPath":"string","screenshotPath":"string","dataPath":"string"}
Notes:
Choose agent type correctly as each agent is specialized for specified use cases. Use general for most standard web scraping tasks. The go to agent if the user doesn't specify or the connected LLM is not confident about the type of page. But mostly used for scraping product page, but handles any type of page very well as well. Use listing for scraping listing pages like product listings, job listings, etc. Choose this if the connected LLM can confidently identify whether the given URL is a listing page. Use map for crawling and getting all subdomain or subpages of a website. Choose this if the user specifies that the given URL is a website and not a specific page. For map agent type, there is a special args that can be used to configure the scraping process.
For the map agent, you can use special arguments to control crawling: maxDepth (lower values 1–2 for focused scraping, max 3 recommended), maxPages (limits total pages regardless of depth), limit (caps total records extracted), and includePatterns/excludePatterns (regex patterns separated by || to specify which URLs to crawl or skip, e.g., */products/*||*/blog/* or */cart/*||*.pdf). If includePatterns is an empty string, all URLs are included. If excludePatterns is an empty string, no URLs are excluded.
3. Rerun Existing AI Scraper
Method: POST
Host: https://api.app.mrscraper.com
Path: /api/v1/scrapers-ai-rerun
Auth: x-api-token
Reruns an existing scraper configuration on a new URL.
Payload parameters:
Field
Type
Required
Default
Description
scraperId
string
Yes
—
Scraper ID retrieved from created AI scraper
url
string
Yes
—
Target URL
Optional payload parameters for map agent:
Field
Type
Required
Default
Description
maxDepth
number
No
2
Crawl depth
maxPages
number
No
50
Maximum pages to crawl
limit
number
No
1000
Result limit
includePatterns
string
No
""
Regex patterns to include (separate multiple with ||)
excludePatterns
string
No
""
Regex patterns to exclude (separate multiple with ||)
{"message":"Successful operation!","data":{"id":"497f6eca-6276-4993-bfeb-53cbbbba6f08","createdAt":"2019-08-24T14:15:22Z","createdById":"e13e432a-5323-4484-a91d-b5969bc564d9","updatedAt":"2019-08-24T14:15:22Z","updatedById":"d8bc6076-4141-4a88-80b9-0eb31643066f","deletedAt":"2019-08-24T14:15:22Z","deletedById":"8ef578ad-7f1e-4656-b48b-b1b4a9aaa1cb","userId":"2c4a230c-5085-4924-a3e1-25fb4fc5965b","scraperId":"6695bf87-aaa6-46b0-b1ee-88586b222b0b","type":"Rerun-AI","url":"http://example.com","status":"Finished","error":"string","tokenUsage":0,"runtime":0,"data":{},// MAIN SCRAPED DATA"htmlPath":"string","recordingPath":"string","screenshotPath":"string","dataPath":"string","htmlContent":"string"}}
4. Bulk Rerun Existing AI Scraper
Method: POST
Host: https://api.app.mrscraper.com
Path: /api/v1/scrapers-ai-rerun/bulk
Auth: x-api-token
Runs one scraper configuration over multiple URLs.
{"message":"Successful operation!","data":{"id":"497f6eca-6276-4993-bfeb-53cbbbba6f08","createdAt":"2019-08-24T14:15:22Z","createdById":"e13e432a-5323-4484-a91d-b5969bc564d9","updatedAt":"2019-08-24T14:15:22Z","updatedById":"d8bc6076-4141-4a88-80b9-0eb31643066f","deletedAt":"2019-08-24T14:15:22Z","deletedById":"8ef578ad-7f1e-4656-b48b-b1b4a9aaa1cb","userId":"2c4a230c-5085-4924-a3e1-25fb4fc5965b","scraperId":"6695bf87-aaa6-46b0-b1ee-88586b222b0b","type":"Rerun-AI","url":"http://example.com","status":"Finished","error":"string","tokenUsage":0,"runtime":0,"data":{},// MAIN SCRAPED DATA"htmlPath":"string","recordingPath":"string","screenshotPath":"string","dataPath":"string","htmlContent":"string"}}
