scrapingdog

name

scrapingdog

description

Scrapingdog is an all‑in‑one web scraping API that handles rotating proxies, headless browser rendering, CAPTCHA solving, and offers dedicated endpoints (e.g., Google SERP, Amazon, LinkedIn), delivering structured HTML or JSON data effortlessly for scale-able data collection and LLM-ready pipelines. Read and write Scrapingdog data through One: googlepatents, googlescholarauthor, jobs, googletrends, googlemapssearch, googlemapsplaces and more, 72 actions with real parameter documentation. Use whenever the user asks to look something up in Scrapingdog, create or update a record there, or build code against the Scrapingdog API.

Scrapingdog through One

Scrapingdog is an all‑in‑one web scraping API that handles rotating proxies, headless browser rendering, CAPTCHA solving, and offers dedicated endpoints (e.g., Google SERP, Amazon, LinkedIn), delivering structured HTML or JSON data effortlessly for scale-able data collection and LLM-ready pipelines.

One exposes Scrapingdog through four MCP tools. The table below carries real action ids from One's knowledge base, so for a common operation you can skip search and go straight to reading the action's parameters.

How to run an action

1. Find the action in the table below, or call search_one_platform_actions with platform scrapingdog if it is not listed.
2. Call get_one_action_knowledge with the action id. Do this every time, including for actions in this table. The table gives you the id, not the parameters.
3. Call execute_one_action with parameters copied from that knowledge.

Never guess a parameter name, a body field, or an enum value. The knowledge has the real schema, and a guessed field is either a 400 or a silent write of the wrong thing.

Before you start

Call list_one_integrations once and confirm Scrapingdog is connected. If it is missing, the user has not connected it: say so and point them at https://app.withone.ai rather than reaching for raw HTTP.

Each connection carries an access field. If it reports {"policy": "methods", "methods": ["GET"]} the agent is read-only here, so plan a read-only answer instead of attempting a write that will be refused.

Before a write

Creates, updates, deletes and sends land on a real Scrapingdog account and cannot be recalled. State the action and the specific target in one line before the first write in a task, and let the user stop you. Reads need no confirmation.

Actions

GooglePatents

Action	Method	Path	Action id
Get Google Patent Details	GET	/google_patents/details	conn_mod_def::GJ6YOCh83Uc::XAryG6GORgeVRR33RE9Gwg
Search Google Patents Results	GET	/google_patents	conn_mod_def::GJ6YOHOJZaQ::WG4VxUmRTJekOIKs-W_YVw

GoogleScholarAuthor

Action	Method	Path	Action id
Get a Google Scholar Author Profile	GET	/google_scholar/author	conn_mod_def::GJ6YOtSEFi4::KuotjxD2QAuRo_cy8zbUAA
Get a Google Scholar Author’s Citation	GET	/google_scholar/author	conn_mod_def::GJ6YO2WzcoU::PxtVw-3nTGa05JYLvgxYWg

Jobs

Action	Method	Path	Action id
Get Job Overview (Jobs Search Scraper)	GET	/jobs	conn_mod_def::GJ6YPZzct1c::53sTPA3qRC6n-Rk1PxMnqw
Scrape Jobs Search Results	GET	/jobs	conn_mod_def::GJ6YPiNIb_g::j7V39erAR8eWRR66_LnTeA

GoogleTrends

Action	Method	Path	Action id
Get Google Trends “Trending Now” Results	GET	/google_trends/trending_now/	conn_mod_def::GJ6YPP0L7ZM::-TtlE3ReQAOChTRoNAmyoA
Get Google Trends Data	GET	/google_trends	conn_mod_def::GJ6YPB2158E::35rMlpeAQT-0-PxB_5m-eQ

GoogleMapsSearch

Action	Method	Path	Action id
Search Google Maps	GET	/google_maps	conn_mod_def::GJ6YNlxk18g::c9-5DR_LQDyrAcfk7ry1_g

GoogleMapsPlaces

Action	Method	Path	Action id
Get Google Maps Place Details	GET	/google_maps/places	conn_mod_def::GJ6YNl8XoY0::JjUruCUyRS2XaIridaotHQ

GoogleMapsPosts

Action	Method	Path	Action id
Get Google Maps Posts	GET	/google_maps/posts	conn_mod_def::GJ6YNqcu6u8::5kNob0n8Rsm31IHH-MWy7A

GoogleNews

Action	Method	Path	Action id
Search Google News	GET	/google_news	conn_mod_def::GJ6YOh-12r8::vPYe7hnfTla3mEOs4bg73A

GoogleScholarResults

Action	Method	Path	Action id
Search Google Scholar Results	GET	/google_scholar	conn_mod_def::GJ6YOuMvoI8::For8YblYQvWSsScUhZL79w

GoogleShopping

Action	Method	Path	Action id
Scrape Google Shopping Results	GET	/google_shopping	conn_mod_def::GJ6YPA3P0zA::bjLnwVw0QhWwpn-0e_DB7g

GoogleVideos

Action	Method	Path	Action id
Scrape Google Video Results	GET	/google_videos	conn_mod_def::GJ6YPProwZQ::4qLtFASmTHy2Pwn1Kduitw

Indeed

Action	Method	Path	Action id
Scrape an Indeed Page (Parsed JSON)	GET	/indeed	conn_mod_def::GJ6YPSscbxQ::_UFscmLzT9-weOnszTUmkQ

LinkedInProfiles

Action	Method	Path	Action id
Scrape a LinkedIn Person Profile	GET	/profile	conn_mod_def::GJ6YPfrCOPU::-ygCi8bARd6i0bcW_wgU3g

WalmartAutocompleteSuggestions

Action	Method	Path	Action id
Get Walmart Autocomplete Suggestions	GET	/walmart/autocomplete	conn_mod_def::GJ6YPpRgE2c::OqL9SzhMQieJ2Kp1iDYLqA

WalmartSearchResults

Action	Method	Path	Action id
Scrape Walmart Search Results	GET	/walmart/search	conn_mod_def::GJ6YQGhBKdI::Tq87GD-7QxyLyFCfvcNvlw

Scrape

Action	Method	Path	Action id
Scrape a Webpage	GET	/scrape	conn_mod_def::GJ6YQHuRh4w::bfR07Q86SVmOPI31hHVd0w

XProfiles

Action	Method	Path	Action id
Get an X (Twitter) Profile	GET	/x/profile	conn_mod_def::GJ6YQLDoxLo::Ajg0GkvIQCuc2bBBsA6D0Q

YoutubeComments

Action	Method	Path	Action id
List YouTube Video Comments	GET	/youtube/comments	conn_mod_def::GJ6YQXR7SYA::7StLPv4kRD6TNFgZregyCA

ZillowSearchResults

Action	Method	Path	Action id
Scrape Zillow Search Results	GET	/zillow	conn_mod_def::GJ6YQfxK4Gg::1nUb546vQqqIowJQVOUL6g

YoutubeVideo

Action	Method	Path	Action id
Get a YouTube Video	GET	/youtube/video	conn_mod_def::GJ6YQhG6HFY::muvVJ8lwTZSVfkXyYYXaGg

AmazonOffers

Action	Method	Path	Action id
Get Amazon Product Offers	GET	/amazon/offers	conn_mod_def::GJ6YMMO6cSw::eoz_0YCPS26NmWqluz_ASA

AmazonProducts

Action	Method	Path	Action id
Get an Amazon Product by ASIN	GET	/amazon/product	conn_mod_def::GJ6YMP7ppWs::LBNl6zbLQ2SviZ_S2nMutQ

GoogleImmersiveProduct

Action	Method	Path	Action id
Get Google Immersive Product Details	GET	/google_immersive_product	conn_mod_def::GJ6YNbR9IeQ::fPDNyELpTPe03v20_UEmIQ

GoogleImages

Action	Method	Path	Action id
Scrape Google Images Results	GET	/google_images	conn_mod_def::GJ6YNcpURTU::b5VA_goFRJqwr6WRT-AuOQ

GoogleMapsReviews

Action	Method	Path	Action id
Get Google Maps Reviews (by data_id)	GET	/google_maps/reviews	conn_mod_def::GJ6YNl92Y-s::9QWToN9wTFCsWXD923uyIg

GoogleShoppingProducts

Action	Method	Path	Action id
Get Google Shopping Product Details (Deprecated)	GET	/google_product	conn_mod_def::GJ6YOCzffQg::yUB6D7YNSsm_yArXjt7I5A

GoogleScholarProfiles

Action	Method	Path	Action id
Search Google Scholar Profiles	GET	/google_scholar/profiles	conn_mod_def::GJ6YOq23VRg::WaQZj-RESyaowebhVjrhRg

GoogleShorts

Action	Method	Path	Action id
Scrape Google Shorts Results	GET	/google_shorts	conn_mod_def::GJ6YPBIxxhA::YZ-kAbbfSfObTbyMVySc6A

GoogleSearchResults

Action	Method	Path	Action id
Scrape Google Search Results	GET	/google	conn_mod_def::GJ6YPFYglVM::1RpY2ZKdQ5qjNG9c8k_b2w

WalmartProductReviews

Action	Method	Path	Action id
Get Walmart Product Reviews	GET	/walmart/reviews	conn_mod_def::GJ6YPspUwW8::mE5AgUfVQ4mlFPFM-tsC3Q

WalmartProduct

Action	Method	Path	Action id
Get a Walmart Product Page (Scrape Walmart Product)	GET	/walmart/product	conn_mod_def::GJ6YPwlp1is::ulP06Uu2SBGKbvZWnCQgkw

XPosts

Action	Method	Path	Action id
Get an X (Twitter) Post by Tweet ID	GET	/x/post	conn_mod_def::GJ6YQGNDAaY::WkIYmuomRCK-V0Ry8rYYnA

YoutubeSearch

Action	Method	Path	Action id
Search YouTube	GET	/youtube/search	conn_mod_def::GJ6YQT5IW-Y::M_MMmZcIS7CX2e2GyJbqtA

YelpSearch

Action	Method	Path	Action id
Search Yelp Using the Yelp Scraper API	GET	/yelp/search	conn_mod_def::GJ6YQWJ3gqQ::tBVobVAJQ12LU9mX6wOndg

YoutubeChannel

Action	Method	Path	Action id
Get YouTube Channel Details	GET	/youtube/channel	conn_mod_def::GJ6YQXohjXQ::QsSnuIxlS-G1a3ohhDf-fg

Account

Action	Method	Path	Action id
Get Account Usage (Credits & Concurrency)	GET	/account	conn_mod_def::GJ6YMM5hSzU::f-nIMbE8SHiiuniQIyVNZA

GoogleAiModeResults

Action	Method	Path	Action id
Scrape Google AI Mode Results	GET	/google/ai_mode	conn_mod_def::GJ6YM6tK-aA::OHUUyNa0TDGYgHe10lSXdg

GoogleFinance

Action	Method	Path	Action id
Scrape Google Finance Results	GET	/google_finance	conn_mod_def::GJ6YNCvu_XQ::vU43-g1dQzCXwiVfxIEf2Q

GoogleAiOverview

Action	Method	Path	Action id
Fetch Google AI Overview Results (Separate Request)	GET	/google/ai_overview	conn_mod_def::GJ6YNDaD4cg::wduIqxLvT3agOnTkqdc2BQ

AmazonAutocompleteSuggestions

Action	Method	Path	Action id
Get Amazon Autocomplete Suggestions	GET	/amazon/autocomplete	conn_mod_def::GJ6YMKG510s::nGkc6P9BQIeT1ctfZYQcXg

AmazonReviews

Action	Method	Path	Action id
List Amazon Product Reviews	GET	/amazon/reviews	conn_mod_def::GJ6YMSw1bkQ::-GzzIOC5RPeMVrVJU9BLMg

EbayProducts

Action	Method	Path	Action id
Get an eBay Product (Scrape eBay Product Page)	GET	/ebay/product	conn_mod_def::GJ6YMphkkcI::VAn1SqZZRxuuMn-UCrc74g

BingSearch

Action	Method	Path	Action id
Scrape Bing Search Results	GET	/bing/search	conn_mod_def::GJ6YMdPXbNI::Gda5mrqDSiKwcAj05PqZag

AmazonSearchResults

Action	Method	Path	Action id
Scrape Amazon Search Results	GET	/amazon/search	conn_mod_def::GJ6YMgRoWeM::p-Q0guEIQJGn7UXOoDlLEQ

DuckduckgoSearch

Action	Method	Path	Action id
DuckDuckGo Search (Scraper) — Supported Regions (kl)	GET	/duckduckgo/search	conn_mod_def::GJ6YMo5phUY::tqbP_svYQmWYIftWzsvT0w

FlipkartProducts

Action	Method	Path	Action id
Get a Flipkart Product (Scrape Flipkart Product Page)	GET	/flipkart/product	conn_mod_def::GJ6YMqmOU5E::kcsCUNp6R3-gjhcsXAg2ww

GoogleTrendsLocations

Action	Method	Path	Action id
List Google Trends Supported Locations	GET	/google_trends/locations	conn_mod_def::GJ6YPMEYl9U::voGooSDHT9-cXRgQm72zFQ

Profile

Action	Method	Path	Action id
Scrape a Company Profile	GET	/profile	conn_mod_def::GJ6YMa4piRU::J9yc2i06QMGjOJ_ePCSU1w

GoogleNewsResults

Action	Method	Path	Action id
Scrape Google News Results	GET	/google_news/v2	conn_mod_def::GJ6YOGemYMQ::JUxANNRKTzywxpFGNIN27Q

GoogleTrendsAutocomplete

Action	Method	Path	Action id
Google Trends Autocomplete Suggestions	GET	/google_trends/autocomplete	conn_mod_def::GJ6YO9273FY::XM-WHYo-SJ6PG9SSYCtO8g

GoogleAutocomplete

Action	Method	Path	Action id
Get Google Autocomplete Suggestions	GET	/google_autocomplete	conn_mod_def::GJ6YNC4SEUU::OIHAllyNRl-PTxRp5pNn9w

BaiduSearch

Action	Method	Path	Action id
Search Baidu	GET	/baidu/search/	conn_mod_def::GJ6YMgirpyA::-UBDTWmKRKyYDOw1U8mGOw

GoogleMapsPhotos

Action	Method	Path	Action id
List Google Maps Photos for a Place (by data_id)	GET	/google_maps/photos	conn_mod_def::GJ6YN6CE8WQ::J-387UDBT7GEHWnjOZgplw

DuckduckgoSearchResults

Action	Method	Path	Action id
Scrape DuckDuckGo Search Results	GET	/duckduckgo/search/	conn_mod_def::GJ6YMeCB60g::FNedzUNbQleC_F8rm3wIcQ

ProfilePosts

Action	Method	Path	Action id
Scrape a Profile Post (Person or Company)	GET	/profile/post	conn_mod_def::GJ6YPa-gRhA::GGpReEKaT--J0p4RG867aw

EbaySearchResults

Action	Method	Path	Action id
Scrape eBay Search Results	GET	/ebay/search	conn_mod_def::GJ6YMrv-oYs::1FXdjH54SWq3raU9_OqWvQ

GoogleScholarCitations

Action	Method	Path	Action id
Get Google Scholar Citations (Cite) for a Result	GET	/google_scholar/cite	conn_mod_def::GJ6YOq7crjA::DVWXkG0vSD-RzO1Sua-NDg

GoogleLens

Action	Method	Path	Action id
Scrape Google Lens Results	GET	/google_lens	conn_mod_def::GJ6YNYETMNk::nRJniu30SaeF_9FktHVAKA

GoogleLocalResults

Action	Method	Path	Action id
Scrape Google Local Results	GET	/google_local	conn_mod_def::GJ6YNX_mQkA::UabZrA-IQvCqGhaN4njJxw

GoogleJobs

Action	Method	Path	Action id
Scrape Google Jobs Results	GET	/google_jobs	conn_mod_def::GJ6YNYT9Zdo::SSpSKkIyRW6eVikVrHYqsA

WebhookScrapingRequests

Action	Method	Path	Action id
Submit a Web Scraping Request to a Saved Webhook Destination	GET	/webhook	conn_mod_def::GJ6YQE5RvMY::un6ti3RkSjCMTzX40XX7Rw

Screenshot

Action	Method	Path	Action id
Take a Screenshot of a Web Page	GET	/screenshot	conn_mod_def::GJ6YP8HSTck::I0LOQtLqTk-q0IA6zqeE-Q

ScrapingdogScrape

Action	Method	Path	Action id
Send a POST Request via Scrapingdog (Scrape with Forwarded POST Data)	POST	/scrape	conn_mod_def::GJ6YPam6F8U::3zdSRHQUQEuzg42WZD7aPQ

YoutubeTranscripts

Action	Method	Path	Action id
Get YouTube Video Transcripts	GET	/youtube/transcripts	conn_mod_def::GJ6YQRkRV9s::P_PkFL9aSAaN9C1-UzCiYw

UniversalSearch

Action	Method	Path	Action id
Universal Search API	GET	/search	conn_mod_def::GJ6YPrxR4Ag::0pwHBYNQS8ScwZCrURYpNA

MyntraProducts

Action	Method	Path	Action id
Get a Myntra Product	GET	/myntra/product	conn_mod_def::GJ6YPMxrTls::z2XtExYGTYO3AxPay7SRPw

GoogleFlights

Action	Method	Path	Action id
Scrape Google Flights Results	GET	/google_flights	conn_mod_def::GJ6YNNzffHA::l_89sF-8QT2QwPic_uYqdA

GoogleHotels

Action	Method	Path	Action id
Scrape Google Hotels Results	GET	/google_hotels	conn_mod_def::GJ6YNHf8BMM::Kia8ZuMJTtGhUChfX1Gu7Q

When a call fails

The error comes from Scrapingdog, not from One. A 400 or 422 means your parameters do not match the schema, so re-read the knowledge and fix the field. A 401 or 403 means the connection needs re-authorizing, which no retry will fix. A 404 means the id is not on this account. A 429 means slow down. Never retry a write more than once: the first attempt may have landed.

Full catalog: https://www.withone.ai/knowledge/scrapingdog

Integration knowledge by One (withone.ai), licensed under One-Knowledge-1.0. Attribution must be preserved in derivative works.