Skip to main content
polymer-pay-olostep AI-powered web search, extraction, and custom research agents. Scrape webpages, extract structured data, crawl websites, and build research workflows.
Jump to install Skills Marketplace Discover and explore AI skills built by the community.
Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.
Show prompt details A direct command skips the review prompt. Inspect the source before running it.
npx skills add https://github.com/polymerdao/pay-apis --skill polymer-pay-olostepThe command stays on one line. Scroll horizontally to inspect it before copying.
Prefer a local copy? Download the files currently available to SkillsMP.
Download Zip Downloading... More from this repository name polymer-pay-olostep description AI-powered web search, extraction, and custom research agents. Scrape webpages, extract structured data, crawl websites, and build research workflows. endpoints [{"path":"/v1/scrapes","method":"POST","price":"$0.01","description":"Scrape single webpage"},{"path":"/v1/scrapes/{id}","method":"GET","price":"Free","description":"Get scrape status"},{"path":"/v1/answers","method":"POST","price":"$0.05","description":"AI research task"},{"path":"/v1/answers/{id}","method":"GET","price":"Free","description":"Get answer results"},{"path":"/v1/maps","method":"POST","price":"$0.01","description":"Extract website links"},{"path":"/v1/crawls","method":"POST","price":"Dynamic","description":"Start website crawl"},{"path":"/v1/crawls/{id}","method":"GET","price":"Free","description":"Get crawl status"},{"path":"/v1/crawls/{id}/pages","method":"GET","price":"Free","description":"Get crawl pages"},{"path":"/v1/batches","method":"POST","price":"Dynamic","description":"Batch processing"},{"path":"/v1/batches/{id}","method":"GET","price":"Free","description":"Get batch status"},{"path":"/v1/batches/{id}/items","method":"GET","price":"Free","description":"Get batch items"},{"path":"/v1/retrieve","method":"POST","price":"Free","description":"Retrieve processed content"}] metadata {"polymer-pay-skill":"🕷️","requires.env":"POLYMER_PAY_API_KEY","requires.primaryEnv":"POLYMER_PAY_API_KEY"} registries {} provider orthogonal
Olostep
AI-powered web search, extraction, and custom research agents. Scrape webpages, extract structured data with AI, crawl websites at scale, and build custom research agent workflows.
Authentication
All requests route through the Polymer Pay proxy. Include your Polymer Pay API key in every request:
{
"headers" : {
"Content-Type" : "application/json" ,
"x-polymer-pay-api-key" : "{{POLYMER_PAY_API_KEY}}"
}
}
Base URL: https://pay.polymerlabs.org/proxy/https/x402.orth.sh/olostep
To get an Polymer Pay API key, sign up at https://my.pay.polymerlabs.org/dashboard/api-keys
Common Operations
Scrape Webpage
Initiate a web page scrape with various extraction options.
Pricing: $0.01
{
"url" : "https://pay.polymerlabs.org/proxy/https/x402.orth.sh/olostep/v1/scrapes" ,
"method" : "POST" ,
"headers" : {
"Content-Type" : "application/json" ,
"x-polymer-pay-api-key" : "{{POLYMER_PAY_API_KEY}}"
} ,
"body" : {
"url_to_scrape" :
"https://example.com"
,
"formats"
:
[
"markdown"
,
"html"
]
,
"remove_css_selectors"
:
"default"
}
}
Returns scrape_id for retrieval.
AI Answer Get AI to perform research and find answers to questions by searching and browsing.
{
"url" : "https://pay.polymerlabs.org/proxy/https/x402.orth.sh/olostep/v1/answers" ,
"method" : "POST" ,
"headers" : {
"Content-Type" : "application/json" ,
"x-polymer-pay-api-key" : "{{POLYMER_PAY_API_KEY}}"
} ,
"body" : {
"task" : "What is the revenue of Stripe in 2023?" ,
"json_format" : { "revenue" : "string" , "year" : "number" }
}
}
Get Website Links Extract all URLs from a website.
{
"url" : "https://pay.polymerlabs.org/proxy/https/x402.orth.sh/olostep/v1/maps" ,
"method" : "POST" ,
"headers" : {
"Content-Type" : "application/json" ,
"x-polymer-pay-api-key" : "{{POLYMER_PAY_API_KEY}}"
} ,
"body" : {
"url" : "https://example.com"
}
}
Start Crawl Start a website crawl with configurable depth and scope.
{
"url" : "https://pay.polymerlabs.org/proxy/https/x402.orth.sh/olostep/v1/crawls" ,
"method" : "POST" ,
"headers" : {
"Content-Type" : "application/json" ,
"x-polymer-pay-api-key" : "{{POLYMER_PAY_API_KEY}}"
} ,
"body" : {
"start_url" : "https://example.com" ,
"max_pages" : 10 ,
"max_depth" : 2
}
}
Returns crawl_id for status checking.
Batch Processing Process multiple URLs in a batch.
{
"url" : "https://pay.polymerlabs.org/proxy/https/x402.orth.sh/olostep/v1/batches" ,
"method" : "POST" ,
"headers" : {
"Content-Type" : "application/json" ,
"x-polymer-pay-api-key" : "{{POLYMER_PAY_API_KEY}}"
} ,
"body" : {
"items" : [
{ "url" : "https://example.com/page1" } ,
{ "url" : "https://example.com/page2" }
]
}
}
Retrieve Content Retrieve processed content from batches and crawls.
{
"url" : "https://pay.polymerlabs.org/proxy/https/x402.orth.sh/olostep/v1/retrieve" ,
"method" : "POST" ,
"headers" : {
"Content-Type" : "application/json" ,
"x-polymer-pay-api-key" : "{{POLYMER_PAY_API_KEY}}"
} ,
"body" : {
"retrieve_id" : "{retrieve_id}"
}
}
Get Scrape Status Poll for status of a scrape operation.
{
"url" : "https://pay.polymerlabs.org/proxy/https/x402.orth.sh/olostep/v1/scrapes/{scrape_id}" ,
"method" : "GET" ,
"headers" : {
"Content-Type" : "application/json" ,
"x-polymer-pay-api-key" : "{{POLYMER_PAY_API_KEY}}"
}
}
Get Answer Status Poll for results of an AI research task.
{
"url" : "https://pay.polymerlabs.org/proxy/https/x402.orth.sh/olostep/v1/answers/{answer_id}" ,
"method" : "GET" ,
"headers" : {
"Content-Type" : "application/json" ,
"x-polymer-pay-api-key" : "{{POLYMER_PAY_API_KEY}}"
}
}
Get Crawl Status Poll for status of a website crawl.
{
"url" : "https://pay.polymerlabs.org/proxy/https/x402.orth.sh/olostep/v1/crawls/{crawl_id}" ,
"method" : "GET" ,
"headers" : {
"Content-Type" : "application/json" ,
"x-polymer-pay-api-key" : "{{POLYMER_PAY_API_KEY}}"
}
}
Get Crawl Pages Get the list of pages discovered during a crawl.
{
"url" : "https://pay.polymerlabs.org/proxy/https/x402.orth.sh/olostep/v1/crawls/{crawl_id}/pages" ,
"method" : "GET" ,
"headers" : {
"Content-Type" : "application/json" ,
"x-polymer-pay-api-key" : "{{POLYMER_PAY_API_KEY}}"
}
}
Get Batch Status Poll for status of a batch processing job.
{
"url" : "https://pay.polymerlabs.org/proxy/https/x402.orth.sh/olostep/v1/batches/{batch_id}" ,
"method" : "GET" ,
"headers" : {
"Content-Type" : "application/json" ,
"x-polymer-pay-api-key" : "{{POLYMER_PAY_API_KEY}}"
}
}
Get Batch Items Get the list of processed items from a batch.
{
"url" : "https://pay.polymerlabs.org/proxy/https/x402.orth.sh/olostep/v1/batches/{batch_id}/items" ,
"method" : "GET" ,
"headers" : {
"Content-Type" : "application/json" ,
"x-polymer-pay-api-key" : "{{POLYMER_PAY_API_KEY}}"
}
}
When to Use
Web Scraping : Extract content from any webpageData Extraction : Get structured data from unstructured web contentWebsite Crawling : Crawl entire websites at scaleResearch Automation : Build AI-powered research workflowsBatch Processing : Process multiple URLs efficiently
Best Practices
Use Transformers : Use Mercury parser to clean extracted contentConfigure Timeouts : Set appropriate timeouts for complex pagesCrawl Depth : Start with limited depth to control costsBatch for Scale : Use batches for processing many URLsFor errors — See @skills/polymer-pay-api-errors/SKILL.md for complete error code reference and troubleshooting Related occupations SOC
Based on SOC occupation classification
