菜单
Extract structured data from 40+ websites including Amazon, LinkedIn, Instagram, TikTok, Facebook, YouTube, and more. Uses Bright Data's Web Data APIs with automatic polling. Returns clean JSON with product details, profiles, reviews, posts, and comments.
用 Codex 或 Claude 帮你安装 复制这段 Prompt，粘贴到 Codex、Claude 或其他助手里，让它检查 Skill 页面并帮你完成安装。
基于 SOC 职业分类
| name | data-feeds |
| description | Extract structured data from 40+ websites including Amazon, LinkedIn, Instagram, TikTok, Facebook, YouTube, and more. Uses Bright Data's Web Data APIs with automatic polling. Returns clean JSON with product details, profiles, reviews, posts, and comments. |
Extract structured data from major websites with automatic parsing. No scraping logic needed - just provide a URL and get clean JSON data.
export BRIGHTDATA_API_KEY="your-api-key"
export BRIGHTDATA_POLLING_TIMEOUT=600 # Max seconds to wait (default: 600)
Get your API key from Bright Data Dashboard.
bash scripts/datasets.sh <dataset_type> <url> [additional_params...]
| Dataset | Command | Description |
|---|---|---|
| Amazon Product | datasets.sh amazon_product <url> | Product details, pricing, ratings |
| Amazon Reviews | datasets.sh amazon_product_reviews <url> | Customer reviews for a product |
| Amazon Search | datasets.sh amazon_product_search <keyword> <domain_url> | Search results |
| Walmart Product | datasets.sh walmart_product <url> | Product details from Walmart |
| Walmart Seller | datasets.sh walmart_seller <url> | Seller information |
| eBay Product | datasets.sh ebay_product <url> | eBay listing details |
| Home Depot | datasets.sh homedepot_products <url> | Home Depot product data |
| Zara | datasets.sh zara_products <url> | Zara product details |
| Etsy | datasets.sh etsy_products <url> | Etsy listing data |
| Best Buy | datasets.sh bestbuy_products <url> | Best Buy product info |
| Dataset | Command | Description |
|---|---|---|
| LinkedIn Person | datasets.sh linkedin_person_profile <url> | Profile data (experience, skills) |
| LinkedIn Company | datasets.sh linkedin_company_profile <url> | Company page data |
| LinkedIn Jobs | datasets.sh linkedin_job_listings <url> | Job posting details |
| LinkedIn Posts | datasets.sh linkedin_posts <url> | Post content and engagement |
| LinkedIn Search | datasets.sh linkedin_people_search <url> <first> <last> | Find people |
| Crunchbase | datasets.sh crunchbase_company <url> | Company funding, employees |
| ZoomInfo | datasets.sh zoominfo_company_profile <url> | Company profile data |
| Dataset | Command | Description |
|---|---|---|
| Profiles | datasets.sh instagram_profiles <url> | Bio, followers, following |
| Posts | datasets.sh instagram_posts <url> | Post details, likes, captions |
| Reels | datasets.sh instagram_reels <url> | Reel data and metrics |
| Comments | datasets.sh instagram_comments <url> | Post comments |
| Dataset | Command | Description |
|---|---|---|
| Posts | datasets.sh facebook_posts <url> | Post content and reactions |
| Marketplace | datasets.sh facebook_marketplace_listings <url> | Listing details |
| Reviews | datasets.sh facebook_company_reviews <url> [num] | Company reviews |
| Events | datasets.sh facebook_events <url> | Event details |
| Dataset | Command | Description |
|---|---|---|
| Profiles | datasets.sh tiktok_profiles <url> | Creator profile data |
| Posts | datasets.sh tiktok_posts <url> | Video details and metrics |
| Shop | datasets.sh tiktok_shop <url> | TikTok Shop product data |
| Comments | datasets.sh tiktok_comments <url> | Video comments |
| Dataset | Command | Description |
|---|---|---|
| Profiles | datasets.sh youtube_profiles <url> | Channel data |
| Videos | datasets.sh youtube_videos <url> | Video details and stats |
| Comments | datasets.sh youtube_comments <url> [num] | Video comments (default: 10) |
| Dataset | Command | Description |
|---|---|---|
| X (Twitter) | datasets.sh x_posts <url> | Tweet data |
datasets.sh reddit_posts <url> | Post and comment data |
| Dataset | Command | Description |
|---|---|---|
| Maps Reviews | datasets.sh google_maps_reviews <url> [days] | Business reviews (default: 3 days) |
| Shopping | datasets.sh google_shopping <url> | Product comparison data |
| Play Store | datasets.sh google_play_store <url> | App details and reviews |
| Dataset | Command | Description |
|---|---|---|
| Apple App Store | datasets.sh apple_app_store <url> | iOS app data |
| Reuters News | datasets.sh reuter_news <url> | News article content |
| GitHub | datasets.sh github_repository_file <url> | Repository file data |
| Yahoo Finance | datasets.sh yahoo_finance_business <url> | Stock and company data |
| Zillow | datasets.sh zillow_properties_listing <url> | Property listing details |
| Booking.com | datasets.sh booking_hotel_listings <url> | Hotel listing data |
bash scripts/datasets.sh linkedin_person_profile "https://www.linkedin.com/in/satyanadella/"
bash scripts/datasets.sh amazon_product "https://www.amazon.com/dp/B09V3KXJPB"
bash scripts/datasets.sh instagram_profiles "https://www.instagram.com/natgeo/"
bash scripts/datasets.sh youtube_comments "https://www.youtube.com/watch?v=dQw4w9WgXcQ" 20
bash scripts/datasets.sh amazon_product_search "wireless headphones" "https://www.amazon.com"
Returns structured JSON with website-specific fields. Example for LinkedIn profile:
{
"name": "Satya Nadella",
"headline": "Chairman and CEO at Microsoft",
"location": "Greater Seattle Area",
"connections": "500+",
"experience": [...],
"education": [...],
"skills": [...]
}
The polling mechanism handles rate limits and ensures data quality by waiting for full extraction.
For custom dataset IDs or advanced use cases:
bash scripts/fetch.sh <dataset_id> '<json_input>'
Example:
bash scripts/fetch.sh gd_l1viktl72bvl7bjuj0 '{"url":"https://linkedin.com/in/someone"}'
Audit and incrementally retrofit an existing codebase so its intent and behavior are equally legible to people and AI agents. Applies Context Architecture's eight principles: place AGENTS.md at boundaries, bind every context claim to a mechanism (lint, types, tests, review), name boundaries, and find context that has rotted. Use when an agent reimplements code that already exists, invents structure, follows stale or deleted docs, propagates a deprecated pattern, or resolves ambiguity at random, or when asked to make a repository "agent-ready", "AI-legible", or to add or fix AGENTS.md / CLAUDE.md files.
Use when the user wants to integrate with the X (Twitter) API via Xquik to search tweets, look up user profiles, extract followers, run giveaway draws, monitor accounts, or access trending topics. Also use when the user mentions 'Xquik,' 'Twitter API,' 'X API,' 'tweet scraper,' 'follower extraction,' or 'Twitter monitoring.' Covers REST API, webhooks, and MCP server setup.
Fill any PDF locally and place each value precisely in a visual editor. Use when the user wants to fill out a PDF form, enter data into a PDF, complete a tax/insurance/bank form, or position text on a flat/scanned PDF. Handles flat (field-less) PDFs, per-character (comb) fields, and native AcroForm fields; leaves the signature blank for the user to sign.
Automated Android CI/CD pipeline to Google Play — supports TWA, React Native, Flutter, and native Android. Run npx android-cicd to set up keystore generation, GitHub Secrets, and a multi-stage workflow (internal/alpha/beta/production) with auto-bump versionCode.
Use this skill whenever a developer wants to turn an idea into a complete, production-ready, end-to-end system plan BEFORE writing any code. Trigger on 'plan this system', 'design the architecture for', 'help me blueprint', 'deep plan for X', 'break this idea into components', 'expand into action points', 'full implementation plan', or when the user pastes a project idea wanting architecture, components, pipelines, and file-level execution mapped out. Casual phrasing also triggers: 'help me think this through end-to-end', 'plan before coding'. Also covers living-workspace patterns: self-improving knowledge bases, reflection loops with auditor agents, four-agent teams, schema-as-code, wiki health scoring. **Resume triggers**: 'where did we leave off', 'continue this plan', 'resume my blueprint' - rehydrates state from disk via SESSION.md/NEXT.md/decisions/. Web research is mandatory every invocation.
Use when adding a blog to a Next.js + Sanity site, building a blog section from scratch, integrating Sanity CMS for editorial content, or setting up an SEO-optimized article surface. Triggers on phrases like 'add a blog', 'build the blog', 'create blog section', 'set up blog with Sanity', 'integrate Sanity CMS', 'blog architecture', or any new-blog scoping conversation on a Next.js project.