This skill should be used when the user asks to "research web data", "scrape websites", "extract web data", "perform market research", "analyze competitors", "monitor prices", "collect product information", "search and analyze web content", or mentions Bright Data MCP, web scraping, web data extraction, or automated research. Provides comprehensive web research workflows using Bright Data MCP tools including search, scraping, extraction, and browser automation capabilities.
This skill should be used when the user asks to "research web data", "scrape websites", "extract web data", "perform market research", "analyze competitors", "monitor prices", "collect product information", "search and analyze web content", or mentions Bright Data MCP, web scraping, web data extraction, or automated research. Provides comprehensive web research workflows using Bright Data MCP tools including search, scraping, extraction, and browser automation capabilities.
version
1.0.0
Bright Data Research Skill
Advanced web research powered by Bright Data MCP - perform market analysis, competitive intelligence, data extraction, and comprehensive web research with anti-bot protection.
Overview
This skill provides complete workflows for automated web research using Bright Data MCP. Handle search discovery, content collection, structured data extraction, and comprehensive analysis with browser automation support.
When This Skill Applies
Activate this skill when the user's request involves:
Web scraping and data collection
Market research and competitive analysis
Price monitoring and comparison
Product information extraction
Search engine result analysis
Large-scale web data gathering
Research requiring anti-bot protection
Core Capabilities
Search and Discovery
Use search_engine tool to find relevant sources:
{"tool":"search_engine"
,
"parameters"
:
{
"query"
:
"site:etsy.com nba merchandise"
,
"engine"
:
"google"
,
"cursor"
:
"0"
}
}
Search strategies:
Use site operators: "site:etsy.com keywords"
Use exact phrases: "machine learning in healthcare"
Exclude terms: "iphone -case -cover"
Paginate with cursor: "0", "1", "2" for more results
Content Collection
Three collection modes based on research depth:
Quick Mode (3-5 URLs, serial processing):
Use scrape_as_markdown for each URL
Best for: Fast overviews, fact-checking
Standard Mode (10-20 URLs, parallel batch):
Use scrape_batch for up to 10 URLs concurrently
Best for: Market research, competitive analysis
Deep Mode (20-50 URLs, browser automation):
Use scraping_browser_navigate for JavaScript-rendered pages
Use scraping_browser_links to discover page links
Use scraping_browser_click for interactions
Best for: Dynamic content, multi-page extraction
Data Extraction
Use extract tool for AI-powered structured data extraction:
{"tool":"extract","parameters":{"url":"https://example.com/product","extraction_prompt":"Extract: product name, price as number, rating (0-5), number of reviews, seller name, availability status"}}
examples/academic-research-ml-healthcare.md - Academic literature review
Limitations
Requires Bright Data MCP server configuration
Needs valid Bright Data API token
Subject to API rate limits
Browser automation is slower than direct scraping
Some sites may still block access
Quality depends on source content
Progressive Disclosure
This SKILL.md provides core workflows and quick reference (approximately 2,000 words).
For detailed implementation patterns, advanced techniques, and comprehensive examples, consult the references/ files which load as needed during research tasks.
