scraping-skills

6 web scraping & data collection skills. Trigger: collecting web data, finding datasets, API access for research. Design: ethical scraping methods with rate limiting and data quality checks.

Jump to install

Repository: brycewang-stanford/Auto-Empirical-Research-Skills
Last source activity: April 3, 2026 at 02:07
Detected SKILL.md language: English
Stars: 3,291
Forks: 432

Install options

The review-first prompt is selected by default. You can switch to a direct command or download a local copy.

Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.

A direct command skips the review prompt. Inspect the source before running it.

npx skills add https://github.com/brycewang-stanford/Auto-Empirical-Research-Skills --skill scraping-skills

The command stays on one line. Scroll horizontally to inspect it before copying.

Prefer a local copy? Download the files currently available to SkillsMP.

Review the source files

Read SKILL.md and any companion files shown by SkillsMP before deciding whether to install.

File Explorer

7 files

SKILL.md

Source instructions · Read-only preview

Back to search Back to installation

auto-empirical-research-skills

Route empirical-research requests through the Auto-Empirical Research Skills catalog when this whole repository is installed as one skill in Codex, CodeBuddy, Claude Code, or another IDE. Use to choose and load the right vendored AERS skill for causal inference, econometrics, replication, data acquisition, manuscript writing, peer review and referee responses, citation checking, de-AIGC editing, or full empirical-paper workflows without reading the entire repository at once.

2026-08-06

de-aigc-skills

中英双语学术降 AIGC / bilingual academic de-AIGC skill. Removes AI-generated writing signatures from empirical papers in economics, management, and the social sciences — in both English and Chinese. Covers Turnitin AI, GPTZero, Originality.ai on the English side and 知网 AMLC, 万方, 维普 on the Chinese side. Uses a six-step loop (intake → audit → claim-evidence check → differentiated rewrite → five-dimension self-score → cold-reader recheck) with two pattern libraries (22 English + 17 Chinese patterns), section-by-section strategies for empirical papers, and hard protections that keep every number, coefficient, and citation intact.

2026-08-04

kaggle-research

Use when a research task needs reproducible Kaggle discovery, metadata inspection, bounded public-data downloads, competition or kernel discovery, model discovery, or an explicitly approved Kaggle write/delete operation through the official CLI.

2026-07-31

View all from this repository

Skill	Description
academic-web-scraping	Ethical web scraping and API-based data collection for research
dataset-finder-guide	Search and download research datasets from Kaggle, HuggingFace, and repos
easy-spider-guide	Guide to EasySpider for visual no-code web data collection
google-scholar-scraper	Ethical Google Scholar data collection techniques and best practices
repository-harvesting-guide	Harvest metadata from open repositories using OAI-PMH protocol
web-scraping-ethics-guide	Scrape web data ethically and legally for research purposes

Skill	Description
academic-web-scraping	Ethical web scraping and API-based data collection for research
dataset-finder-guide	Search and download research datasets from Kaggle, HuggingFace, and repos
easy-spider-guide	Guide to EasySpider for visual no-code web data collection
google-scholar-scraper	Ethical Google Scholar data collection techniques and best practices
repository-harvesting-guide	Harvest metadata from open repositories using OAI-PMH protocol
web-scraping-ethics-guide	Scrape web data ethically and legally for research purposes

scraping-skills

Install options

Review the source files

Web Scraping & Data Collection — 6 Skills

Web Scraping & Data Collection — 6 Skills

name	scraping-skills
description	6 web scraping & data collection skills. Trigger: collecting web data, finding datasets, API access for research. Design: ethical scraping methods with rate limiting and data quality checks.

scraping-skills

Source facts

Install options

Review the source files

More from this repository

More from this repository

Web Scraping & Data Collection — 6 Skills

Web Scraping & Data Collection — 6 Skills