| name | arxiv |
| description | Search and retrieve academic papers from arXiv (and citations via Semantic Scholar) using only curl + Python stdlib.
Use when: "найди статью на arxiv", "поищи научные работы", "найди цитирования статьи", "search arxiv", "find papers on", "get citation count"
|
arXiv Research
Search and retrieve academic papers from arXiv via their free REST API. No API key, no dependencies — just curl.
What do you need?
Find papers?
├─ By topic / author / category → use the helper script (happy path below)
├─ Complex queries (field prefixes, boolean, sort, pagination) → follow syntax from arxiv-api.md
└─ Results with citation counts (JSON) → use search endpoint from semantic-scholar.md
Work with a known paper (have its arXiv ID)?
├─ Read it → WebFetch (happy path below)
├─ BibTeX entry, version pinning, withdrawn check → follow recipes from arxiv-api.md
└─ Citations / references / recommendations → use endpoints from semantic-scholar.md
Author profile (h-index, paper count)? → use author endpoint from semantic-scholar.md
Load the smallest set of references that fits the task — the happy paths below cover most requests without any.
Quick Reference
| Action | Command |
|---|
| Search papers | python scripts/search_arxiv.py "QUERY" |
| Search (raw API) | curl "https://export.arxiv.org/api/query?search_query=all:QUERY&max_results=5" |
| Get specific paper | curl "https://export.arxiv.org/api/query?id_list=2402.03300" |
| Read abstract (web) | WebFetch on https://arxiv.org/abs/2402.03300 |
| Read full paper (PDF) | WebFetch on https://arxiv.org/pdf/2402.03300 |
| Citation count | curl "https://api.semanticscholar.org/graph/v1/paper/arXiv:2402.03300?fields=citationCount" |
Searching Papers (happy path)
The arXiv API returns Atom XML; the scripts/search_arxiv.py helper handles parsing and prints clean output. Python stdlib only.
python scripts/search_arxiv.py "GRPO reinforcement learning"
python scripts/search_arxiv.py "transformer attention" --max 10 --sort date
python scripts/search_arxiv.py --author "Yann LeCun" --max 5
python scripts/search_arxiv.py --category cs.AI --sort date
python scripts/search_arxiv.py --id 2402.03300
python scripts/search_arxiv.py --id 2402.03300,2401.12345
For raw curl queries, build search_query using the prefix table (ti:, au:, cat:, …), boolean operators, and sort/pagination parameters from arxiv-api.md. Category codes (cs.AI, cs.LG, …) are listed there too.
Reading Paper Content (happy path)
After finding a paper, read it with WebFetch:
# Abstract page (fast, metadata + abstract)
WebFetch on https://arxiv.org/abs/2402.03300
# Full paper (PDF)
WebFetch on https://arxiv.org/pdf/2402.03300
# HTML (when available)
WebFetch on https://arxiv.org/html/2402.03300
When citing what you read, preserve the version suffix (v1, v7) — versioning rules and the withdrawn-paper check are in arxiv-api.md.
Complete Research Workflow
- Discover:
python scripts/search_arxiv.py "your topic" --sort date --max 10
- Assess impact:
curl -s "https://api.semanticscholar.org/graph/v1/paper/arXiv:ID?fields=citationCount,influentialCitationCount"
- Read abstract: WebFetch on
https://arxiv.org/abs/ID
- Read full paper: WebFetch on
https://arxiv.org/pdf/ID
- Find related work: citations/references endpoints from semantic-scholar.md
- Get recommendations: POST to the recommendations endpoint, same reference
- Track authors: author search endpoint, same reference
Rate Limits
| API | Rate | Auth |
|---|
| arXiv | ~1 req / 3 seconds | None needed |
| Semantic Scholar | 1 req / second | None (100/sec with API key) |
Notes
- arXiv returns Atom XML — use the helper script for clean output; Semantic Scholar returns JSON — pipe through
python3 -m json.tool
- PDF:
https://arxiv.org/pdf/{id} — Abstract: https://arxiv.org/abs/{id}
- For local PDF processing, see the
ocr-and-documents skill
