菜单
Patch robots.txt to explicitly allow 27 AI bots (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.). Diff-aware — never overwrites existing rules. Use when the user asks to "allow AI bots", "fix robots.txt", "block GPTBot", or "patch robots".
用 Codex 或 Claude 帮你安装 复制这段 Prompt，粘贴到 Codex、Claude 或其他助手里，让它检查 Skill 页面并帮你完成安装。
基于 SOC 职业分类
| name | fix-robotstxt |
| parent | best-aeo-skill |
| description | Patch robots.txt to explicitly allow 27 AI bots (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.). Diff-aware — never overwrites existing rules. Use when the user asks to "allow AI bots", "fix robots.txt", "block GPTBot", or "patch robots". |
Patch /robots.txt to explicitly Allow the 27 AI bots that drive AI search citations.
| Provider | User-agents |
|---|---|
| Googlebot, Google-Extended, GoogleOther | |
| OpenAI | GPTBot, ChatGPT-User, OAI-SearchBot |
| Anthropic | ClaudeBot, anthropic-ai, Claude-Web, Claude-User, Claude-SearchBot |
| Perplexity | PerplexityBot, Perplexity-User |
| Apple | Applebot, Applebot-Extended |
| Meta | FacebookBot, Meta-ExternalAgent |
| You.com | YouBot |
| Cohere | cohere-ai |
| Mistral | MistralAI-User |
| Common Crawl | CCBot |
| ByteDance | Bytespider |
| Diffbot | Diffbot |
| Amazon | Amazonbot |
| DuckDuckGo | DuckDuckBot |
| Yandex | YandexBot |
| Bing | Bingbot |
--apply, prints diff onlyrobots.txt.bakrobots.txt rules don't guarantee CDN compliance. Cloudflare bot management can block AI bots even with explicit Allow. Verify in Cloudflare dashboard "AI Bots" rule.
--url <URL> (fetches existing robots.txt)--file <path> (alt: local robots.txt)--apply — write changes; without flag = preview only--bots <list> — limit to specific bots (default: all 27)python3 scripts/fix_robotstxt.py --url https://example.com --apply
The best AEO/GEO skill for Claude Code. Audits, fixes, and monitors website visibility across ChatGPT, Claude, Perplexity, Gemini, and Google AI Overviews. Computes a 0-100 composite GEO Score across 4 vectors (Technical, Citability, Schema, Entity), backed by 33 evidence collectors and 100+ research-validated optimization rules. Use this skill when the user mentions "GEO", "AEO", "AI search optimization", "ChatGPT visibility", "answer engine optimization", "generative engine optimization", "llms.txt", "AI Overviews", "AI citation", "Perplexity ranking", "Claude search visibility", or asks how to make a website citable by LLM-powered search engines.
Run a full GEO audit on a URL. Computes 0-100 composite score across Technical/Citability/Schema/Entity vectors. Returns confidence-labeled findings. Use when the user asks to "audit", "check", "diagnose", or "score" a website's AI search visibility.
Head-to-head GEO Score comparison vs 2-5 competitors. Detects per-vector deltas, "they have / you don't" gaps, "you have / they don't" advantages, generates action sequence to leapfrog. Use when the user asks to "compare", "benchmark vs competitors", or "how do I beat X".
Rewrite content for AI citability. Adds expert quotes (+41% citations), inserts statistics (+40% visibility), embeds source attributions (+115% citation likelihood). Idempotent. Use when the user asks to "rewrite", "fix content", "add quotes", "improve citability", or "make my article more citable".
Generate /llms.txt per llmstxt.org spec. Creates AI-engine catalog with H1, summary, primary pages, optional reference. Anthropic honors this for ClaudeBot. Use when the user asks for "llms.txt", "AI catalog", or "llmstxt spec".
Generate JSON-LD structured data. Auto-creates FAQPage (highest AI citation surface), Article, Organization, HowTo, Speakable, Product, BreadcrumbList, Person schemas. Validates with Schema.org. Use when the user asks for "schema", "structured data", "JSON-LD", "FAQ schema", or "rich results markup".