메뉴
Patch robots.txt to explicitly allow 27 AI bots (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.). Diff-aware — never overwrites existing rules. Use when the user asks to "allow AI bots", "fix robots.txt", "block GPTBot", or "patch robots".
Codex 또는 Claude로 설치 이 Prompt를 복사해 Codex, Claude 또는 다른 어시스턴트에 붙여 넣으면 Skill 페이지를 검토하고 설치를 진행할 수 있습니다.
SOC 직업 분류 기준
The best AEO/GEO skill for Claude Code. Audits, fixes, and monitors website visibility across ChatGPT, Claude, Perplexity, Gemini, and Google AI Overviews. Computes a 0-100 composite GEO Score across 4 vectors (Technical, Citability, Schema, Entity), backed by 33 evidence collectors and 100+ research-validated optimization rules. Use this skill when the user mentions "GEO", "AEO", "AI search optimization", "ChatGPT visibility", "answer engine optimization", "generative engine optimization", "llms.txt", "AI Overviews", "AI citation", "Perplexity ranking", "Claude search visibility", or asks how to make a website citable by LLM-powered search engines.
Run a full GEO audit on a URL. Computes 0-100 composite score across Technical/Citability/Schema/Entity vectors. Returns confidence-labeled findings. Use when the user asks to "audit", "check", "diagnose", or "score" a website's AI search visibility.
Head-to-head GEO Score comparison vs 2-5 competitors. Detects per-vector deltas, "they have / you don't" gaps, "you have / they don't" advantages, generates action sequence to leapfrog. Use when the user asks to "compare", "benchmark vs competitors", or "how do I beat X".
Rewrite content for AI citability. Adds expert quotes (+41% citations), inserts statistics (+40% visibility), embeds source attributions (+115% citation likelihood). Idempotent. Use when the user asks to "rewrite", "fix content", "add quotes", "improve citability", or "make my article more citable".
Generate /llms.txt per llmstxt.org spec. Creates AI-engine catalog with H1, summary, primary pages, optional reference. Anthropic honors this for ClaudeBot. Use when the user asks for "llms.txt", "AI catalog", or "llmstxt spec".
Generate JSON-LD structured data. Auto-creates FAQPage (highest AI citation surface), Article, Organization, HowTo, Speakable, Product, BreadcrumbList, Person schemas. Validates with Schema.org. Use when the user asks for "schema", "structured data", "JSON-LD", "FAQ schema", or "rich results markup".
| name | fix-robotstxt |
| parent | best-aeo-skill |
| description | Patch robots.txt to explicitly allow 27 AI bots (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.). Diff-aware — never overwrites existing rules. Use when the user asks to "allow AI bots", "fix robots.txt", "block GPTBot", or "patch robots". |
Patch /robots.txt to explicitly Allow the 27 AI bots that drive AI search citations.
| Provider | User-agents |
|---|---|
| Googlebot, Google-Extended, GoogleOther | |
| OpenAI | GPTBot, ChatGPT-User, OAI-SearchBot |
| Anthropic | ClaudeBot, anthropic-ai, Claude-Web, Claude-User, Claude-SearchBot |
| Perplexity | PerplexityBot, Perplexity-User |
| Apple | Applebot, Applebot-Extended |
| Meta | FacebookBot, Meta-ExternalAgent |
| You.com | YouBot |
| Cohere | cohere-ai |
| Mistral | MistralAI-User |
| Common Crawl | CCBot |
| ByteDance | Bytespider |
| Diffbot | Diffbot |
| Amazon | Amazonbot |
| DuckDuckGo | DuckDuckBot |
| Yandex | YandexBot |
| Bing | Bingbot |
--apply, prints diff onlyrobots.txt.bakrobots.txt rules don't guarantee CDN compliance. Cloudflare bot management can block AI bots even with explicit Allow. Verify in Cloudflare dashboard "AI Bots" rule.
--url <URL> (fetches existing robots.txt)--file <path> (alt: local robots.txt)--apply — write changes; without flag = preview only--bots <list> — limit to specific bots (default: all 27)python3 scripts/fix_robotstxt.py --url https://example.com --apply