robots-sitemap-validator

name	robots-sitemap-validator
description	Check robots.txt and sitemap.xml for crawl-blocking mistakes. Use when the user says "check my robots.txt", "validate my sitemap", or "is my site crawlable".
metadata	{"author":"JustHandled Labs","version":"1.0.0","price":"$0","credits":0,"triggers":["check my robots.txt","validate my sitemap","is my site crawlable"]}

Robots Sitemap Validator

Detect common local robots.txt and sitemap.xml mistakes that can hurt crawling. This detector does not fetch, submit, or change live sites.

Workflow

1. Run scripts/scan_robots_sitemap.py with a folder, files, or --stdin.
2. Review findings by rule id, severity, file, and line.
3. Treat missing sibling sitemap files as review flags when robots.txt references them.

Guardrails

• Read local files or stdin only.
• Do not fetch live URLs or submit sitemaps.
• Do not modify robots.txt or sitemap files.

Verification

Run tests/test_robots_sitemap.py. Risky fixture must produce findings and clean fixture must produce zero findings.

Commercial Terms

Price: $0 / 0 credits. Free commercial use for personal or internal team workflows. Do not resell or redistribute the package as-is.