| name | project-aeo-monitoring-tools |
| description | Build custom AI search monitoring tools for competitive AEO analysis. Covers API access, scraping architecture, legal compliance, and cost estimation. |
| version | 1.0.0 |
| tags | ["aeo","monitoring","scraping","api","competitive-analysis","engineering"] |
AEO Monitoring Tools
Build custom infrastructure for monitoring AI search engine visibility and competitive citation analysis.
Audience: Engineers building custom AEO monitoring systems
Related: For AEO strategy and optimization guidance, see marketing-ai-search-optimization
When to Use This Skill
- Building custom AEO monitoring infrastructure
- Evaluating build vs. buy decisions for AI search tracking
- Understanding API vs. scraping trade-offs per platform
- Designing data pipelines for citation analysis
- Estimating costs for multi-platform monitoring
Decision Framework: Build vs. Buy
Before building custom tools, evaluate whether commercial solutions fit your needs.
| Factor | Use Commercial Tools | Build Custom |
|---|
| Budget | <$500/mo | >$2,000/mo in tool costs OR need custom queries |
| Query volume | <500 queries/week | >2,000 queries/week |
| Platform coverage | Standard 5-6 engines | Need niche engines or custom prompts |
| Integration needs | Standard exports (CSV, API) | Deep CRM/analytics integration |
| Engineering capacity | No dedicated engineer | 1+ FTE available |
| Customization | Standard metrics sufficient | Custom scoring, proprietary analysis |
Commercial tools to evaluate first:
| Tool | Price | Strengths |
|---|
| Profound | $499/mo | Full AEO tracking, competitor analysis |
| Semrush One | $199+/mo | Integrated with SEO suite |
| Goodie AI | $495+/mo | Enterprise features |
| Otterly.AI | Contact | ChatGPT/Perplexity focus |
| LLMrefs | Free | Basic citation tracking |
Platform Access Overview
Each AI platform requires different access approaches.
| Platform | Recommended Approach | API Available | Monthly Cost | Citation Support |
|---|
| Perplexity | Sonar API | Yes (citations native) | $15-30 | Native |
| Gemini | Free API tier | Yes (1,500/day free) | $0 | Extract from response |
| Claude | Claude API | Yes | $75-150 | Extract from response |
| ChatGPT / OpenAI | Official API (use web search tools if available) OR commercial vendor | Yes (varies) | $60-500+ | Varies (official tools or vendor) |
| Google AI Overviews | Commercial tools only | No (typically) | N/A | Commercial tools only |
Key insight: Perplexity Sonar API is the most AEO-friendly - it returns citations natively in the response.
See: references/platform-access-methods.md
Architecture Tiers
Tier 1: API-First (Recommended)
Use official APIs where available. Lowest risk, most maintainable.
Query Bank -> API Orchestrator -> Response Store -> Analysis Layer
(250-500 (rate limiting, (PostgreSQL/ (citation extraction,
queries) retry logic) BigQuery) brand detection)
Platforms covered: Perplexity, Gemini, Claude, OpenAI (baseline; use official web-search tooling if available)
Cost: $15-300/mo depending on volume
Risk: Low
Tier 2: Hybrid (API + Commercial Scraping)
Add commercial scraping services for platforms without good APIs.
Additional coverage: ChatGPT web interface, Google AI Overviews
Cost: $500-1,500/mo (adds commercial scraper fees)
Risk: Medium (dependent on scraper provider)
Tier 3: Full Custom Scraping (Not Recommended)
DIY web scraping of AI platforms.
Why to avoid:
- High ToS violation risk
- Aggressive bot detection (especially Google, ChatGPT)
- Maintenance burden (UI changes break scrapers)
- Potential legal liability
See: assets/technical/architecture-diagrams.md
Risk Assessment Matrix
| Approach | ToS Risk | Legal Risk | Detection Risk | Recommendation |
|---|
| Official APIs | None | None | None | RECOMMENDED |
| Commercial scraping services | Transferred to provider | Provider's liability | Low | Acceptable with due diligence |
| DIY web scraping | High | Medium-High | High | NOT RECOMMENDED |
| Violating robots.txt | Very High | High | Very High | NEVER |
Legal developments to monitor:
- Publisher lawsuits and data sourcing disputes (example: Reddit v. Perplexity AI (2024))
- Platform ToS enforcement and liquidated damages policies (example: X ToS changes)
- Rising use of crawler blocks and WAF rules (GPTBot, ClaudeBot, etc.)
See: references/legal-compliance.md
Cost Estimation
| Tier | Components | Monthly Cost |
|---|
| Minimal | Gemini free + Perplexity Sonar + Supabase | $15-50 |
| Standard | Multi-platform APIs + PostgreSQL | $150-300 |
| Comprehensive | APIs + commercial scraping + analytics | $500-1,500 |
| Enterprise | Full coverage + dedicated infrastructure | $2,000+ |
See: references/cost-estimation.md
Implementation Timeline
| Week | Focus | Deliverables |
|---|
| 1 | Foundation | Query bank (250-500), API accounts, database schema |
| 2 | Core pipeline | API orchestrator, response storage, citation extraction |
| 3 | Analysis | Brand detection, competitor tracking, Share of Model calc |
| 4 | Reporting | Dashboard, alerts, maintenance procedures |
See: assets/setup/minimal-setup-guide.md
What to Load (Progressive Disclosure)
Load additional references based on your needs:
Quick Start Checklist
[ ] Define query bank (250-500 queries by intent)
[ ] Choose platforms to monitor (prioritize by ICP usage)
[ ] Evaluate build vs. buy decision
[ ] If building: Set up API accounts (Perplexity, Gemini, Claude/OpenAI)
[ ] Create database schema (PostgreSQL recommended)
[ ] Build API orchestrator with rate limiting
[ ] Implement citation extraction
[ ] Set up scheduled runs (daily/weekly)
[ ] Create Share of Model dashboard
[ ] Document maintenance procedures
Key Metrics
Primary metric: Share of Model (SoM)
SoM = (Your brand mentions / Total responses) * 100
Track SoM:
- Per platform (ChatGPT, Perplexity, Gemini, Claude)
- Per query intent (informational, commercial, transactional)
- Over time (weekly/monthly trends)
- vs. competitors
Secondary metrics:
- Citation rate (% of responses with your URL)
- Position in citations (1st, 2nd, 3rd mention)
- Sentiment of brand mentions
- Query coverage (% of target queries where you appear)
Related Skills
marketing-ai-search-optimization - AEO strategy, content optimization, measurement methodologysoftware-api-design - API integration patternsqa-observability - Monitoring and alerting setup
Disclaimer
This guidance is for educational purposes. Users must:
- Conduct their own legal review
- Ensure compliance with applicable terms of service
- Respect robots.txt directives
- Follow laws and regulations in their jurisdiction
Building monitoring tools that violate platform ToS may result in account termination, legal action, or both.
