alma-scraper

name	alma-scraper
description	Intelligent scraper for Australian youth justice sources. Discovers, extracts, and learns from government, Indigenous, research, and media sources.

ALMA Intelligent Scraper

When to Use

• Finding new youth justice information
• Updating ALMA intelligence
• Discovering new sources
• Analyzing coverage gaps
• Checking what's new in youth justice

Commands

Command	Purpose	Duration
quick	Top 10 high-value sources	5 min
deep	All 50+ sources with discovery	30-60 min
discover	Follow discovered links	Variable
source "QLD"	Deep dive specific jurisdiction	15 min
gaps	Show coverage gaps	2 min
status	Current knowledge state	Instant

Learning Cycle

SCRAPE → EXTRACT → EVALUATE → LEARN → STORE
         (Claude)   (Quality)  (Patterns)

Quality Signals

Signal	Weight
Relevance (AU youth justice?)	30%
Novelty (new info?)	25%
Specificity (concrete details?)	20%
Evidence (research backed?)	15%
Actionability (useful?)	10%

Priority Formula

priority = (quality × 0.4) + (freshness_need × 0.3) + (coverage_gap × 0.3)

Sacred Boundaries

Never scrape: Private info, court records, social media, paywalled Always mark: Community Controlled, Indigenous orgs, cultural knowledge Always check: Consent level, cultural authority, data sovereignty

File References

Need	Reference
Database schema	references/database-schema.md
Extraction patterns	references/extraction-patterns.md
Coverage tracking	references/coverage-tracking.md
Implementation code	references/implementation.md