firecrawl-crawl

name	firecrawl-crawl
description	Use when bulk extracting a website or site section through Firecrawl CLI, especially docs sections, many pages on one site, or ArkSpace web_crawl routing that selects Firecrawl.

Firecrawl Crawl

Use Firecrawl Crawl as a CLI-backed web_crawl provider when ArkSpace needs multi-page extraction from a known site or site section.

Before Use

Resolve the installed ArkSpace package root before running commands. Replace <installed-arkspace-path> with the directory two levels above this loaded SKILL.md, such as /Users/<user>/.claude/plugins/cache/ark-space/ark-space/0.1.2. Use the installed package path, not a repository-relative command.

Check configuration:

python3 <installed-arkspace-path>/scripts/arkspace.py provider check firecrawl --capability web_crawl

Set up Firecrawl:

python3 <installed-arkspace-path>/scripts/arkspace.py provider setup firecrawl --wizard

Missing Configuration Recovery

If the provider check reports missing configuration, ask whether to start setup with python3 <installed-arkspace-path>/scripts/arkspace.py provider setup firecrawl --wizard. Do not crawl with Firecrawl until the provider check succeeds.

Helper Script

Crawl a docs section:

python3 <installed-arkspace-path>/scripts/arkspace.py site crawl --provider firecrawl "https://docs.example.com" \
  --include-paths /docs \
  --limit 50 \
  --output json

Routing Notes

• Use registry/web-crawl-providers.yaml before execution.
• Start with shallow depth and small limits.
• Use map first when the user only needs a specific page from a large site.