dev-cycle

Crawlberg iteration loops codified as Taskfile tasks — alef install/generate/format/bump, core and binding builds, e2e generate/build/test cycles, cleanup tiers, and the mock-server / stale-.so / precompiled-NIF / generated-e2e gotchas. Load when running or debugging crawlberg build, alef regeneration, or e2e workflows, or when unsure which task to run.

Jump to install

Repository: xberg-io/crawlberg
Last source activity: July 22, 2026 at 18:19
Detected SKILL.md language: English
Stars: 157
Forks: 24

Install options

The review-first prompt is selected by default. You can switch to a direct command or download a local copy.

Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.

A direct command skips the review prompt. Inspect the source before running it.

npx skills add https://github.com/xberg-io/crawlberg --skill dev-cycle

The command stays on one line. Scroll horizontally to inspect it before copying.

Prefer a local copy? Download the files currently available to SkillsMP.

Review the source files

Read SKILL.md and any companion files shown by SkillsMP before deciding whether to install.

SKILL.md

Source instructions · Read-only preview

Back to search Back to installation

automating-the-browser

Use when extracting a page needs scripted interaction first — click, type, press a key, scroll, wait, screenshot, or run JS before capturing the DOM. Covers `crawlberg interact URL --actions` with the real action schema, result shape, limits, and external-CDP options.

2026-08-11

crawlberg

Crawl, scrape, and convert websites to Markdown using the local crawlberg CLI and its MCP server. Use when the user wants to fetch a page, follow links across a domain, enumerate URLs, or drive a real browser. Covers installation, the subcommands (scrape, crawl, map, interact, batch-scrape, batch-crawl, download, citations, version, mcp, serve), output formats (JSON + Markdown), browser fallback, and when to prefer the MCP server over shelling out.

2026-08-11

crawling-a-site

Use when the user wants to follow links across a domain and capture every reachable page as Markdown. Covers `crawlberg crawl` with depth, page caps, concurrency, rate limiting, domain scoping, robots, and output selection.

2026-08-11

View all from this repository

task alef:install # cargo install --path ../alef/crates/alef-cli task alef:generate # alef all --clean --format=false task alef:format # explicit Alef formatting; task format excludes this VERSION=0.15.30 task alef:bump # bump pin in alef.toml + reinstall + regen

task e2e:generate # regenerate all language test suites from fixtures task e2e:build # build bindings and the generated mock-server for e2e task e2e:test # run generated e2e suites task e2e:all # generate + build + run generated e2e suites

task clean # per-language artifacts task clean:workspace # cargo target + alef IR cache + legacy mock-server bins task clean:e2e # venvs, node_modules, _build, lockfiles, vendor/ task clean:full # all of the above

dev-cycle

Install options

Review the source files

After alef changes

After crawlberg-core changes

E2E cycles

Cleanup

Gotchas (codified, but worth knowing)

After alef changes

After crawlberg-core changes

E2E cycles

Cleanup

Gotchas (codified, but worth knowing)

name	dev-cycle
description	Crawlberg iteration loops codified as Taskfile tasks — alef install/generate/format/bump, core and binding builds, e2e generate/build/test cycles, cleanup tiers, and the mock-server / stale-.so / precompiled-NIF / generated-e2e gotchas. Load when running or debugging crawlberg build, alef regeneration, or e2e workflows, or when unsure which task to run.

dev-cycle

Source facts

Install options

Review the source files

More from this repository

After alef changes

After crawlberg-core changes

E2E cycles

Cleanup

Gotchas (codified, but worth knowing)

More from this repository

After alef changes

After crawlberg-core changes

E2E cycles

Cleanup

Gotchas (codified, but worth knowing)