Run any Skill in Manus with one click

re-extract

Stars29

Forks2

UpdatedMay 29, 2026 at 19:08

Re-extract the legacy Confluence RouterOS documentation export into SQLite. Use for rebuilding the current DB pipeline, not for the manual.mikrotik.com Docusaurus migration.

Installation

Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.

Run Skill in Manus

Source

tikoci

tikoci/rosetta

View GitHub Repository View Creator Repositories

Download

Run Skill in Manus

Related occupationsSOC

Based on SOC occupation classification

Software DevelopersComputer and Mathematical Occupations·SOC 15-1252

SKILL.md

readonly

name	re-extract
description	Re-extract the legacy Confluence RouterOS documentation export into SQLite. Use for rebuilding the current DB pipeline, not for the manual.mikrotik.com Docusaurus migration.
argument-hint	Path to legacy HTML export directory (optional)

Re-extract Legacy Documentation Pipeline

When to Use

A legacy Confluence HTML export is available
Database needs rebuilding from scratch
Schema changes require fresh extraction
New RouterOS versions available in restraml GitHub Pages

Do not use this skill as the migration path for https://manual.mikrotik.com. MikroTik's new Docusaurus manual and CLI Reference require extractor and MCP/TUI result-shape redesign; read DESIGN.md and briefings/B-0012-docusaurus-manual-migration.md first.

Procedure

Verify prerequisites
- Bun is installed: bun --version
- Dependencies installed: bun install
- Legacy HTML export exists in box/documents-export-*/ROS/
- For commands: internet access to https://tikoci.github.io/restraml/ (or provide a local docs path explicitly)
Clean existing database
```
make clean
```
Run full pipeline (choose one)

Single version (fast, latest stable only):
```
make extract
```
All versions (slower, all 46 RouterOS versions):
```
make extract-full
```
Pipeline order:
- extract-html — HTML → pages + callouts tables
- extract-properties — Property tables from HTML → properties table
- extract-commands or extract-all-versions — inspect.json → commands + ros_versions + command_versions
- link — command ↔ page mapping
Verify results
```
make search query="firewall filter"
```
Expected counts (full pipeline):
- ~317 pages, ~4860 properties, ~1034 callouts
- ~40K commands (primary version), ~1.67M command_versions
- 46 ros_versions, ~92% dir link coverage
Validate with type check and lint
```
bun run typecheck && make lint
```

Troubleshooting

If HTML directory changed, update HTML_DIR in the root Makefile
If using offline/local data, pass explicit source paths to extract-commands.ts or extract-all-versions.ts
Each extractor is idempotent — safe to re-run individually
FK deletion order matters: callouts → properties → pages

More from this repository

same repository

pr-review-gate

tikoci/rosetta

Close the loop on a rosetta PR's bot review threads (CodeRabbit + Copilot) before claiming it's mergeable. Green status checks and a clean reviewDecision do NOT mean mergeable here — main requires all conversation threads resolved, and that's a separate gate. Use when a PR is Ready for Review and you're about to say it's done, when `gh pr merge` is blocked despite green checks, or when the user asks to address/close review comments.

2026-07-1729

pick-next-task

tikoci/rosetta

Pick the next actionable work item from GitHub Issues. Filters open issues labeled agent-ready (spec settled, not blocked), surfaces umbrella/blocked context. Use when starting fresh work or asking 'what should I do next?'

2026-07-1029

promote-idea

tikoci/rosetta

Promote an Inbox bullet from BACKLOG.md to either a GitHub issue (work commitment) or a briefing (briefings/B-NNNN-*.md, research/decision support). Asks which based on whether the work is committed or still needs thinking. Removes the original bullet.

2026-07-1029

verify-task

tikoci/rosetta

Verify a work item is actually done by running the V-* validation rows its issue cites. Maps V-* IDs to the CI step / test command via VALIDATION.md, runs them, reports pass/fail per row.

2026-07-1029

Re-extract Legacy Documentation Pipeline

When to Use

A legacy Confluence HTML export is available

Database needs rebuilding from scratch

Schema changes require fresh extraction

New RouterOS versions available in restraml GitHub Pages

Procedure

Verify prerequisites

Bun is installed: bun --version
Dependencies installed: bun install
Legacy HTML export exists in box/documents-export-*/ROS/
For commands: internet access to https://tikoci.github.io/restraml/ (or provide a local docs path explicitly)

Clean existing database

make clean

Run full pipeline (choose one)

Single version (fast, latest stable only):

make extract

All versions (slower, all 46 RouterOS versions):

make extract-full

Pipeline order:

extract-html — HTML → pages + callouts tables
extract-properties — Property tables from HTML → properties table
extract-commands or extract-all-versions — inspect.json → commands + ros_versions + command_versions
link — command ↔ page mapping

Verify results

make search query="firewall filter"

Expected counts (full pipeline):

~317 pages, ~4860 properties, ~1034 callouts
~40K commands (primary version), ~1.67M command_versions
46 ros_versions, ~92% dir link coverage

Validate with type check and lint

bun run typecheck && make lint

Troubleshooting

If HTML directory changed, update HTML_DIR in the root Makefile

If using offline/local data, pass explicit source paths to extract-commands.ts or extract-all-versions.ts

Each extractor is idempotent — safe to re-run individually

FK deletion order matters: callouts → properties → pages