run-claude-osint

name	run-claude-osint
description	Build, validate, and run the claude-osint skills repo — check SKILL.md frontmatter, run the secret_scan.py and h1_reference.py helpers, run sync-skill-content.sh, run the smoke test. Use when asked to run, build, test, validate, or smoke-test claude-osint or its OSINT skills/scripts.
version	1.0.0
triggers	["run claude-osint","build claude-osint","test claude-osint","validate claude-osint","smoke test claude-osint","run secret_scan","run h1_reference","validate SKILL.md frontmatter","sync skill content"]

Run: claude-osint

claude-osint is not an app — it's a Claude skills package. Its product is two SKILL.md files (skills/offensive-osint/, skills/osint-methodology/) plus two runnable Python helpers under skills/offensive-osint/scripts/. There is no GUI, server, or TUI. "Running it" means: the SKILL.md frontmatter parses and is complete (that's what Claude loads), and the helper scripts work.

The driver is .claude/skills/run-claude-osint/smoke.sh — it does all of that in one shot. All paths below are relative to the repo root.

Prerequisites

Python 3 with PyYAML (already present on this container). If import yaml fails:

pip install pyyaml    # or: apt-get install -y python3-yaml

The helpers are stdlib-only otherwise. h1_reference.py needs outbound HTTPS to hackerone.com. No build step, no npm install — nothing to compile.

Run (agent path) — the driver

From the repo root:

.claude/skills/run-claude-osint/smoke.sh           # full smoke (exits 0 on pass)
.claude/skills/run-claude-osint/smoke.sh --no-net  # skip the HackerOne live check

It runs six checks and prints a ==> PASS / ==> FAIL line (exit 0 / 1):

1. py_compile both helpers.
2. secret_scan.py detects AWS key + JWT from stdin (the CI canaries).
3. secret_scan.py recursively scans skills/ and emits JSONL (~11 findings — example tokens in the SKILL.md docs).
4. Every skills/*/SKILL.md has valid YAML frontmatter with name/description/version/triggers and ≥5 triggers.
5. sync-skill-content.sh --check exits 0.
6. h1_reference.py fetches one live disclosed report (non-fatal if offline).

Run individual pieces

Verified this session:

# Secret scanner — stdin
printf 'AKIAIOSFODNN7EXAMPLE\n' | python3 skills/offensive-osint/scripts/secret_scan.py
# -> {"pattern": "AWS_ACCESS_KEY", "severity": "critical", ...}

# Secret scanner — scan a directory tree (JSONL, one finding per line)
python3 skills/offensive-osint/scripts/secret_scan.py skills/

# HackerOne reference helper (needs network)
python3 skills/offensive-osint/scripts/h1_reference.py --top-voted --limit 3
python3 skills/offensive-osint/scripts/h1_reference.py --top-bounty --limit 3
python3 skills/offensive-osint/scripts/h1_reference.py --top-voted --query "XSS" --pages 3

# Install the skills for Claude to load
cp -r skills/* ~/.claude/skills/

Test

CI (.github/workflows/lint.yml) runs four jobs: markdown lint (markdownlint-cli2), the frontmatter check, the secret_scan.py smoke, and shellcheck ./scripts. smoke.sh covers the latter two plus the helpers directly. markdownlint-cli2 and shellcheck are not installed on this container; install with npm i -g markdownlint-cli2 / apt-get install -y shellcheck if you need to reproduce those jobs locally.

Gotchas

• sync-skill-content.sh is a no-op in a fresh clone. It copies from docs/full-skills/, which is not in the repo — the script prints "⚠ Source missing … Skipping" and exits 0. The skills/*/SKILL.md files are already the full inline content (offensive-osint ≈ 4,200 lines), so you do not need to run sync after cloning. Don't be alarmed by the warnings.
• secret_scan.py skips its own findings as noise filters. It excludes .git, node_modules, __pycache__, .venv, dist, build, .cache and any file >10 MB. Scanning skills/ returns the example/doc tokens (~11), not real secrets.
• h1_reference.py hits an undocumented public GraphQL endpoint. It works unauthenticated but is sensitive to HackerOne-side changes and rate limits; treat a failure there as environmental, not a repo bug (hence non-fatal in the driver). It caps at 50 results/page — use --pages N for breadth.
• No screenshot / no window — this repo has no visual surface. If a request asks to "see it run," that means the smoke.sh PASS output, not a GUI.

Troubleshooting

Symptom	Fix
ModuleNotFoundError: No module named 'yaml' in check [4]	pip install pyyaml (only the frontmatter check needs it).
Check [6] shows ~ no network / HackerOne unreachable	Expected when egress is blocked; run with --no-net to silence. Driver still passes.
sync --check shows "Source missing"	Expected — see Gotchas. Not a failure; exit code is 0.