Run any Skill in Manus with one click

probeagent-repo-conventions

Stars18

Forks6

UpdatedJuly 13, 2026 at 17:27

Follow ProbeAgent's house rules for files, licensing, packaging, changelog, and what belongs in the repo. LOAD THIS when creating a new source file, editing packaging (pyproject), writing changelog entries, or deciding whether something (esp. marketing) belongs in the repo at all. Prevents the common mistakes that get caught in review.

Installation

Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.

Run Skill in Manus

Source

sumamovva

sumamovva/probeagent

View GitHub Repository View Creator Repositories

Download

Run Skill in Manus

Related occupationsSOC

Based on SOC occupation classification

Software DevelopersComputer and Mathematical Occupations·SOC 15-1252

SKILL.md

readonly

name	probeagent-repo-conventions
description	Follow ProbeAgent's house rules for files, licensing, packaging, changelog, and what belongs in the repo. LOAD THIS when creating a new source file, editing packaging (pyproject), writing changelog entries, or deciding whether something (esp. marketing) belongs in the repo at all. Prevents the common mistakes that get caught in review.

ProbeAgent — repo conventions

When NOT to use: for commit/test/release mechanics use [[probeagent-build-test-and-release]].

License header on every source file

Every .py (and shell tool) starts with:

# Copyright 2025 Suma Movva
# SPDX-License-Identifier: Apache-2.0

The project is Apache 2.0 (LICENSE, NOTICE). Third-party credits go in ATTRIBUTION.md.

Keep marketing OUT of the repo

The repo stays product-focused. LinkedIn posts, launch copy, positioning decks, and generated marketing reports do not get committed — they live in the scratchpad. Demo tooling under tools/ (functional scripts, runbooks) is fine; marketing narrative is not. This is a standing decision — do not "helpfully" add a launch post or a bakeoff report to the repo.

Packaging (setuptools)

Source lives under src/; packages found via [tool.setuptools.packages.find] where=["src"].
Package data must be declared or it won't ship: [tool.setuptools.package-data] probeagent = ["web/*.html", "profiles/*.yaml"]. (A missing declaration shipped a broken wheel once — profiles weren't packaged, so attack --profile failed on a clean install.)
tools/ and tests/ are not packaged. Runtime deps in [project.dependencies]; everything else in extras: dev, game, pyrit, demo.
Console entry point: probeagent = "probeagent.cli:app".

CHANGELOG

CHANGELOG.md follows Keep a Changelog + SemVer, newest version on top: ## [X.Y.Z] - YYYY-MM-DD then ### Added / ### Fixed bullets. Every release commit updates it alongside the two version stamps (see [[probeagent-build-test-and-release]]).

Commits & attribution

No AI-attribution/Co-Authored-By trailers. Commit subjects are conventional-ish (docs:, test:, Release X.Y.Z: …). Marketing decisions and cross-session facts live in the user's memory, not the repo.

Provenance & maintenance

Written 2026-07-12. Re-verify packaging data: grep -A2 'package-data' pyproject.toml and unzip -l dist/*.whl | grep -E 'profiles/|web/'.
Re-verify a header sample: head -2 src/probeagent/cli.py.
Related: [[probeagent-build-test-and-release]], [[probeagent-attacks-and-registry]].

More from this repository

same repository

probeagent-attacks-and-registry

sumamovva/probeagent

Understand and modify ProbeAgent's attack catalog. LOAD THIS when adding, removing, or editing an attack category or its strategies, when touching src/probeagent/attacks/, when the "N attack categories / M strategies" doc test fails, or when reasoning about profiles (quick/standard/thorough). Encodes the auto-discovery registration, the BaseAttack grading knobs, and the critical 12-vs-13 category count invariant that blocks releases.

2026-07-1318

probeagent-build-test-and-release

sumamovva/probeagent

Run the tests, lint, commit, and cut a release for ProbeAgent (the probeagent-ai package). LOAD THIS before running pytest/ruff, before any `git commit`, before bumping the version, or before publishing to PyPI. Encodes the non-obvious gotchas: the pre-commit hook hangs so commits need --no-verify, commits must carry NO AI-attribution trailer, the version lives in three files, and PyPI publishing fires off a GitHub Release and is irreversible.

2026-07-1318

probeagent-filesystem-wedge

sumamovva/probeagent

Recover this repo's working copy when files read as empty/corrupt or reads hang. LOAD THIS the moment you see any of: a file that `ls`/`stat` shows as N bytes but reads as empty; md5 == d41d8cd98f00b204e9800998ecf8427e on a non-empty file; "short read: Undefined error: 0" from git/grep; ImportError "No module named 'probeagent'" even though tests pass; pytest failing on a symbol that exists in source; a Read/cat/open that hangs forever. This machine's filesystem intermittently wedges — inode metadata stays intact while data blocks go empty or unreadable. This is the single most destructive trap in this project; a model that doesn't recognize it will "fix" phantom bugs for hours.

2026-07-1318

probeagent-model-bakeoff

sumamovva/probeagent

Run the "same agent, different backing models" resistance comparison and build the leaderboard. LOAD THIS when asked to compare models, stress-test an agent across models, produce the bakeoff report, or work with tools/run_bakeoff.sh, tools/model_bakeoff.py, tools/leaky_agent.py, or the --model flag. Encodes the OpenRouter setup, the secret-key hygiene, the wedged-fs invocation, and cost control.

2026-07-1318

probeagent-targets-and-test-isolation

sumamovva/probeagent

Work with ProbeAgent's target adapters (http, openclaw, mock, mcp) and write/fix its tests. LOAD THIS when touching src/probeagent/targets/, adding target-facing tests, mocking HTTP with respx, testing the async MCP path, or debugging a test that passes alone but fails in the full suite. Encodes the mock schemes, the respx pattern, and the SeedCorpusAttack.STRATEGIES global-mutation trap that silently breaks unrelated tests.

2026-07-1318

probeagent-verdicts-and-json-contract

sumamovva/probeagent

Reason about ProbeAgent's grading (Compromised/Resisted/Blocked) and its JSON report shape. LOAD THIS when interpreting scan results, changing the scorer/reporter, writing anything user-facing about verdicts, consuming the JSON programmatically, or touching docs/demo copy. Encodes the three-verdict model, the retired-vocabulary guardrail, the exact JSON schema, and the --output json vs -f gotcha.

2026-07-1318

name	probeagent-repo-conventions
description	Follow ProbeAgent's house rules for files, licensing, packaging, changelog, and what belongs in the repo. LOAD THIS when creating a new source file, editing packaging (pyproject), writing changelog entries, or deciding whether something (esp. marketing) belongs in the repo at all. Prevents the common mistakes that get caught in review.

ProbeAgent — repo conventions

When NOT to use: for commit/test/release mechanics use [[probeagent-build-test-and-release]].

License header on every source file

Every .py (and shell tool) starts with:

# Copyright 2025 Suma Movva
# SPDX-License-Identifier: Apache-2.0

The project is Apache 2.0 (LICENSE, NOTICE). Third-party credits go in ATTRIBUTION.md.

Keep marketing OUT of the repo

Packaging (setuptools)

Source lives under src/; packages found via [tool.setuptools.packages.find] where=["src"].
Package data must be declared or it won't ship: [tool.setuptools.package-data] probeagent = ["web/*.html", "profiles/*.yaml"]. (A missing declaration shipped a broken wheel once — profiles weren't packaged, so attack --profile failed on a clean install.)
tools/ and tests/ are not packaged. Runtime deps in [project.dependencies]; everything else in extras: dev, game, pyrit, demo.
Console entry point: probeagent = "probeagent.cli:app".

CHANGELOG

Commits & attribution

Provenance & maintenance

Written 2026-07-12. Re-verify packaging data: grep -A2 'package-data' pyproject.toml and unzip -l dist/*.whl | grep -E 'profiles/|web/'.
Re-verify a header sample: head -2 src/probeagent/cli.py.
Related: [[probeagent-build-test-and-release]], [[probeagent-attacks-and-registry]].