Skip to main content
skillsmp

Menu

memmesh-test-integration

Verify a MemMesh integration produced by memmesh-integrate. Runs in the same workspace: executes the repo's native test suite, then exercises a real end-to-end smoke flow (observe → search → optionally predict) against the user's live key or local engine, and produces a pass/fail scorecard. TRIGGER when: the user has just run memmesh-integrate and says "verify", "test the integration", or when a `.memmesh-integration/` directory exists and tests have not been run yet. DO NOT TRIGGER for: first-time wiring (use memmesh-integrate) or vendor migration (use memmesh-migrate).

Jump to installReview files

Source facts

Repository
ThinkfleetAI/memmesh
Last source activity
July 13, 2026 at 02:13
Detected SKILL.md language
English
Stars
420
Forks
439

Install options

The review-first prompt is selected by default. You can switch to a direct command or download a local copy.

Review the source files

Read SKILL.md and any companion files shown by SkillsMP before deciding whether to install.

Showing SKILL.md

SKILL.md
Source instructions · Read-only preview
name
memmesh-test-integration
description
Verify a MemMesh integration produced by memmesh-integrate. Runs in the same workspace: executes the repo's native test suite, then exercises a real end-to-end smoke flow (observe → search → optionally predict) against the user's live key or local engine, and produces a pass/fail scorecard. TRIGGER when: the user has just run memmesh-integrate and says "verify", "test the integration", or when a `.memmesh-integration/` directory exists and tests have not been run yet. DO NOT TRIGGER for: first-time wiring (use memmesh-integrate) or vendor migration (use memmesh-migrate).
license
Apache-2.0
metadata
{"author":"thinkfleet","category":"ai-memory","tags":"memory, integration, testing, verification"}
# memmesh-test-integration Prove the integration actually works — not just that it typechecks. ## Preconditions - A `.memmesh-integration/` directory exists (else tell the user to run `memmesh-integrate` first). - Credentials: Hosted ⇒ `MEMMESH_API_KEY` set; Local ⇒ `memmesh doctor` passes. ## Steps 1. **Static gate.** Typecheck / lint / build. Any failure ⇒ stop, report. 2. **Native suite.** Run the repo's own tests **twice** — once with `MEMMESH_ENABLED` unset (must be byte-for-byte the original behavior) and once set. Both must pass. 3. **Real E2E smoke** against the live engine (not a mock): - `observe` a known fact for a throwaway `userId` (e.g. `smoke-<runid>`). - `search` for it; assert the fact comes back. - `buildContext` for the subject; assert the fact appears in the bundle. - If prediction was wired: call `predict` / `predictTarget` and assert you get *either* a calibrated probability *or* an honest abstention — both are a pass; a crash or an uncalibrated 1.0/0.0 with no evidence is a fail. - Clean up: `memory_delete` (or `compliance.hardDeleteSubject`) the throwaway subject so the smoke run leaves no residue. 4. **Scorecard.** Write `.memmesh-integration/scorecard.md`: | Check | Result | |---|---| | Typecheck / build | ✅ / ❌ | | Native tests (flag off) | ✅ / ❌ | | Native tests (flag on) | ✅ / ❌ | | E2E observe→search | ✅ / ❌ | | E2E buildContext | ✅ / ❌ | | E2E predict (calibrated OR abstained) | ✅ / ❌ / n/a | | Smoke cleanup | ✅ / ❌ | ## Definition of done Every applicable row green, throwaway data removed, and a one-paragraph verdict: ship / needs-work, with the failing checks called out.
View on GitHub
Back to searchBack to installation