benchmark-first

星标1

分支0

更新时间2026年4月17日 16:32

Benchmark converted code against the frozen upstream implementation before making performance claims.

安装

用 Codex 或 Claude 帮你安装复制这段 Prompt，粘贴到 Codex、Claude 或其他助手里，让它检查 Skill 页面并帮你完成安装。

在 Manus 中运行

来源

strmt7

strmt7/ome-zarr-C

打开 GitHub 仓库查看创作者相关仓库

下载

在 Manus 中运行

Benchmark First

Use this skill after parity has been demonstrated for a converted surface.

Rules

Compare the upstream implementation and the converted implementation on the same inputs and same machine class.
Verify parity on the exact benchmark input before timing it.
Prefer representative real data. If real data is unavailable, document the synthetic fallback clearly.
Use the narrowest suite, group, and match filters that isolate the edited hot path before widening to larger reports.
Run repeated measurements and report medians or geometric means, not one-off wall-clock numbers.
Report time terms first: Python time, native C++ time, time saved per operation, and native C++ time reduction. If a ratio is included, label it as native C++ speedup over Python (python_time / native_cpp_time).
Report version and environment details with the results.
If the benchmark points to boundary overhead instead of native arithmetic, load cpp-performance-optimization before changing code.

同仓库更多 Skills

同仓库

browser-fallback

strmt7/ome-zarr-C

Use a deterministic browser workflow only when direct fetch or extraction is insufficient for a public-web task.

2026-04-171

verification-loop

strmt7/ome-zarr-C

Run the smallest correct verification lane and report it precisely.

2026-04-171

compliance-and-rate-limit

strmt7/ome-zarr-C

Keep public-web research compliant, bounded, and efficient through rule checks, caching, and backoff instead of evasive scraping.

2026-04-171

cpp-performance-optimization

strmt7/ome-zarr-C

Optimize a parity-proven ome-zarr native C++ surface for measurable speedups by improving data layout, copies, cache behavior, and boundary design without changing behavior.

2026-04-171

cpp-parity-porting

strmt7/ome-zarr-C

Port one upstream ome-zarr-py surface to standalone native C++ without touching the frozen snapshot.

2026-04-161

pybind11-runtime-parity

strmt7/ome-zarr-C

Legacy reference only. Current main does not use pybind11 ports; use this only to understand old debt before removing it.

2026-04-161

name	benchmark-first
description	Benchmark converted code against the frozen upstream implementation before making performance claims.
origin	repo-local

Benchmark First

Use this skill after parity has been demonstrated for a converted surface.

Rules

Compare the upstream implementation and the converted implementation on the same inputs and same machine class.
Verify parity on the exact benchmark input before timing it.
Prefer representative real data. If real data is unavailable, document the synthetic fallback clearly.
Use the narrowest suite, group, and match filters that isolate the edited hot path before widening to larger reports.
Run repeated measurements and report medians or geometric means, not one-off wall-clock numbers.
Report time terms first: Python time, native C++ time, time saved per operation, and native C++ time reduction. If a ratio is included, label it as native C++ speedup over Python (python_time / native_cpp_time).
Report version and environment details with the results.
If the benchmark points to boundary overhead instead of native arithmetic, load cpp-performance-optimization before changing code.