(Also known as pwc-reply-issue.) Handle unread GitHub notifications for "Verify evals on Papers with Code" issues end-to-end. Apply author feedback to the catalog database, verify changes live, reply to authors, mark handled notifications read, and summarize…
Thoroughly audit the health of every Papers With Code production CRON job shown on the admin dashboard, including scheduler execution, logs, locks, durable data freshness, backlog completeness, semantic correctness, and bounded comparisons with upstream…
Resolve one trending Hugging Face model repository, or one release-radar signal, to a canonical paper or reject it as non-novel repackaging.
Safely curate one Papers With Code paper from a remote Hugging Face Job without direct database access.
Add or update benchmark datasets/leaderboards in the paperswithcode repo database. Use this whenever the user asks to add a benchmark, add a leaderboard, set default/featured benchmarks for a task, link benchmarks to tasks, add Accuracy or other metrics for a…
Add evaluation results to the paperswithcode database from any source — Hugging Face model cards, arXiv/HF/PapersWithCode paper text, or GitHub repository READMEs — restricted to benchmarks that already exist with a task association and the exact leaderboard…
Add or update AI/ML method taxonomy rows in the paperswithcode repo database. Use this whenever the user asks to add a method, technique, architecture, attention mechanism, training method, model-family method, or source/visual metadata for a method; says…
Process the user's X (Twitter) bookmarks into Papers with Code: find every bookmarked post that announces a paper, index missing arXiv papers, add non-arXiv releases as external papers, enrich each paper (code, project page, HF artifacts, tags, thumbnail),…