allenai

This skill should be used when the user asks to "generate theories", "theorize about", "what theories explain", "form scientific theories", "literature-driven theories", "hypothesize", "form hypotheses", "generate hypotheses", "what hypotheses explain", "run…

Show the user the agent's work on a research project and save iterations on the user's behalf. Scaffold rendering and deploy infrastructure (Quarto today, GitHub Pages, dev container), show the rendered output, save iterations. Doesn't handle research…

Install or update the `asta` CLI to the version pinned by this plugin. Invoke whenever `asta` is not on PATH (e.g. `command not found` for `asta`) or when a subcommand/flag appears missing — that signals a stale install needing an update.

Interview the user about their experience with the Asta plugins and tools, write a narrative feedback report, and submit it (with optional supporting files) to the Asta team for analysis. Use when the user wants to "give feedback", "send feedback to the Asta…

Converse with the user to identify the next most productive units of work for the current project, and record them in project.md under Pending Work. Use when the user wants to plan what to work on next, or when there is no project.md yet.

Execute the approved plan in work/<slug>/README.md (status ready), write outputs into work/<slug>/data/, record what happened in the Results section, then hand off to review-work. Use when there is a ready work item.

Write a detailed, executable plan for a single unit of work, then get it approved by review-plan. Updates work/<slug>/README.md with concrete instructions and sets status to ready (or needs-input if review repeatedly rejects).

Critic skill. Given a plan in work/<slug>/README.md (status pending-review), check that the steps are concrete, the tools are appropriate, and the plan is realistic. Write a verdict and feedback back into the README.

Use when creating or reviewing Ai2 benchmark charts, leaderboard tables, HTML data visualizations, score-vs-cost visuals, scatterplots, architecture or data-flow diagrams, branching or two-path causal comparison diagrams, processing-pipeline or stage…

Use when writing, editing, or reviewing Ai2 communications (launches, newsletters, blogs, social, emails) where voice, source fidelity, approval constraints, benchmark caution, newsletter format, or brand consistency matters.

Use when adapting approved Ai2 copy for X, LinkedIn, Reddit, Discord, Bluesky, Hugging Face blogs, newsletters, launch posts, or post-release community follow-up.

Use when running a complete Ai2 comms task through the full pipeline — drafting plus parallel lector review plus optional charts and cross-posting. Triggered by "run pipeline", "full pipeline", "ai2-comms pipeline", "pipeline for [task]", or any Ai2 comms…

Use when drafting or revising Ai2 research communications, launch copy, newsletters, technical blogs, emails, captions, social posts, researcher Q&A, or Hugging Face blog copy.

Use when checking Ai2 copy for factuality, attribution, benchmark scope, model names, scores, costs, caveats, approval-sensitive claims, or source-paper fidelity.

Use when planning an Ai2 release before drafting — locating it on the Olmo/Tulu/Molmo/OlmoEarth arc, deciding demo scope, staging supplementary materials (paper, code, leaderboard, video, technical report), surfacing partner roles, identifying the primary…

Use when reviewing Ai2 drafts for framing, openings, section order, redundancy, narrative flow, reader stakes, or whether the contribution is presented clearly.

Runnable evaluation template scripts for ML tasks. Match task_type to template, adapt CONFIG, run.

Use this skill for Hugging Face Dataset Viewer API workflows that fetch subset/split metadata, paginate rows, search text, apply filters, download parquet URLs, and read size or statistics.

Create and manage datasets on Hugging Face Hub. Supports initializing repos, defining configs/system prompts, streaming row updates, and SQL-based dataset querying/transformation. Designed to work alongside HF MCP server for comprehensive dataset workflows.

Add and manage evaluation results in Hugging Face model cards. Supports extracting eval tables from README content, importing scores from Artificial Analysis API, and running custom model evaluations with vLLM/lighteval. Works with the model-index metadata…

Run a VLA model evaluation against a simulation benchmark. Use this skill whenever the user wants to evaluate, benchmark, test, or run a model on a sim environment — even if they say it casually like 'try OpenVLA on LIBERO' or 'get me CALVIN scores'. Covers…

Add a new VLA model server to the evaluation harness. Use this skill whenever the user wants to integrate, create, or add a new model — e.g. 'add OpenVLA server', 'integrate RT-2', 'hook up my model', 'write a model server'. Also use when they ask how model…

Add a new simulation benchmark to the VLA evaluation harness. Use this skill whenever the user wants to integrate, create, or add a new benchmark or simulation environment — e.g. 'add ManiSkill3', 'integrate OmniGibson', 'hook up a new sim'. Also use when…

Update the body of a GitHub pull request. Use when the user asks to update, edit, or modify a PR description/body.

Monitor Beaker experiments until completion. Use when the user asks to monitor, check, or track a Beaker experiment.

Local document metadata index for scientific documents

Local document metadata index for scientific documents

This skill should be used when the user asks to "create a verification script", "write a test training run", "make a quick training job", "verify my change with a short run", "launch a smoke test", or wants a small Beaker job to validate that a feature works…

This skill should be used when the user asks to "start a task", "run a verifier", "verify my solution", "work on a Harbor task", "pier start", "pier verify", or needs to interactively work on Harbor benchmark tasks.