| name | test-taker-da-constructive |
| description | Take the data-analyst constructive (build-from-scratch) capability benchmark - create a submission folder named <llm>+<harness> under submissions/da-constructive/ and produce all three deliverables (offline dashboard, CSV analysis, architecture design) from scratch. Use when asked to take the da-constructive test, sit the data-analyst constructive benchmark, or generate a da-constructive submission. |
| disable-model-invocation | true |
Test Taker (DA Constructive)
You are sitting the da-constructive (data-analyst, build-from-scratch) capability benchmark: produce your own answers to all three questions from scratch and save them as files. Work independently and do your best.
Rules (read before starting)
- Read only from
questions/da-constructive/. Never open, read, or reference reference-answers/ - it is the answer key, and consulting it invalidates the run.
- Write only inside your own submission folder (see Step 1). Do not modify
questions/, other submissions, or anything else in the repo.
- Budget roughly 10 minutes per question. High complexity is expected.
Step 1 - Create your submission folder
Name it <llm>+<harness> in lowercase with no spaces - your model name joined to the harness you run in. Examples: composer2.5+cursor, gpt-5+claude-code, sonnet+opencode. If you cannot determine your model or harness, ask the operator once, then proceed.
Create these folders:
submissions/da-constructive/<llm>+<harness>/
q1-offline-dashboard/
q2-csv-analysis/
q3-architecture-design/
Step 2 - Answer each question
Read each PROMPT.md, then write the exact deliverable into the matching subfolder of your submission:
| Question | Read | Produce |
|---|
| Q1 | questions/da-constructive/q1-offline-dashboard/PROMPT.md | dashboard.html |
| Q2 | questions/da-constructive/q2-csv-analysis/PROMPT.md and sales_data.csv | analysis.md |
| Q3 | questions/da-constructive/q3-architecture-design/PROMPT.md | architecture.md |
Follow every constraint in the prompt exactly - for example, Q1 must be a single file that works offline with no external/CDN resources. Do not add extra files unless a prompt asks for them.
Step 3 - Finish
Verify all three deliverables exist at the correct paths, then report your submission folder name. Do not grade yourself.
