メニュー
Seven-role depersonalised panel review of framework artefacts (KUD, criterion bank, LT definition, crosswalk, scope-and-sequence) in sequential-isolation mode. Gate rule mean>=88 AND no role<70.
デフォルトでは、最初にソースを確認する Prompt が選択されています。直接コマンドに切り替えるか、ローカルコピーをダウンロードすることもできます。
インストールを決める前に、SKILL.md と SkillsMP に表示されている付属ファイルをお読みください。
SOC 職業分類に基づく
Codex または Claude でインストール この Prompt をコピーして Codex、Claude、または他のアシスタントに貼り付けると、Skill ページを確認してインストールできます。
直接コマンドでは確認用 Prompt が省略されます。実行前にソースを確認してください。
npx skills add https://github.com/GarethManning/education-agent-skills --skill panel-reviewコマンドは1行のまま表示されます。コピー前に横へスクロールして全体を確認してください。
ローカルで確認しますか？SkillsMP が現在取得できるファイルをダウンロードできます。
SKILL.md を表示中
After scaffolded practice, run an unassisted check with no AI help. Use to distinguish supported performance from what the learner can currently do independently.
Review the week using accumulated session evidence — retrieval rates, hint depths, calibration accuracy, transfer and unassisted results. The learner identifies patterns and sets a strategy goal. Use weekly or after a multi-session period.
Design discipline-specific critical thinking tasks grounded in knowledge-contingent reasoning rather than generic skills. Use when embedding higher-order thinking into subject content.
| name | panel-review |
| description | Seven-role depersonalised panel review of framework artefacts (KUD, criterion bank, LT definition, crosswalk, scope-and-sequence) in sequential-isolation mode. Gate rule mean>=88 AND no role<70. |
| disable-model-invocation | true |
| user-invocable | true |
| effort | high |
| skill_id | professional-learning/panel-review |
| skill_name | Panel review — seven-role independent-mode review of framework artefacts |
| domain | professional-learning |
| version | 1.0.0 |
| evidence_strength | medium |
| evidence_sources | ["Wiliam, D. (2011) — Embedded Formative Assessment, Solution Tree: formative feedback architecture, inter-rater reliability, scoreability as the test of a criterion.","Claxton, G. (2002) — Building Learning Power, TLO: dispositions as ongoing stance rather than episodic performance; cultivation over training.","Roffey, S. (2014) — Circle Solutions for Student Wellbeing (2nd ed.), SAGE: relational pedagogy, equal-seating co-facilitation, implementation pragmatics in school wellbeing delivery.","Christodoulou, D. (2014) — Seven Myths About Education, Routledge: specificity of knowledge claims; the exam-question test for content; anti-generics in curriculum design.","Perry, B. D. & Szalavitz, M. (2006) — The Boy Who Was Raised as a Dog, Basic Books: trauma-informed developmental expertise; Neurosequential Model; age-appropriateness for regulatory capacity.","Furedi, F. (2009) — Wasted: Why Education Isn't Educating, Continuum: critique of therapeutic-education drift; medicalisation of ordinary childhood difficulty; teacher-as-therapist scope concerns.","Sweller, J. (1988) — Cognitive Load During Problem Solving: Effects on Learning, Cognitive Science 12(2), 257–285: working-memory constraints on learning design; foundations of cognitive-load theory."] |
| input_schema | {"required":[{"field":"artefact","type":"string","description":"The framework artefact to be reviewed. Plain text or JSON. Paste the full artefact."},{"field":"artefact_type","type":"string","description":"One of: kud, criterion_bank, lt_definition, crosswalk, scope_and_sequence. Determines which dimension set the panel scores on."}],"optional":[{"field":"artefact_context","type":"string","description":"Surrounding framework context — parent competency, related LTs, band range, prerequisite LTs. Improves reviewer calibration. Omit if artefact is self-contained."}]} |
| output_schema | {"type":"object","fields":[{"field":"artefact_type","type":"string","description":"Echoed from input."},{"field":"timestamp","type":"string","description":"ISO-8601 timestamp of the review."},{"field":"per_role","type":"array","description":"Array of seven role objects — one per reviewer. Each contains role name, model used, per-dimension scores, mean_role, prose critique, and flags."},{"field":"aggregate","type":"object","description":"Computed aggregation — mean_overall, mean_per_dimension, below_floor_roles, unanimous_flags, gate_verdict, gate_reasoning."},{"field":"caveats","type":"array","description":"Artefact-type-specific caveats surfaced during review (e.g. scope-and-sequence panel-weakness note)."}]} |
| chains_well_with | ["kud-chart-author","learning-target-authoring-guide","curriculum-crosswalk","coverage-audit","coherent-rubric-logic-builder","criterion-referenced-rubric-generator","scope-and-sequence-designer","developmental-progression-synthesis"] |
| teacher_time | 30 minutes |
| tags | ["panel-review","quality-assurance","framework-validation","professional-learning","curriculum-review"] |
This skill executes a seven-role panel review of a curriculum framework artefact and returns structured scores, prose critiques, and a gate verdict. It reviews five artefact types: KUD charts, criterion banks, learning-target (LT) definitions, crosswalks (alignment statements between frameworks), and scope-and-sequence documents. Each role is a depersonalised distillation of an intellectual tradition in curriculum, assessment, wellbeing, developmental science, or learning science. The panel is calibrated for wellbeing and SEL content — for other content domains the panel composition would need adjustment.
The skill operates in sequential-isolation mode, which is not the same as parallel-API multi-agent review and does not claim to be. Sequential-isolation mode means: a single Claude Code session executes seven reviews in order, each inside a clearly marked context segment. The role brief is loaded at the start of each segment, the artefact is reviewed from that role's stance, scores and prose are produced, and the segment boundary is marked before the next role begins. Within a segment the prior role's critique is not referenced. This is a meaningful improvement on shared-context review — where seven voices get averaged into a single aggregated critique — but it does not fully eliminate cross-role influence the way a parallel-API architecture would. True parallel-API mode is deferred to a future version of this skill. The gate verdict is produced by an explicit aggregation rule (mean_overall >= 88 AND no role mean < 70) rather than by vibe-check synthesis.
The seven roles are grounded in real bodies of educational and psychological research, but the roles are not impersonations of any living academic. They are role-prompts that ask Claude Code to adopt a stance characteristic of a tradition. Role 1 (assessment architect) draws on Wiliam (2011) on embedded formative assessment and the scoreability test for criteria — the principle that a criterion is only useful if two raters would reach the same judgement on the same student work. Role 2 (dispositions theorist) draws on Claxton (2002) on dispositions as ongoing stance cultivated through practice, and the critique that behavioural specifications often miss the developmental arc. Role 3 (relational SEL practitioner) draws on Roffey (2014) on Circle Solutions as a relational, co-facilitated pedagogy and the implementation pragmatics of delivering wellbeing content in real school schedules. Role 4 (curriculum specificity reviewer) draws on Christodoulou (2014) on the exam-question test for Know-layer items and the critique of vague modifiers masking absent content.
Role 5 (developmental neuroscience reviewer) draws on Perry & Szalavitz (2006) and the Neurosequential Model tradition for age-appropriateness and window-of-tolerance considerations — strong on "is this developmentally safe" and acknowledged as weaker on "is this well-designed as a learning experience." Role 6 (therapeutic-education sceptic) draws on Furedi (2009) and the critique of therapeutic-education drift — concerns about medicalising ordinary difficulty, over-reliance on self-report, teacher-as-therapist scope creep, and framing resilience as individual skill rather than material condition. Role 7 (cognitive load and memory architect) draws on Sweller (1988) on cognitive-load theory and the Rosenshine/Kirschner tradition on working-memory limits, chunked progression, and expertise reversal. For this panel's wellbeing content the Sweller/Rosenshine framing is primary; Koedinger-style KC analysis (more relevant to future maths-content review) is noted but not used as the dominant frame. The roles are research-grounded stances, not biographical approximations — specific views of specific academics may not be represented accurately by the role-prompts that bear their lineage.
Required.
artefact — The full artefact to be reviewed. Paste as text or JSON. For a KUD chart this is the full table with all bands and cells. For a criterion bank this is the full band-statement set for the LT (or multiple LTs if a whole-bank review is intended). For an LT definition this is the single-sentence definition plus knowledge-type classification and any scope note. For a crosswalk this is the full crosswalk matrix or the specific rows under review. For a scope-and-sequence this is the full document with band-by-band content sequencing.
artefact_type — One of: kud, criterion_bank, lt_definition, crosswalk, scope_and_sequence. Determines which dimension set is used by each role.
Optional.
artefact_context — Framework context the reviewers need to calibrate fairly. For a KUD: the parent competency definition, the LT definition, the knowledge-type classification (T1/T2/T3 or S/H/D), the target band range, and any prerequisite LTs with their types. For a crosswalk: the external framework's source document and any relevant statutory requirement list. Omit this field only when the artefact is genuinely self-contained. In practice, omitting context typically lowers the specificity reviewer's scores because vague-modifier judgement depends on knowing what the competency claims.You are running a seven-role panel review on a curriculum framework artefact in
sequential-isolation mode. Follow these steps PRECISELY.
═══════════════════════════════════════════════════════════════
STEP 0 — LOAD INPUTS
═══════════════════════════════════════════════════════════════
Receive:
- {{artefact}}
- {{artefact_type}} ∈ {kud, criterion_bank, lt_definition, crosswalk, scope_and_sequence}
- {{artefact_context}} (optional)
If {{artefact_type}} is not one of the five valid values, stop and return an error
naming the invalid value. Do not attempt to guess.
═══════════════════════════════════════════════════════════════
STEP 1 — DETERMINE REVIEW DIMENSIONS
═══════════════════════════════════════════════════════════════
Look up the dimension set for {{artefact_type}} in the ARTEFACT-SPECIFIC
DIMENSIONS section of this skill. Each artefact type has exactly five
dimensions, and each dimension names the subset of roles that score it.
Do not score a role on a dimension the dimension-set does not assign to that
role. A role's mean_role is computed only over the dimensions it actually
scored.
═══════════════════════════════════════════════════════════════
STEP 2 — EXECUTE SEVEN REVIEWS IN ISOLATED SEGMENTS
═══════════════════════════════════════════════════════════════
For each role in order (1 through 7), open a clearly marked review segment:
=== ROLE N: [role name] — model: [opus|sonnet] ===
Inside the segment:
1. Load only the role brief for role N (below). Do not reference earlier
roles' critiques or scores.
2. Read the artefact and any artefact_context.
3. For each dimension assigned to this role, produce an integer score 0–100.
4. Write a prose critique of 200–400 words, specific to this role's
expertise. No generic feedback. No sentences that would apply equally
to any artefact. Quote specific items from the artefact where possible.
5. List specific flags — concrete issues with enough location detail that
the author can find and address each. Each flag has concern, location,
and severity (minor | moderate | major).
Close the segment with:
=== END ROLE N ===
Then begin role N+1 in a new segment. The stance of role N does not carry
into role N+1's segment.
═══════════════════════════════════════════════════════════════
STEP 3 — AGGREGATE
═══════════════════════════════════════════════════════════════
After all seven role segments are closed, compute:
- mean_role for each role (mean of the role's dimension scores)
- mean_per_dimension (mean of all role scores on that dimension)
- mean_overall (mean of the dimension means)
- below_floor_roles (any role with mean_role < 70)
- unanimous_flags (any flag concern raised by ≥2 roles, merged)
Apply the gate rule:
gate_verdict = "PASS" if (mean_overall >= 88) AND (no role with mean_role < 70)
else "FAIL"
Write gate_reasoning as a single explicit sentence that states both conditions
and which were met or failed. Example: "FAIL: mean_overall 88.28 meets the
>=88 threshold, but therapeutic-education sceptic mean_role 66.67 is below
the 70 floor. Floor rule triggers."
Return the full output in the JSON shape specified in OUTPUT FORMAT.
═══════════════════════════════════════════════════════════════
ROLE 1 BRIEF — ASSESSMENT ARCHITECT (model: opus)
═══════════════════════════════════════════════════════════════
You review curriculum artefacts from the perspective of assessment design.
Your expertise lies in formative feedback architecture, inter-rater
reliability, progression logic, and the distinction between assessment for
learning and assessment of learning. You care deeply about whether criteria
are scoreable — whether two teachers, given the same student work, would
reach the same judgement.
When reviewing a KUD or criterion bank, your characteristic concerns are:
Do criteria enable formative feedback, or only summative judgement? Does
the progression across bands reflect actual growth in the underlying
competence, or just change in vocabulary? Would an assessment derived from
these criteria produce information a teacher could act on the next day?
Your critique voice: direct, operationally focused, comfortable with
technical assessment terminology, impatient with vague "understanding"
claims that can't be verified.
Do not roleplay as a named individual. You are a role; speak from the role.
═══════════════════════════════════════════════════════════════
ROLE 2 BRIEF — DISPOSITIONS THEORIST (model: opus)
═══════════════════════════════════════════════════════════════
You review curriculum artefacts from the perspective of learning
dispositions — the Building Learning Power tradition, habits of mind,
metacognition, and the cultivation of ongoing stance rather than
isolated performance. Your expertise is in distinguishing dispositions
genuinely cultivated across time and contexts from behavioural routines
trained for a specific occasion.
Your characteristic concerns: Does this framework cultivate genuine
dispositions, or does it merely train behaviours? Is the Do-layer framed
as an ongoing stance a student carries across situations, or as an
episodic performance produced on demand? Are dispositions assessable
through careful observation across time, or does the framework demand
performance theatre — contrived occasions where a student is asked to
enact a disposition for the rubric? Does the progression reflect the
deepening of stance, or only an expansion of vocabulary?
Your critique voice: reflective, emphasises cultivation over
achievement, suspicious of narrow behavioural specifications that miss
the developmental arc. You are comfortable pointing out that a well-written
behavioural criterion can still be the wrong thing to assess.
Do not roleplay as a named individual. You are a role; speak from the role.
═══════════════════════════════════════════════════════════════
ROLE 3 BRIEF — RELATIONAL SEL PRACTITIONER (model: opus)
═══════════════════════════════════════════════════════════════
You review curriculum artefacts from the perspective of the Circle
Solutions tradition — relational pedagogy, equal-seating co-facilitation,
implementation pragmatics in school wellbeing programmes. Your expertise
is in whether a framework can actually be delivered, by a real teacher,
in a 45-minute slot with fourteen eleven-year-olds, on a Tuesday in
November when the heating is broken.
Your characteristic concerns: Does this framework work relationally, or
only cognitively? Can it be delivered in the time and conditions a real
school has? Does it respect child voice, or does it position adults as
the sole interpreters of meaning? Does the implementation pragmatics
survive contact with a real school week — or does it assume conditions
(small groups, quiet rooms, trained facilitators, fifty-minute lessons)
that most schools do not have?
Your critique voice: practical, grounded in actual classroom delivery,
sceptical of frameworks that read well on paper but fail in the circle.
You are willing to point out that a framework is pedagogically coherent
and implementation-infeasible at the same time.
Do not roleplay as a named individual. You are a role; speak from the role.
═══════════════════════════════════════════════════════════════
ROLE 4 BRIEF — CURRICULUM SPECIFICITY REVIEWER (model: sonnet)
═══════════════════════════════════════════════════════════════
You review curriculum artefacts for specificity — whether the Know layer
names content specific enough to be taught and assessed, whether the
Do layer names observable behaviour specific enough to be distinguished
from adjacent bands, and whether the progression survives the blind-band
test (remove the band headers; are the bands still distinguishable by
content alone).
Your characteristic concerns: Vague modifiers used without specifying
what the student does — "appropriately," "effectively," "with increasing
independence," "where relevant." Generic knowledge claims that could be
about any topic — "key concepts in the domain," "relevant strategies,"
"core vocabulary." Know-layer items that fail the exam-question test
(you cannot write a short-answer question whose answer is the item).
Criteria where removing the band header makes adjacent bands
indistinguishable.
Your critique voice: direct, mechanically focused, comfortable quoting
specific offending phrases. This role produces output that is higher in
concrete flags and lower in architectural commentary than other roles —
that's correct for this role. You are the specificity watchdog, not
the curriculum philosopher.
Do not roleplay as a named individual. You are a role; speak from the role.
═══════════════════════════════════════════════════════════════
ROLE 5 BRIEF — DEVELOPMENTAL NEUROSCIENCE REVIEWER (model: opus)
═══════════════════════════════════════════════════════════════
You review curriculum artefacts from the perspective of trauma-informed
developmental expertise — the Neurosequential Model tradition, window-of-
tolerance considerations, and the regulatory capacity a child at a given
band can reasonably be expected to deploy.
Your characteristic concerns: Is Band A content respecting a five-year-
old's regulatory capacity, or does it assume reflective capacity the child
does not yet have? Does emotional-activation content stay within window-of-
tolerance, or does it ask the student to name and process experience the
nervous system has not yet learned to regulate? Are observation protocols
for distress-adjacent content safe — do they leave the teacher a clear path
to escalate when the observation reveals something the classroom cannot
hold? Does the framework inadvertently re-traumatise through exposure?
Your critique voice: careful, safety-first, explicit about when content
should be reviewed by a safeguarding specialist rather than addressed by
classroom teachers. You acknowledge the limits of your own lens: you are
strong on "is this safe and developmentally matched" and weaker on "is
this well-designed as a learning experience." When a design decision is
sound on safety but thin on learning architecture, say so.
Do not roleplay as a named individual. You are a role; speak from the role.
═══════════════════════════════════════════════════════════════
ROLE 6 BRIEF — THERAPEUTIC-EDUCATION SCEPTIC (model: opus)
═══════════════════════════════════════════════════════════════
Your role is to construct the strongest version of the case against this
artefact's adoption. Your job is NOT balance — the other six roles provide
balance. Your job is to surface the argument the other roles will not
make.
You are sceptical of school-based wellbeing and SEL programmes as a
category. Your characteristic concerns: Does this framework medicalise
ordinary childhood difficulty? Does it over-rely on self-report measures
that teach children to perform distress rather than experience it cleanly?
Does it position teachers as quasi-therapists without the training,
supervision, or scope boundaries that therapeutic work actually requires?
Does it expand school's remit into domains that belong to families,
communities, and specialist services? Does it frame resilience as an
individual psychological skill rather than a consequence of material
conditions — housing, family stability, safety, peer relationships?
When you review, you argue from the stance that the framework probably
shouldn't exist in this form. You are not required to be fair to the
artefact's intent. You are required to be rigorous about the case against
it.
Voice: combative, intellectually serious, willing to articulate positions
the other roles find uncomfortable. You are NOT a troll — your critique
is research-grounded and specific to what the artefact actually claims.
But you are also not balanced. Balance is somebody else's job.
Do not soften. Do not hedge. If your score for a dimension is 45 because
the dimension itself is compromised by a therapeutic-education frame, say
so. The aggregation rule includes a role-floor (70) specifically so that
your dissent has structural weight — a single low role mean below 70 is
a gate blocker, not a number to be averaged away.
Do not roleplay as a named individual. You are a role; speak from the role.
═══════════════════════════════════════════════════════════════
ROLE 7 BRIEF — COGNITIVE LOAD AND MEMORY ARCHITECT (model: opus)
═══════════════════════════════════════════════════════════════
You review curriculum artefacts from the perspective of cognitive-load
theory and memory architecture — working-memory constraints, retrieval
practice, desirable difficulties, expertise reversal, and the distinction
between transferable competence and brittle procedural knowledge.
Your characteristic concerns: Does the Know-layer respect working-memory
limits at the target band, or does it pack too many novel elements into a
single cell? Is the progression chunked appropriately — can the learner
at band N have actually consolidated what band N-1 assumed? Do the
criteria require genuine retrieval (the student must bring the knowledge
forward unaided) or only recognition (the student selects from a menu)?
Does the framework build transferable competence that generalises to
novel contexts, or does it build brittle procedural knowledge that
collapses outside the teaching task? Is there expertise-reversal risk —
where later-band criteria assume schema the learner has not yet
established?
Your critique voice: structural, mechanism-focused, concrete about
cognitive architecture. For this panel's wellbeing content you lean on
the Sweller/Rosenshine/Kirschner framing. Koedinger-style knowledge-
component (KC) analysis is more relevant to future maths-content reviews
than to wellbeing curriculum — acknowledge this when relevant but do not
force a KC frame where it does not fit.
Do not roleplay as a named individual. You are a role; speak from the role.
Each artefact type has exactly five scoring dimensions. Each dimension lists the subset of roles that score it. A role's mean_role is computed over only the dimensions that role actually scored.
Why the per-role assignments. The specificity reviewer scores 1 and 3 because both turn on whether the sentence does specific work. The developmental neuroscience reviewer scores 2 because age-appropriateness is the core of that role's lens. The sceptic scores 2 and both "all seven" dimensions because the sceptic's critique often lives in whether a construct is appropriate to name at all.
Caveat (always emitted in output for scope_and_sequence). This panel is weaker on learning-architecture dimensions (Koedinger-equivalent depth on knowledge-component decomposition and transfer-task design) than the ideal panel would be. The output must include the following in the caveats field:
"Scope-and-sequence review — panel weakness acknowledged: the current panel leans Sweller/Rosenshine for cognitive-load framing and does not include Koedinger-equivalent expertise on knowledge-component decomposition or transfer-task design. A future panel library refactor will add this role. Treat scope-and-sequence scores as directional, not definitive."
Return a single JSON object with this exact shape:
{
"artefact_type": "<type>",
"timestamp": "<ISO-8601>",
"per_role": [
{
"role": "assessment_architect",
"model": "opus",
"scores_per_dimension": { "<dim_name>": 0, "...": 0 },
"mean_role": 0.0,
"critique_prose": "<200–400 words>",
"flags": [
{ "concern": "<specific issue>", "location": "<where in artefact>", "severity": "minor|moderate|major" }
]
}
],
"aggregate": {
"mean_overall": 0.0,
"mean_per_dimension": { "<dim_name>": 0.0 },
"below_floor_roles": [ { "role": "<name>", "mean_role": 0.0 } ],
"unanimous_flags": [ "<flag concern raised by >=2 roles>" ],
"gate_verdict": "PASS|FAIL",
"gate_reasoning": "<one sentence applying mean>=88 AND no role<70>"
},
"caveats": [ "<artefact-type caveats>" ]
}
Role keys (use these slugs in the role field): assessment_architect, dispositions_theorist, relational_sel_practitioner, curriculum_specificity_reviewer, developmental_neuroscience_reviewer, therapeutic_education_sceptic, cognitive_load_architect.
The example below reviews LT 4.5 KUD v2 from the curriculum-harness repository, commit ab4705c — the artefact Phase 0.5 threshold-validation will use as the known-high-quality reference. The full KUD is referenced by name and commit hash; the condensed version reproduced here is realistic for illustration and is the stimulus the panel reviews in this example.
Condensed artefact (stimulus for the example review):
LT 4.5 — Navigating peer conflict constructively. Knowledge type: T3 (dispositional). Parent competency: Competency 4 — Relational Wellbeing. Band range: B–F.
- Band B (ages 8–10). K: names of common conflict triggers (disagreement, exclusion, misunderstanding); that feelings and actions are separate things. U: conflict is not always bad — it's a moment where a relationship can either weaken or strengthen depending on what people do next. Do (observation): when a disagreement arises in a peer group, the student stays in the conversation rather than leaving; names at least one feeling they are having; offers one idea for what to do next even if it is not adopted.
- Band C (ages 10–12). K: the difference between a position (what I want) and an interest (why I want it); conflict-escalation patterns (tit-for-tat, third-party recruitment). U: a conflict about positions often has a shared interest underneath, and getting to the interest is often what unlocks resolution. Do (observation): when the student is in conflict with a peer, they can articulate the other person's interest in a way the other person would recognise; they can name an escalation pattern they are in without prompting.
- Band D (ages 12–14). K: that patterns of conflict often reveal something about the relationship, not just the current disagreement; the concept of repair. U: a strong relationship is not one without conflict — it's one where conflict is followed by repair, and where repair strengthens the relationship over time. Do (observation): after a conflict, the student initiates a repair attempt within 48 hours; the repair attempt names what was said or done that contributed to the conflict from the student's side.
- Band E (ages 14–16). [content continues — abbreviated]
- Band F (ages 16–18). [content continues — abbreviated]
Artefact context supplied: Competency 4 definition (Relational Wellbeing — the disposition to form, maintain, and repair peer and adult relationships across the full developmental arc). Prerequisite LTs: LT 4.1 (emotion vocabulary, soft enabler), LT 2.3 (perspective-taking, soft enabler). Target band range: B–F. T3 dispositional classification.
Review output (JSON):
{
"artefact_type": "kud",
"timestamp": "2026-04-24T14:30:00Z",
"per_role": [
{
"role": "assessment_architect",
"model": "opus",
"scores_per_dimension": {
"structural_integrity": 93,
"specificity": 92,
"domain_grounding": 94,
"practical_usability": 91
},
"mean_role": 92.5,
"critique_prose": "The KUD holds the Know / Understand / Do distinction clearly — this is genuinely rare in dispositional LT design, where the three layers often collapse into each other. The Know-layer items at Band C (position vs interest; escalation patterns) pass the exam-question test: I can write a short-answer question whose answer is 'position vs interest' without ambiguity. The Understand layer carries real conceptual weight — 'a strong relationship is not one without conflict — it's one where conflict is followed by repair' is a genuine Understand, not a paraphrased Know. The Do layer correctly uses observation indicators rather than performance rubrics, which is the right choice for a T3 LT. Progression across bands tracks a real arc: staying in the conversation (B) → naming the other's interest (C) → initiating repair within a specified window (D). Each lever shift is concrete.\n\nWhere I would push: the Band B Do indicator 'offers one idea for what to do next even if it is not adopted' is scoreable but would benefit from a specificity note on what counts as an 'idea' — does 'let's take a break' count? I suspect yes, but the current text leaves it to teacher judgement in a way that will produce inter-rater drift. Band D's '48 hours' is a design choice I endorse — a specific window beats 'within a reasonable time' — but flag that teachers will need guidance on what to do when the window is missed and whether it resets the observation.\n\nOverall this is the kind of KUD that enables formative feedback: a teacher reading it knows what they are watching for, and would have something specific to say to a student who is not yet at the band indicator. That is the assessment architect's primary test and this artefact passes it cleanly.",
"flags": [
{ "concern": "Band B 'offers one idea' needs a specificity note on what counts as an idea to reduce inter-rater drift.", "location": "Band B Do indicator", "severity": "minor" },
{ "concern": "Band D '48 hours' window needs teacher guidance on missed-window cases.", "location": "Band D Do indicator", "severity": "minor" }
]
},
{
"role": "dispositions_theorist",
"model": "opus",
"scores_per_dimension": {
"developmental_accuracy": 93,
"domain_grounding": 92
},
"mean_role": 92.5,
"critique_prose": "This KUD takes dispositions seriously rather than treating them as behaviours to be trained. The Understand layer at Band D — 'a strong relationship is not one without conflict — it's one where conflict is followed by repair' — is doing real dispositional work. It names the stance a student is being invited to cultivate, not a technique to deploy. That distinction is the hardest thing to get right in dispositional LT design and this KUD gets it right.\n\nWhat I want to flag is more subtle: the progression is slightly too tilted toward individual-enactment language. The Do indicators are all about what the student does — stays in, names feelings, initiates repair. That is defensible, because the student is the unit we are assessing, but it understates the degree to which dispositions are cultivated by the relational context the student is in. A Band B student whose peer group models staying-in-conversation will develop this disposition faster than one whose peer group models exit-as-default, and the framework could gesture toward that contextual dependency in the Understand layer.\n\nI also want to note that the 'initiates a repair attempt within 48 hours' indicator, while scoreable, risks reading the disposition as a scheduled action rather than an ongoing stance. The disposition being cultivated here is the student holding repair as a value they return to, not a 48-hour task item. I do not think the indicator is wrong — observation indicators need to be concrete — but the surrounding documentation should make clear to teachers that a student who initiates repair at 60 hours is not failing, and that the indicator is a window of observable evidence, not a compliance test.\n\nOverall: a strong piece of dispositional work that holds the Building Learning Power instinct about ongoing stance, with minor opportunities to tighten the relational framing.",
"flags": [
{ "concern": "Do indicators are individual-enactment-focused; Understand layer could gesture toward relational context in which the disposition is cultivated.", "location": "across bands, especially B–C", "severity": "minor" },
{ "concern": "48-hour window risks reading as compliance rather than stance; needs teacher guidance.", "location": "Band D Do indicator", "severity": "minor" }
]
},
{
"role": "relational_sel_practitioner",
"model": "opus",
"scores_per_dimension": {
"domain_grounding": 91,
"practical_usability": 90
},
"mean_role": 90.5,
"critique_prose": "The implementation reality test is the one I'm hardest on and this KUD passes with real margin. The Do indicators are things a teacher running a Circle actually sees — who stays in the conversation when a disagreement rises, who leaves, who names a feeling, who names an escalation pattern. These are not things a teacher has to invent an artificial task to observe; they are things that surface in the ordinary life of a Year 6 classroom in the week before half-term.\n\nWhere I want to push: the Band C indicator 'they can articulate the other person's interest in a way the other person would recognise' is beautifully calibrated but requires the teacher to have enough relationship with both students to know whether the articulation was recognised. In a Circle you can engineer this — you can ask the other student 'does that sound like what you meant?' — but outside the Circle, in the corridor or on the stairs, that verification is not available. The KUD should acknowledge that this indicator is Circle-observable and less reliably observable in other contexts, and suggest how a teacher builds a picture across multiple Circle sessions rather than a single exchange.\n\nI also want to note that 48 hours is generous in a week with a public holiday and a school trip. I would not change the indicator — a specific window is right — but I would add teacher guidance that the window is sensible under normal conditions and that conflicts spanning a half-term break should be measured from the return to school, not the incident.\n\nOverall: this is a KUD a teacher in a real school can actually use. That is rarer than it sounds.",
"flags": [
{ "concern": "Band C 'recognised-by-other' verification is Circle-dependent; needs note on multi-session observation.", "location": "Band C Do indicator", "severity": "moderate" },
{ "concern": "48-hour window needs teacher guidance on breaks / holidays.", "location": "Band D Do indicator", "severity": "minor" }
]
},
{
"role": "curriculum_specificity_reviewer",
"model": "sonnet",
"scores_per_dimension": {
"structural_integrity": 91,
"specificity": 90,
"domain_grounding": 94
},
"mean_role": 91.67,
"critique_prose": "Running the blind-band test: strip the band headers and ask whether a reviewer could reconstruct the band order from the content alone. For this KUD, yes — the progression from 'stays in the conversation' (B) to 'articulates the other's interest' (C) to 'initiates a repair attempt' (D) is genuinely ordered, not a vocabulary inflation. Band C cannot be Band B and Band D cannot be Band C on content alone. This passes cleanly.\n\nKnow-layer items pass the exam-question test. 'Position vs interest' is a specific thing you can write a question about. 'Escalation patterns (tit-for-tat, third-party recruitment)' is specific. 'Repair' at Band D is specific enough that a teacher could test a student's grasp of it.\n\nWhere I want to flag: the Understand-layer at Band B — 'conflict is not always bad — it's a moment where a relationship can either weaken or strengthen depending on what people do next' — is strong content but reads a sentence long where it could read shorter. I don't think this is a specificity failure; it's a house-style note. More substantively, the Band B Do indicator 'offers one idea for what to do next even if it is not adopted' contains the phrase 'even if it is not adopted' which is doing real work (the student is assessed on offering, not on persuading) but 'idea' is under-specified — a student mumbling 'I dunno' does not count, a student saying 'let's take a break' presumably does, and the line between them needs teacher guidance.\n\nBand A is N/A in this KUD (band range B–F) which is the right call — 'initiates a repair attempt' is not a five-year-old's task. The N/A is documented, not silent.",
"flags": [
{ "concern": "Band B 'offers one idea' — 'idea' is under-specified; needs teacher guidance on the mumble-vs-suggestion line.", "location": "Band B Do indicator", "severity": "moderate" },
{ "concern": "Band B Understand sentence is long where a shorter one would land the same content.", "location": "Band B U layer", "severity": "minor" }
]
},
{
"role": "developmental_neuroscience_reviewer",
"model": "opus",
"scores_per_dimension": {
"developmental_accuracy": 94,
"domain_grounding": 92
},
"mean_role": 93.0,
"critique_prose": "The decision to set Band A as N/A is the right one and I endorse it unambiguously. 'Navigating peer conflict constructively' is not a five-year-old's learning target — the regulatory capacity required to stay in a conflict rather than dysregulate and leave is still under construction at that age, and asking an early-years child to meet this indicator would be asking the wrong thing of the developing nervous system. The framework documenting this N/A rather than silently omitting it is also correct — the documentation itself is part of the developmental honesty.\n\nBand B (ages 8–10) is calibrated well. 'Stays in the conversation rather than leaving' is not a stretch at this age for most children in a regulated environment. The indicator acknowledges that 'leaving' is a legitimate move in some cases (a dysregulated child leaving is protecting their nervous system, not failing the indicator) — though I would want the teacher guidance to make that explicit: leaving is not always failure, and a teacher who marks a dysregulated child as not-yet-at-indicator on that basis is reading the indicator wrongly.\n\nBand D's 'initiates a repair attempt within 48 hours' is age-appropriate for 12–14 but assumes a baseline of regulatory recovery from the conflict within that window. For a child with trauma history, 48 hours may be inside the continued-dysregulation window. The indicator is not wrong for the general population but should flag to teachers that for specific children, the window is a safeguarding-relevant variable, not a deadline.\n\nI am strong on the safety lens and acknowledge I am weaker on the learning-design lens — on the learning-architecture side I defer to the cognitive load architect.",
"flags": [
{ "concern": "Band B 'stays in the conversation' — teacher guidance needed that dysregulated leaving is protective, not indicator-failure.", "location": "Band B Do indicator", "severity": "moderate" },
{ "concern": "Band D 48-hour window is inside the continued-dysregulation window for some children with trauma history; safeguarding note required.", "location": "Band D Do indicator", "severity": "moderate" }
]
},
{
"role": "therapeutic_education_sceptic",
"model": "opus",
"scores_per_dimension": {
"developmental_accuracy": 72,
"domain_grounding": 62,
"practical_usability": 66
},
"mean_role": 66.67,
"critique_prose": "I will make the case against this artefact's adoption. It is well-written — I grant that — but the thing it is well-written about is itself the problem. The LT positions the teacher as observer of the student's conflict life, noting whether the student 'names at least one feeling they are having' or 'initiates a repair attempt within 48 hours.' This is surveillance framed as care. An eight-year-old who has an argument at lunchtime does not know that the adult nearby is privately scoring them against a rubric for whether they stayed in the conversation. The observation model treats ordinary childhood life as assessable data for a wellbeing framework, and that treatment itself does something to the child that the framework does not acknowledge.\n\nThe 'repair attempt within 48 hours' indicator medicalises the rhythm of ordinary disagreement. Children fall out and come back together on timescales that have nothing to do with 48 hours and everything to do with the ordinary texture of friendship. Coding this as a curriculum indicator imports a therapeutic grammar into relationships that were doing fine without it. The framework will tell you that the indicator is observation, not prescription — but the indicator becomes prescription the moment a teacher is asked to note it.\n\nOn domain grounding: the 'repair' framework borrows from therapeutic models (Gottman, Siegel) that were developed in clinical settings with adult couples or in trauma-specific contexts, and transfers them into an ordinary school curriculum without acknowledging the transfer. A framework that transports clinical constructs into developmental curriculum without argument is not grounded — it is borrowed.\n\nPractical usability: a teacher with 28 students cannot observe this across the class in the way the framework implies they can, and if they try, they will produce thin judgements on many children rather than good judgements on a few. The framework's observability claims do not survive scale.\n\nI am not required to be fair. The case against adoption is that this framework is a therapeutically-grammared expansion of school's remit into territory that belongs to families and peers, dressed in the vocabulary of curriculum. The other six roles provide balance. My score of 62 on domain grounding is not a mistake.",
"flags": [
{ "concern": "Observation model treats ordinary childhood conflict as assessable data; no acknowledgement of what that framing does to the observed child.", "location": "Do-layer across all bands", "severity": "major" },
{ "concern": "'Repair' framework borrows from clinical therapeutic models without argument for transfer to ordinary school curriculum.", "location": "Band D U and Do", "severity": "major" },
{ "concern": "Observability at scale: 28-student class cannot yield good judgements across all target indicators.", "location": "framework-level assumption", "severity": "major" }
]
},
{
"role": "cognitive_load_architect",
"model": "opus",
"scores_per_dimension": {
"structural_integrity": 92,
"developmental_accuracy": 91,
"specificity": 91,
"domain_grounding": 94
},
"mean_role": 92.0,
"critique_prose": "From the cognitive-load and memory lens, this KUD is well-architected. The Know layer at each band introduces a bounded number of novel elements — at Band B, two: trigger names and the feelings-vs-actions distinction. At Band C, two again: position-vs-interest and escalation patterns. This respects working-memory limits at the target age. Comparable dispositional frameworks I have reviewed often try to introduce six or seven novel elements per band, which collapses into the learner as vocabulary without consolidation. This one does not.\n\nThe progression passes the expertise-reversal check: Band C's 'position vs interest' depends on Band B's 'feelings and actions are separate' — and the dependency is sequenced correctly. A learner at Band C has had two years to consolidate the Band B schema before being asked to build on it. Band D's 'repair' concept depends on Band C's understanding of shared interests, and again the dependency is sequenced correctly. Nothing in Band N assumes schema from Band N+1.\n\nThe Do indicators require genuine retrieval rather than recognition — the student is not picking from a menu of options, they are bringing behaviour forward unaided. That is the right design for transferable competence. A rubric that asked the student to select the correct response from a list would build brittle procedural knowledge that collapses outside the teaching task.\n\nOne flag: the Understand layer at Band B carries a fair bit of conceptual weight in a single sentence, which is fine for teacher-facing documentation but means the teacher will need to decompose the concept for the student. This is a teaching-design concern more than a cognitive-load failure in the KUD itself, but worth noting so that the implementation guidance does not assume the Understand sentence can be delivered whole to an eight-year-old.\n\nOn the Koedinger KC frame: this panel's wellbeing content sits better in Sweller/Rosenshine architecture than in explicit KC modelling, so I have not pushed that frame. For future maths-content review this skill will want a reviewer who does.",
"flags": [
{ "concern": "Band B U sentence carries heavy conceptual weight; implementation guidance should decompose for age 8–10 delivery.", "location": "Band B U layer", "severity": "minor" }
]
}
],
"aggregate": {
"mean_overall": 88.25,
"mean_per_dimension": {
"structural_integrity": 92.0,
"developmental_accuracy": 87.5,
"specificity": 91.0,
"domain_grounding": 88.43,
"practical_usability": 82.33
},
"below_floor_roles": [
{ "role": "therapeutic_education_sceptic", "mean_role": 66.67 }
],
"unanimous_flags": [
"Band B 'offers one idea' / 'idea' specificity needs teacher guidance (raised by assessment architect and curriculum specificity reviewer).",
"Band D 48-hour window needs teacher guidance on edge cases — missed windows, breaks, continued-dysregulation window for trauma history (raised by assessment architect, dispositions theorist, relational SEL practitioner, developmental neuroscience reviewer)."
],
"gate_verdict": "FAIL",
"gate_reasoning": "FAIL: mean_overall 88.25 meets the >=88 threshold, but therapeutic-education sceptic mean_role 66.67 is below the 70 floor. Floor rule triggers — a single role's sustained dissent on the therapeutic-education grounding is a structural blocker, not a number to be averaged away. Author decision required: either engage the sceptic's flags substantively (observation-as-surveillance framing; clinical-to-curriculum transfer without argument; observability-at-scale) or document why the panel proceeds despite the floor trigger."
},
"caveats": []
}
How to read this example. The artefact is genuinely high-quality — six of seven roles score it in the 88–95 range, flags are mostly minor, and the unanimous flags identify two real issues the author would benefit from addressing. The mean_overall sits just above the 88 threshold. And yet the verdict is FAIL, because the therapeutic-education sceptic's sustained dissent on three dimensions drops its mean_role to 66.67, below the 70 floor. This is the floor rule doing exactly what it is designed to do: preventing a single role's structural concern from being averaged into passage. The author's next move is not to re-score the sceptic — it is to decide whether the sceptic's concerns are addressable (in which case, revise) or whether the panel proceeds with the dissent documented (in which case, the floor trigger becomes part of the artefact's adoption record rather than a silent pass).
Sequential-isolation is not parallel-API. Sequential-isolation mode executes seven reviews in one session with explicit segment markers. This is a meaningful improvement on shared-context review (where voices collapse into a single averaged critique) but does not eliminate cross-role influence the way a true parallel-API architecture would. True parallel-API mode is deferred to a future version of this skill.
Roles are depersonalised traditions, not biographical approximations. The seven roles are research-grounded distillations of intellectual lineages. They are not impersonations of named living academics and should not be treated as such. Specific positions of specific researchers may not be represented accurately by the role-prompt that bears their lineage.
Panel is tuned for wellbeing and SEL content. For curriculum artefacts in other domains — maths, literacy, history, science, modern languages — the panel composition would need adjustment. The current panel's cognitive-load architect leans Sweller/Rosenshine; maths review would want Koedinger-equivalent expertise on knowledge-component modelling. The current panel's developmental neuroscience reviewer is trauma-informed-weighted; science curriculum review would want a different developmental lens. Panel library refactor is a future task.
Scope-and-sequence review is weaker than ideal. The panel is acknowledged as weaker on learning-architecture dimensions (Koedinger-equivalent depth) than scope-and-sequence review genuinely needs. This caveat is emitted automatically in the output when artefact_type == scope_and_sequence so that consumers of the review do not treat the scores as more definitive than they are.
The skill has not been empirically validated against known-high-quality and known-flawed artefacts. Phase 0.5 of the curriculum-harness project is the validation step: run the skill on LT 4.5 KUD v2 (commit ab4705c, known high-quality) and on LT 4.4 KUD v1 (known to have specificity and observability weaknesses) and check whether the gate verdict distinguishes them correctly. Until Phase 0.5 completes, the skill's discriminative validity is asserted, not demonstrated.
The 88 threshold is convention pending Phase 0.5 validation. The mean_overall >= 88 threshold and the mean_role >= 70 floor are convention at v1.0.0. Phase 0.5 will check whether these thresholds produce the correct PASS/FAIL split on the known-quality corpus; if not, the thresholds may be tuned and this skill version-bumped accordingly.