mhdash-online-platform-benchmarking

name

mhdash-online-platform-benchmarking

description

Build risk-aware evaluation pipelines for mental health AI assistants using the MHDash framework. Implements multi-dimensional annotation, risk-specific metrics, and multi-turn dialogue benchmarking that exposes safety-critical failure modes hidden by aggregate scores. Triggers: 'benchmark mental health AI', 'evaluate AI safety for mental health', 'risk-aware model evaluation', 'build mental health chatbot test suite', 'assess high-risk recall for AI', 'evaluate multi-turn dialogue safety'

MHDash: Risk-Aware Benchmarking for Mental Health AI Assistants

This skill enables Claude to design, implement, and run evaluation pipelines for AI systems operating in mental health support contexts. Based on the MHDash framework, it replaces simplistic aggregate-accuracy benchmarking with a multi-dimensional, risk-stratified evaluation approach that reveals catastrophic failure modes on high-risk populations — the exact failures that conventional metrics mask. Use this skill when building test harnesses, annotation schemas, or evaluation dashboards for any AI system where missing a high-risk case (suicidal ideation, self-harm, crisis escalation) is a safety-critical failure.

When to Use

• When the user is building or evaluating a chatbot, LLM, or classifier for mental health support and needs a rigorous test framework
• When the user asks to benchmark multiple models on mental health text classification and wants more than just accuracy/F1
• When the user needs to design an annotation schema for mental health dialogue data with concern type, risk level, and intent dimensions
• When the user wants to generate synthetic multi-turn mental health dialogues for evaluation purposes
• When the user needs to measure high-risk recall, false negative rates on severe cases, or ordinal ranking consistency (Kendall's Tau) for safety-critical classification
• When the user is comparing fine-tuned encoders (BERT, RoBERTa) against LLM APIs and needs to understand where each fails
• When the user asks to build a dashboard or reporting system that surfaces per-class and risk-specific model failures

Key Technique

MHDash's core insight is that aggregate metrics actively hide the most dangerous failures in mental health AI. A model achieving 85% overall accuracy can simultaneously have a 100% false negative rate on suicide attempt detection — meaning it misses every single severe case while looking "good" on paper. This happens because non-risk cases dominate datasets (56.9% in MHDash's data), inflating aggregate scores even when high-risk recall is zero.

The framework addresses this through three-dimensional annotation applied to every data point: (1) Concern Type with 7 categories ranging from Attempt to Not Related, (2) Risk Level with 6 ordinal severity tiers from Severe to Not Related, and (3) Dialogue Intent with 8 categories split between support-oriented patterns (emotional venting, help-seeking, validation, recovery) and strategy-oriented patterns (escalation, avoidance, adversarial). This triple-axis annotation enables evaluation sliced along any combination of dimensions, revealing exactly where and how models fail.

The second key innovation is multi-turn dialogue evaluation. Real mental health conversations don't present risk in a single message — risk signals emerge gradually across turns. MHDash generates 10-round synthetic dialogues (the MHDialog dataset) and evaluates models on their ability to track escalating risk over conversation history. Models that perform well on single-turn classification often degrade significantly in multi-turn settings, where context accumulation and gradual risk escalation expose shallow pattern matching. The framework uses risk-specific metrics — high-risk recall, per-severity false negative rate, and Kendall's Tau for ordinal ranking — to quantify these failures explicitly.

Step-by-Step Workflow

1. Define the annotation schema with three dimensions: create enum types or a schema file for Concern Type (Attempt, Behavior, Ideation, Indicator, Supportive, Unsure, Not Related), Risk Level (Severe, Moderate, Minor, No Risk, Unsure, Not Related), and Dialogue Intent (emotional venting, help-seeking, validation-seeking, recovery-sharing, escalation, avoidance, adversarial, neutral). Every evaluation sample must carry all three labels.

2. Prepare or collect the evaluation dataset. Source mental health text from established datasets (e.g., Reddit mental health subreddits, crisis text corpora) or use the MHDialog dataset from Hugging Face. Ensure the dataset includes multi-turn dialogues (minimum 5-10 rounds per conversation) alongside single-turn samples. Verify class distribution and document the imbalance — expect ~55-60% non-risk cases.

3. Apply human-in-the-loop annotation filtering. Implement an annotation pipeline where each sample receives labels on all three dimensions. Use inter-annotator agreement metrics (Cohen's Kappa or Fleiss' Kappa) as quality gates. Flag samples where annotators disagree on risk level for expert adjudication — disagreement on severity is itself a safety signal.

4. Generate synthetic multi-turn dialogues for coverage gaps. Use an LLM (GPT-4 class or equivalent) to produce 10-round dialogues seeded from annotated single-turn posts. Each dialogue must have per-turn risk annotations showing how risk escalates, de-escalates, or remains stable across the conversation. Validate generated dialogues against the annotation schema.

5. Implement the evaluation metrics suite. Beyond standard accuracy, precision, recall, and macro-F1, implement these risk-specific metrics:

   • High-Risk Recall: recall computed only on Severe and Moderate risk levels
   • Per-Class False Negative Rate: FNR for each concern type, especially Attempt and Ideation
   • Kendall's Tau: measures whether the model preserves ordinal severity ranking even if absolute labels are wrong
   • Risk-Stratified Confusion Matrix: a confusion matrix filtered to high-risk rows only

6. Run baseline and target models through the pipeline. Evaluate each model on both single-turn and multi-turn settings. For LLM APIs, use few-shot prompting (3-5 examples per class) with structured output formatting. For fine-tuned models, evaluate on held-out splits. Record predictions with full metadata (model, input, turn number, ground truth on all three dimensions).

7. Compute and compare risk-specific results. For each model, generate a report card showing: overall accuracy, macro-F1, high-risk recall, per-concern-type FNR, Kendall's Tau for risk ordering, and a delta column showing multi-turn vs. single-turn performance degradation. Sort models by high-risk recall rather than overall accuracy.

Concrete Examples

Example 1: Building a risk-aware evaluation harness for a mental health chatbot

User: "I have a fine-tuned BERT model and GPT-4o that I want to evaluate for a mental health support chatbot. I need more than just accuracy — I need to know if they miss high-risk cases."

Approach:

1. Define the three-dimensional annotation schema as Python dataclasses or Pydantic models
2. Load the evaluation dataset with ground-truth labels on all three dimensions
3. Run both models, collecting structured predictions
4. Compute the full metrics suite

Output:

from dataclasses import dataclass
from enum import Enum
from sklearn.metrics import classification_report, confusion_matrix
from scipy.stats import kendalltau
import numpy as np

class ConcernType(Enum):
    ATTEMPT = "attempt"
    BEHAVIOR = "behavior"
    IDEATION = "ideation"
    INDICATOR = "indicator"
    SUPPORTIVE = "supportive"
    UNSURE = "unsure"
    NOT_RELATED = "not_related"

class RiskLevel(Enum):
    SEVERE = 5
    MODERATE = 4
    MINOR = 3
    NO_RISK = 2
    UNSURE = 1
    NOT_RELATED = 0

class DialogueIntent(Enum):
    EMOTIONAL_VENTING = "emotional_venting"
    HELP_SEEKING = "help_seeking"
    VALIDATION_SEEKING = "validation_seeking"
    RECOVERY_SHARING = "recovery_sharing"
    ESCALATION = "escalation"
    AVOIDANCE = "avoidance"
    ADVERSARIAL = "adversarial"
    NEUTRAL = "neutral"

@dataclass
class AnnotatedSample:
    text: str
    concern_type: ConcernType
    risk_level: RiskLevel
    dialogue_intent: DialogueIntent
    turn_number: int =   

 ():
    
     high_risk_levels  :
        high_risk_levels = {RiskLevel.SEVERE.value, RiskLevel.MODERATE.value}
    mask = np.isin(y_true, (high_risk_levels))
     mask.() == :
         ()
     (np.array(y_true)[mask] == np.array(y_pred)[mask]).mean()

 ():
    
    mask = np.array(y_true) == target_class
     mask.() == :
         ()
    false_negatives = ((np.array(y_true) == target_class) &
                       (np.array(y_pred) != target_class)).()
     false_negatives / mask.()

 ():
    
    tau, p_value = kendalltau(y_true_ordinal, y_pred_ordinal)
     tau, p_value

 ():
    report = {: model_name}
    report[] = (np.array(y_true_risk) == np.array(y_pred_risk)).mean()
    report[] = compute_high_risk_recall(y_true_risk, y_pred_risk)
    report[] = compute_per_class_fnr(
        y_true_concern, y_pred_concern, ConcernType.ATTEMPT.value)
    report[] = compute_per_class_fnr(
        y_true_concern, y_pred_concern, ConcernType.IDEATION.value)
    tau, _ = compute_risk_ranking(y_true_risk, y_pred_risk)
    report[] = tau
     report

Example 2: Generating synthetic multi-turn dialogues for evaluation

User: "I need to create multi-turn mental health test conversations where risk escalates gradually, to test whether my model can track it."

Approach:

1. Seed each dialogue from a real annotated single-turn post
2. Use an LLM to generate a 10-round conversation with per-turn risk annotations
3. Validate that risk trajectories are realistic

Output:

DIALOGUE_GENERATION_PROMPT = """You are generating a synthetic mental health support
dialogue for evaluation purposes. Given the seed post below, create a 10-round
conversation between a user and an AI assistant.

SEED POST: {seed_post}
SEED RISK LEVEL: {seed_risk}
SEED CONCERN TYPE: {seed_concern}

REQUIREMENTS:
- The user's messages should show gradual risk evolution (escalation OR de-escalation)
- Each user turn must be annotated with: concern_type, risk_level, dialogue_intent
- The AI assistant responds supportively but this is about evaluating the USER's state
- Risk signals should be subtle in early turns and become clearer over time
- Include at least one turn where intent shifts (e.g., from help-seeking to avoidance)

OUTPUT FORMAT (JSON):
{{
  "dialogue_id": "unique_id",
  "turns": [
    {{
      "turn": 1,
      "speaker": "user",
      "text": "...",
      "concern_type": "ideation",
      "risk_level": "minor",
      "dialogue_intent": "emotional_venting"
    }},
    {{
      "turn": 2,
      "speaker": "assistant",
      "text": "..."
    }},
    ...
  ]
}}
"""

def generate_evaluation_dialogues(seed_samples, llm_client, n_dialogues=100):
    dialogues = []
    for sample in seed_samples[:n_dialogues]:
        prompt = DIALOGUE_GENERATION_PROMPT.format(
            seed_post=sample.text,
            seed_risk=sample.risk_level.name,
            seed_concern=sample.concern_type.name
        )
        response = llm_client.generate(prompt, response_format="json")
        dialogue = json.loads(response)
        # Validate annotations exist on every user turn
        for turn in dialogue["turns"]:
            if turn["speaker"] == "user":
                assert "risk_level" in turn, f"Missing risk_level on turn {turn['turn']}"
                assert "concern_type" in turn
                assert "dialogue_intent" in turn
        dialogues.append(dialogue)
     dialogues

Example 3: Multi-turn performance degradation analysis

User: "I want to see how my model's performance changes across dialogue turns — does it get worse as conversations get longer?"

Approach:

1. Run the model on each turn independently (cumulative context up to that turn)
2. Compute per-turn metrics
3. Plot degradation curves

Output:

def evaluate_per_turn(model, dialogues, max_turns=10):
    """Evaluate model at each turn with cumulative context."""
    turn_results = {t: {"y_true": [], "y_pred": []} for t in range(1, max_turns + 1)}

    for dialogue in dialogues:
        context = []
        for turn in dialogue["turns"]:
            context.append(turn)
            if turn["speaker"] == "user":
                # Model sees all context up to this turn
                prediction = model.predict(context)
                t = turn["turn"] // 2 + 1  # user turn index
                if t <= max_turns:
                    turn_results[t]["y_true"].append(turn["risk_level"])
                    turn_results[t]["y_pred"].append(prediction["risk_level"])

    per_turn_metrics = {}
    for t in range(1, max_turns + 1):
        if turn_results[t]["y_true"]:
            per_turn_metrics[t] = {
                "high_risk_recall": compute_high_risk_recall(
                    turn_results[t]["y_true"], turn_results[t]["y_pred"]),
                "accuracy": np.mean(np.array(turn_results[t]["y_true"]) ==
                                    np.array(turn_results[t]["y_pred"])),
            }
     per_turn_metrics
    
    

Best Practices

• Do: Always report high-risk recall and per-class FNR alongside aggregate accuracy. A model with 85% accuracy and 0% attempt recall is unsafe for deployment.
• Do: Evaluate on multi-turn dialogues, not just single-turn classification. Models that look competent on isolated messages often fail when risk escalates gradually across a conversation.
• Do: Use Kendall's Tau to evaluate ordinal consistency. A model that confuses Severe with Moderate is less dangerous than one that confuses Severe with No Risk — ordinal metrics capture this distinction.
• Do: Stratify results by dialogue intent. Models often perform well on help-seeking intents but fail on adversarial or avoidance patterns where users actively obscure their state.
• Avoid: Relying on macro-F1 alone for model selection. Macro-F1 weights all classes equally but doesn't distinguish between confusing Minor with No Risk versus confusing Severe with Not Related.
• Avoid: Using synthetic dialogues as the sole evaluation set. Always validate synthetic data quality against human annotations and include real-world samples in the evaluation mix.

Error Handling

• Class imbalance distortion: If the evaluation set has fewer than 20 samples per high-risk category, confidence intervals on high-risk recall will be too wide. Report sample counts alongside metrics and use bootstrap confidence intervals.
• Annotation disagreement on risk level: When inter-annotator agreement on severity is low (Kappa < 0.6), treat the annotation as noisy and report performance under both annotator labels. Do not silently drop disagreed-upon samples — they are often the most important edge cases.
• LLM output parsing failures: When evaluating LLM APIs with few-shot prompting, expect 5-15% of responses to not parse into the expected format. Log these separately as "refusals/parse failures" rather than silently counting them as incorrect. A model that refuses to classify a high-risk message is different from one that misclassifies it.
• Multi-turn context overflow: Models with limited context windows may truncate early turns in long dialogues. Track and report context truncation events. If truncation drops critical risk signals from early turns, the evaluation is measuring the tokenizer, not the model.

Limitations

• The three-dimensional annotation schema (concern type, risk level, intent) was designed for English-language social media mental health text. It may not transfer directly to clinical transcripts, crisis hotline logs, or non-English contexts without schema adaptation.
• Synthetic multi-turn dialogues, even when LLM-generated and validated, do not fully capture the unpredictability of real crisis conversations. They should supplement, not replace, evaluation on real interaction data.
• This framework evaluates classification and risk detection accuracy. It does not evaluate the quality or safety of the AI's therapeutic responses — only whether the system correctly recognizes the user's state.
• Ordinal ranking metrics (Kendall's Tau) assume the risk levels are meaningfully ordered, which may not hold perfectly across all concern types (e.g., the severity ordering for "Supportive" vs. "Unsure" is ambiguous).
• The framework benchmarks snapshot performance. It does not address model drift, where deployed models degrade over time as language use and mental health expression patterns evolve.

Reference

Paper: MHDash: An Online Platform for Benchmarking Mental Health-Aware AI Assistants — Zhang et al., IEEE SoutheastCon 2026

What to look for: The three-dimensional annotation schema (Section on Data Annotation), the risk-specific metrics suite (Evaluation Layer), the finding that fine-tuned encoders achieve high aggregate accuracy but 100% false negative rates on attempt/severe cases (Results), and the multi-turn performance degradation analysis.

Dataset: MHDialog (1,000 dialogues, 10 turns each) available on Hugging Face. Platform at https://mhdash.socialshields.org/