test-run-analysis

name	test-run-analysis
description	Analyze Freeplay test run results to surface insights, evaluation metrics, and test case details. Use when the user wants to review test run performance, compare two test runs, understand evaluation scores, or identify failing test cases. Do NOT use for executing new test runs (use run-test) or managing datasets (use dataset-management).

Test Run Analysis

This skill helps you review Freeplay test run results, view evaluation metrics, and identify patterns across test cases.

When to use this skill

• "Summarize the results of test run X"
• "Summarize the major differences between two test runs in the same comparison"
• "What were the metrics for my last test run?"
• "Analyze test run [ID]"
• "Which test cases failed in run X?"
• "What are the evaluation scores from this test?"
• User mentions a specific test run ID and wants insights
• Compare two test runs and summarize differences between latency, cost, and evaluations
• Select a winner from two test runs based on available data

Available API Endpoints

Get Test Run Summary

Endpoint: GET /api/v2/projects/{project_id}/test-runs/id/{test_run_id}

Returns:

{
  "id": "test-run-uuid",
  "name": "Test run name",
  "description": "Description",
  "created_at"