Create, manage, and curate Freeplay datasets (prompt datasets and agent datasets). Always confirm with the user before any write operations. Use when the user wants to create a new dataset, add test cases, update datasets, manage dataset content, import test data from CSV or JSONL, create golden sets, or build evaluation datasets. Do NOT use for running tests (use run-test) or analyzing test results (use test-run-analysis).
Create, manage, and curate Freeplay datasets (prompt datasets and agent datasets). Always confirm with the user before any write operations. Use when the user wants to create a new dataset, add test cases, update datasets, manage dataset content, import test data from CSV or JSONL, create golden sets, or build evaluation datasets. Do NOT use for running tests (use run-test) or analyzing test results (use test-run-analysis).
Freeplay Dataset Management
IMPORTANT: Safety Guidelines
Confirmation Required: Always ask for user confirmation before performing any write operations (creating datasets, adding test cases, updating datasets, updating test cases).
No Deletion Operations: Do NOT perform any deletion operations (deleting datasets or test cases). If the user requests deletion, inform them that deletion must be done manually through the Freeplay UI or API directly. This skill does not support deletion actions to prevent accidental data loss.
Manage test datasets for evaluating prompts and agents in Freeplay.
Critical: Two Dataset Types
Freeplay has two distinct dataset types with different API endpoints:
Prompt Datasets - Test individual prompt templates → See prompt-datasets.md
Agent Datasets - Test complete agent workflows → See agent-datasets.md
ALWAYS confirm which type the user needs. The APIs are not interchangeable.
Quick decision guide:
User mentions "prompt", "template", or "component" → Prompt Dataset
User mentions "agent", "workflow", or "end-to-end" → Agent Dataset
Quick Start
Setup (required for all operations)
import requests
os
scripts.secrets SecretString
api_key = SecretString(os.environ.get())
headers = {
: ,
:
}
project_id =
base =
