golden-dataset-validation

name	golden-dataset-validation
description	Use when validating golden dataset quality. Runs schema checks, duplicate detection, and coverage analysis to ensure dataset integrity for AI evaluation.
context	fork
agent	data-pipeline-engineer
version	1.0.0
author	SkillForge AI Agent Hub
tags	["golden-dataset","validation","integrity","schema","duplicate-detection",2025]
allowed-tools	["Read","Grep","Glob"]
user-invocable	false

Golden Dataset Validation

Ensure data integrity, prevent duplicates, and maintain quality standards

Overview

This skill provides comprehensive validation patterns for the golden dataset, ensuring every entry meets quality standards before inclusion.

When to use this skill:

• Validating new documents before adding
• Running integrity checks on existing dataset
• Detecting duplicate or similar content
• Analyzing coverage gaps
• Pre-commit validation hooks

---

Schema Validation

Document Schema (v2.0)

{
  "$schema": "http://json-schema.org/draft-07/schema#",
  "type": "object",
  "required": ["id", "title", "source_url", "content_type", "sections"],
  "properties": {
    "id": {
      "type": "string",
      "pattern": "^[a-z0-9-]+$",
      "description": "Unique kebab-case identifier"
    },