| name | skill-live-processing |
| description | Use for live stream and VOD ingestion pipelines, including YouTube, Twitch, uploads, capture jobs, queues, transcription, clip generation, media storage, retries, idempotent workers, consent, validation, observability, and safe server-side provider credentials. |
| category | media |
| risk | medium |
| source | local-media-pipeline-patterns |
Live Processing
Use this skill for live streams, long VODs, and media pipelines that produce transcripts, summaries, clips, thumbnails, captions, or publishable assets.
Pipeline Contract
- Separate ingestion, processing, enrichment, review, and publishing into explicit stages.
- Keep platform OAuth tokens, webhook secrets, storage credentials, AI provider keys, and signing keys server-side.
- Validate source ownership, platform terms, tenant quota, duration, codec, file size, language, and processing options before enqueueing.
- Create a durable
media_jobs record before downloading or running expensive work.
- Run long work in queues or workers. Do not download, transcode, transcribe, or render inside request handlers.
- Make every stage idempotent and resumable from stored artifacts, checksums, stage status, and provider job IDs.
- Store source media and generated assets in private storage. Use signed URLs with short TTLs for preview and download.
- Batch and chunk AI work. Reuse transcript segments, embeddings, shot boundaries, and thumbnails instead of resending full media context.
- Require review before publishing clips or generated metadata unless the product has explicit auto-publish consent.
- Emit structured progress, queue age, stage duration, retry count, artifact checksums, and sanitized failure reasons.
Stage States
Use stable states such as:
queued, validating, downloading, extracting_audio, transcribing, detecting_clips, rendering, review_ready, publishing, published, failed, cancelled.
Data Model Hints
media_jobs: tenant ID, owner ID, source type, source URL or asset ID, status, current stage, progress, idempotency key, retry count, error class.media_assets: job ID, kind, storage path, duration, size, checksum, codec, metadata, retention deadline.clip_candidates: job ID, timestamps, score, reason, transcript excerpt hash, review status.processing_events: job ID, stage, status, duration, worker ID, details.
Verification
- Test webhook ingestion, duplicate webhook, cancelled job, worker crash and resume, provider timeout, quota exceeded, invalid media, signed URL expiry, and publishing gate behavior.
- Confirm platform and provider secrets are not exposed in clients or logs.
Related Skills
skill-smart-clip-detectionskill-manual-video-processingskill-ai-orchestrationskill-unified-analytics
