databricks-prod-checklist

name	databricks-prod-checklist
description	Execute Databricks production deployment checklist and rollback procedures. Use when deploying Databricks jobs to production, preparing for launch, or implementing go-live procedures. Trigger with phrases like "databricks production", "deploy databricks", "databricks go-live", "databricks launch checklist".
allowed-tools	Read, Bash(databricks:*), Grep
version	1.0.0
license	MIT
author	Jeremy Longshore <[e-mail]>
compatible-with	claude-code, codex, openclaw
tags	["saas","databricks","deployment"]

Databricks Production Checklist

Overview

Complete checklist for deploying Databricks jobs and pipelines to production. Covers security hardening, infrastructure validation, code quality gates, job configuration, deployment commands, monitoring setup, and rollback procedures.

Prerequisites

• Staging environment tested and verified
• Production workspace access with service principal
• Unity Catalog configured with prod catalogs
• Monitoring and alerting ready (see databricks-observability)

Instructions

Step 1: Pre-Deployment Security

• Service principal configured for automated runs (not personal PAT)
• Secrets in Databricks Secret Scopes (not env vars or hardcoded)
• Token expiration set (max 90 days)
• Unity Catalog grants follow least privilege
• Cluster policies enforced for cost/security guardrails
• IP access lists configured in Admin Console
• Audit logging verified via system.access.audit

Step 2: Infrastructure Validation

• Instance pool created for fast cluster startup
• Node types validated for workload (compute-optimized for streaming, memory-optimized for ML)
• Autoscaling configured with sensible min/max workers
• Spot instances enabled for worker nodes (on-demand for driver)
• Auto-termination disabled for job clusters (they terminate on completion)

# Verify infrastructure
databricks clusters list-node-types --output json | jq '.[0:5] | .[].node_type_id'
databricks instance-pools list --output json | jq '.[] | {id: .instance_pool_id, name: .instance_pool_name}'

Step 3: Code Quality Gates

• Unit tests passing locally ()