lakebase-scm-workflowsOpinionated git-Lakebase branch-pairing workflows. Use when scaffolding a Lakebase-paired project, creating/deleting Lakebase branches in lockstep with git branches, diffing parent-aware schemas, opening or merging PRs that touch Lakebase, or running the same…lakebase-sftdd-workflowsSpec-First Test-Driven Development (SFTDD) with evolutionary design, against paired Lakebase branches: the design lane is Spec Driven Development (SDD) and the build lane is canonical Beck-style Test Driven Development (RED-GREEN-REFACTOR), composed with…software-design-principlesFoundational engineering canon – SOLID, DRY, clean code, layered architecture, cross-cutting concerns, NFRs. Imported by workflow skills (lakebase-sftdd-workflows, lakebase-scm-workflows, lakebase-release-workflows). Use when designing a module, reviewing a…architectural-design-principlesSystem-level engineering canon, the architecture counterpart to software-design-principles. Layered architecture + dependency direction, ports and adapters (repository / ORM-as-adapter), the twelve-factor app for cloud-native development, evolutionary…lakebase-release-workflowsOpinionated branching + release methodology for Lakebase-paired projects. Use when designing a project's branch layout, cutting a release candidate, promoting between long-running tiers, rolling back, or asking 'where should this work happen?' Encodes the…ui-ux-design-principlesExperience-level engineering canon, the UI/UX counterpart to software-design-principles (code-level) and architectural-design-principles (system-level). Usability heuristics, visual hierarchy, accessibility, interaction and feedback, information architecture,…
مستكشف المستودعات
databricks-solutions · المستودعات و skills الممثلة - الصفحة ٢
عرض على مستوى المستودعات لـ ٢٦٩ skills مجمعة عبر ٣٥ مستودعات GitHub.
databricks-bundle-deployPackage and deploy Databricks Asset Bundles with proper parameterization, multi-environment support, and serverless compute. Handles project structure, databricks.yml generation, validation, and deployment. Use when packaging tested code for production,…databricks-data-engineeringProduction data engineering pipelines following medallion architecture (Bronze/Silver/Gold layers) with data ingestion, transformation, quality checks, Delta Lake optimization, and orchestration. Use when building ETL pipelines, medallion architecture, data…databricks-ml-pipelineEnd-to-end machine learning pipelines on Databricks including data exploration, feature engineering, model training with hyperparameter optimization, MLflow experiment tracking, model registration to Unity Catalog, and deployment as DABs. Use when building ML…databricks-testingExecute code on Databricks clusters using MCP Command Execution API. Supports stateless quick validation and stateful iterative development. Use when testing Python/SQL code on clusters, debugging pipelines, or validating transformations.databricks-unity-catalogManage Unity Catalog resources including catalogs, schemas, and tables. Handles discovery, creation, updates, and deletions with proper naming conventions and governance. Use when exploring catalogs, creating schemas, managing tables, or setting up data…
dabs-migratorUse to scaffold a Databricks Asset Bundle (DABs) project from existing workspace assets. Trigger when the user says "migrate to DABs", "generate a DAB", "convert my job/pipeline to a bundle", or names Databricks resources (jobs, pipelines, dashboards, etc.)…genie-space-scan-optimizeAudit and improve a single Databricks Genie space / Genie agent's configuration quality. Runs a deterministic 12-check "IQ scan" (data sources, table/column description coverage, instructions, joins, example SQL, benchmarks, entity matching) with RLS /…tableau-migration-assessmentBulk profiling and migration-readiness assessment for Tableau files (.twb / .twbx workbooks and .tds / .tdsx data sources) before converting them to Databricks AI/BI dashboards. Load this skill when the user asks to assess, profile, audit, or evaluate Tableau…pbi-migration-assessmentBulk profiling and migration-readiness assessment for Power BI reports (.pbit files) before converting them to Databricks AI/BI dashboards. Load this skill when the user asks to assess, profile, audit, or evaluate Power BI reports for migration complexity, or…aibi-migration-mapTurn raw Tableau workbooks (`.twbx`/`.tdsx`) or Power BI templates (`.pbit`/`.pbix`) — or a hand-filled inventory — into a shareable single-file HTML migration map. Parses the files directly, clusters them on their shared fact tables, routes every…
asyncioUse when debugging event loop hangs, task scheduling issues, call_soon vs call_soon_threadsafe confusion, Future callback timing, _enter_task/_leave_task conflicts, GIL contention patterns, per-step vs per-drive task context, uvloop compatibility problems,…rustStrict set of rules in terms of codebase development, design patterns, and best practices. Use when the user wants to develop a new feature or refactor existing code.apxQuick reference for building full-stack Databricks Apps with apx (React + FastAPI). Use when working on apx projects, creating routes, adding components, or managing dev servers.commiterCreate git commits with emoji prefixes and conventional commit messages. Use when the user wants to commit changes, push code, or asks to use "just pm" command.
databricks-solution-builderGenerate comprehensive specification files for building Databricks assets, demos or end 2 end projects. Use when users want to create a new demo, design a demo story, or need help structuring demo components, create an entire project. This skill creates…databricks-architectureCreate or edit a Databricks solution-architecture diagram — a Lucidchart-style platform diagram (sources → Lakeflow/Genie pipeline → lakehouse/lakebase → dashboards, Genie, apps → end user, on a governed platform). Use when someone wants to draw, generate, or…loyalty-segmentation-adaptationConfigure and run the Harvestly Co. loyalty segmentation demo in the user's Databricks workspace. Use when the user is working in (or has imported) the loyalty-segmentation project AND says any of "run in my workspace", "set this up", "configure for my…demo-slug-adaptationConfigure, run, and adapt the {{demo-name}} demo in the user's Databricks workspace. Use when the user is working in (or has imported) the {{demo-slug}} project AND says any of "run in my workspace", "set this up", "configure for my workspace/catalog/schema",…
consortConsort, a spec-first, test-driven agent framework for building transactional applications on Lakebase-paired projects: a deterministic orchestrator drives role agents through a spec-first design lane (Spec Driven Development) and a Test Driven Development…software-design-principlesFoundational engineering canon – SOLID, DRY, clean code, layered architecture, cross-cutting concerns, NFRs. Imported by workflow skills (consort, lakebase-scm-workflows). Use when designing a module, reviewing a PR, planning a refactor, mapping cross-cutting…architectural-design-principlesSystem-level engineering canon, the architecture counterpart to software-design-principles. Layered architecture + dependency direction, ports and adapters (repository / ORM-as-adapter), the twelve-factor app for cloud-native development, evolutionary…ui-ux-design-principlesExperience-level engineering canon, the UI/UX counterpart to software-design-principles (code-level) and architectural-design-principles (system-level). Usability heuristics, visual hierarchy, accessibility, interaction and feedback, information architecture,…
pii-managementIdentify and label PII columns in SDP pipeline tables. Use when creating or modifying tables that contain customer or personal data. Includes detection patterns, table property labeling, column annotation, and masking guidance. Always generate SDP pipelines…sdp-basicsApply basic SDP pipeline best practices for table naming, comments, and table properties. Use when creating or modifying tables in Spark Declarative Pipelines. Always generate SDP pipelines using SQL, not Python.sentiment-analysisBuild sentiment-analysis datasets in SDP pipelines using built-in Databricks AI functions (ai_analyze_sentiment, ai_classify, ai_extract, ai_summarize, ai_query). Use when creating or modifying tables that derive sentiment, topics, or entities from free-form…table-governanceEnforce table and column documentation standards across all tables. Use for every table you create or modify. Covers COMMENT clauses, TBLPROPERTIES, column descriptions, PII labeling at the table level, and Unity Catalog tags. This is the baseline governance…
managed-memoryGive an agent durable, cross-session long-term memory using Databricks MANAGED memory (the Unity Catalog memory-store REST APIs) as tools — governed by UC with no infra the customer needs to run. This works for either OpenAI Agents SDK or LangGraph templates.…agent-memoryAdd memory capabilities to your agent. Use when: (1) User asks about 'memory', 'state', 'remember', 'conversation history', (2) Want to persist conversations or user preferences, (3) Adding checkpointing or long-term storage.agent-openai-memoryAdd memory capabilities to your agent. Use when: (1) User asks about 'memory', 'state', 'remember', 'conversation history', (2) Want to persist conversations or user preferences, (3) Adding checkpointing or long-term storage.unity-ai-gateway-model-serviceCreate, configure, query, and govern Databricks Unity AI Gateway "model services" (UC securables at catalog.schema.service that front FMAPI models), and wire a deployed Mosaic AI agent endpoint to call one. Covers the live 2.1 REST API (create-or-get,…
contribute-lakebase-exampleEnd-to-end guide for contributing a new example to the Lakebase Cookbook repository. Use when a contributor wants to add, build, document, or submit a Lakebase example (a new example folder under a category dir + its cookbook site doc page). Orchestrates…document-lakebase-exampleAdd a Lakebase Cookbook example's documentation page to the Astro site and wire it into the sidebar, docs index, and landing-page data. Use after an example folder exists and needs to appear on lakebase-cookbook.com. Implements CONTRIBUTING.md section 4.…scaffold-lakebase-exampleScaffold a new Lakebase Cookbook example folder — a snake_case directory under a category folder (agents/, apps/, developer_experience/, data/) with a Databricks Asset Bundle (databricks.yml + resources/), pyproject.toml (uv), README.md, .env.example, and…verify-lakebase-exampleVerify a Lakebase Cookbook contribution before opening a PR — lint with ruff, validate the Databricks Asset Bundle, build the Astro site, check for committed secrets, and produce the CONTRIBUTING.md PR checklist. Use when a contributor is ready to submit or…
analyze-extraction-confidenceUse when analyzing, profiling, or thresholding confidence scores from ai_parse_document (element confidence) or ai_extract v2.1 (confidence_score with enableConfidenceScores), when deciding which documents, pages, or extracted fields need human review, or…crop-parsed-elementsUse when cropping figures, charts, tables, or other elements out of PDFs parsed with ai_parse_document (bbox coord), when extracting chart data from parsed documents or sending chart images to a vision model, or when crops come out misaligned or chart…parse-large-pdfsUse when parsing PDFs longer than 500 pages with ai_parse_document, when ai_parse_document fails on long documents, or when a document corpus mixes short files with very long ones (SEC 10-Ks, underwriting submissions, loan files, contracts, regulatory…
databricks-spark-declarative-pipelinesCreates, configures, and updates Databricks Lakeflow Spark Declarative Pipelines (SDP/LDP) using serverless compute. Handles streaming tables, materialized views, CDC, SCD Type 2, and Auto Loader ingestion patterns. Use when building data pipelines, working…databricks-synthetic-data-genGenerate realistic synthetic data using Spark + Faker (strongly recommended). Supports serverless execution, multiple output formats (Parquet/JSON/CSV/Delta), and scales from thousands to millions of rows. For small datasets (<10K rows), can optionally…databricks-zerobus-ingestBuild Zerobus Ingest clients for near real-time data ingestion into Databricks Delta tables via gRPC. Use when creating producers that write directly to Unity Catalog tables without a message bus, working with the Zerobus Ingest SDK in…
quadcopter-telemetry-genieDeploy the quadcopter flight-telemetry bundle (13 anonymised flights of a small consumer quadcopter, as Delta tables in Unity Catalog, with a Genie space over them) and explore the data with Genie, including deriving a finer wind direction from the aircraft's…video-to-3d-on-databricksReconstruct a 3D scene (camera poses, point cloud, Gaussian splat) from aerial or ground video (e.g. drones, phones, robots, vehicle cameras) on Databricks serverless GPU, publish results progressively while the job runs, and optionally update one region of…