| name | component-search |
| description | This skill should be used when users need to discover Redpanda Connect components for their streaming pipelines. Trigger when users ask about finding inputs, outputs, processors, or other components, or when they mention specific technologies like "kafka consumer", "postgres output", "http server", or ask "which component should I use for X". |
Redpanda Connect Component Search
Help users discover the right Redpanda Connect components for their streaming pipeline needs.
Objective
Find and recommend the most relevant components that match the user's natural language query.
Provide enough information for users to understand what each component does, how to configure it, and why it matches their needs.
Prerequisites
This skill requires: rpk, rpk connect, python3.
See the SETUP for installation instructions.
Component Categories
Redpanda Connect has 8 types of components:
- inputs - Read data from sources (Kafka, HTTP, files, databases, etc.)
- outputs - Write data to destinations (Kafka, S3, databases, etc.)
- processors - Transform, filter, or enrich messages (mapping, filtering, etc.)
- caches - Store data for lookups (Redis, in-memory, etc.)
- rate-limits - Control throughput (local, Redis-based, etc.)
- buffers - Queue messages between pipeline stages
- metrics - Export metrics (Prometheus, CloudWatch, etc.)
- tracers - Export traces (Jaeger, OTLP, etc.)
Tools
Component Discovery
Lists all available components in a category using rpk.
rpk connect list <category>
rpk connect list inputs
rpk connect list outputs
rpk connect list processors