Kafka source plugin
You can use the Kafka source plugin to configure Chronosphere Telemetry Pipeline to collect data from your Apache Kafka instances.
Supported telemetry types
This plugin supports these telemetry types:
| Logs | Metrics | Traces |
|---|---|---|
Configuration parameters
Use the parameters in this section to configure your plugin. The Telemetry Pipeline web interface uses the values in the Name column to describe the parameters. Items in the Key column are the YAML keys to use in pipeline configuration files.
General
| Name | Key | Description | Default |
|---|---|---|---|
| Brokers | brokers | Required. Single of multiple lists of Kafka brokers. For example, 192.168.1.3:9092, 192.168.1.4:9092. | none |
| Topics | topics | Required. Single entry or list of topics separated by comma (,) that Telemetry Pipeline uses to receive messages from Kafka. | none |
Advanced
| Name | Key | Description | Default |
|---|---|---|---|
| Minimum Queued Messages | rdkafka.queued.min.messages | Minimum number of messages per topic and partition Telemetry Pipeline tries to maintain in the local consumer queue. | 10 |
| Group ID | rdkafka.group.id | The client group ID string. All clients with the same group ID belong to the same group. | none |