Confluent Cloud DataSet destination plugin
The Confluent Cloud destination plugin lets you send Chronosphere Telemetry Pipeline data to Confluent Cloud.
Configuration parameters
The Confluent Cloud destination plugin provides these configuration parameters.
General
| Name | Key | Description | Default |
|---|---|---|---|
| Confluent Cloud Bootstrap Servers | brokers | Required. The Confluent Cloud bootstrap servers can be found within the cluster configuration settings. | SERVERNAME.confluent.cloud:9092 |
| Confluent Cloud Topic | topics | Required. The Confluent Cloud Topic to send information to. | none |
| Confluent Cloud API Key | rdkafka.sasl.username | Required. Confluent Cloud API Key. | none |
| Confluent Cloud API Secret | rdkafka.sasl.password | Required. The Confluent Cloud API Secret. | none |
| Format | format | Specify data a format (json or msgpack). | json |
Advanced
| Name | Key | Description | Default |
|---|---|---|---|
| Message Key | message_key | Optional Key to store the message. | none |
| Message Key Field | message_key_field | If set, the value of Message_Key_Field in the record will indicate the message key. If not set nor found in the record, Message_Key will be used if set. | none |
| Timestamp Key | timestamp_key | Set the key to store the record timestamp. | none |
| Timestamp Format | timestamp_format | Set the format to iso8601 or double. | double |
| Body Key | body_key | Specify the key which contains the body. | none |
| Queue Full Retries | queue_full_retries | Fluent Bit queues data into rdkafka library. If the underlying library can't flush the records the queue might fill and block new addition of records. This option sets the number of local retries to enqueue the data. The interval between each retry is 1 second. Setting queue_full_retries to 0 to set an unlimited number of retries. | 10 |
| Security Protocol | rdkafka.security.protocol | The Security Protocol used to communicate with Confluent Cloud. | SASL_SSL |
| SASL Mechanism | rdkafka.sasl.mechanisms | The SASL authentication mechanism for the API. | PLAIN |