Confluent Cloud source plugin
The Confluent Cloud source plugin lets you retrieve data from Confluent Cloud and ingest it into Chronosphere Telemetry Pipeline.
Configuration parameters
The Confluent Cloud source plugin provides these configuration parameters. Items in the Name column display in the Calyptia Dashboard. Items in the Key column are the YAML keys to use in pipeline configuration files.
General
| Name | Key | Description | Default |
|---|---|---|---|
| Confluent Cloud Bootstrap Servers | brokers | Required. The Confluent Cloud bootstrap found within the configuration settings. | [YOUR_BOOTSTRAP_SERVER].confluent.cloud:9092 |
| Confluent Cloud Topic | topics | Required. The Confluent Cloud Topic to read information from. | none |
| Confluent Cloud API Key | rdkafka.sasl.username | The Confluent Cloud API Key. | none |
| Confluent Cloud API Secret | rdkafka.sasl.password | Required. The Confluent Cloud API Secret. | none |
Advanced
| Name | Key | Description | Default |
|---|---|---|---|
| Minimum Queued Messages | rdkafka.queued.min.messages | Minimum number of messages per topic+partition Calyptia Core tries to maintain in the local consumer queue. | 10 |
| Session Timeout (ms) | rdkafka.session.timeout.ms | The timeout associated with how long to wait prior to terminating a session connection. | 45000 |
| Security Protocol | rdkafka.security.protocol | This is the security protocol for Azure Event Hub. If you require OAuth or OpenID, open a support ticket prior to changing this setting. | SASL_SSL |
| SASL Mechanism | rdkafka.sasl.mechanism | The transport mechanism for the SASL connection. | PLAIN |
Security and TLS
| Name | Key | Description | Default |
|---|---|---|---|
| TLS | tls | Enable or disable TLS/SSL support. | none |
| TLS Certificate Validation | tls.verify | Turn TLS/SSL certificate validation on or off. TLS must be on for this setting to be enabled. | on |
| TLS Debug Level | tls.debug | Set TLS debug verbosity level. Accepted values: 0 (No debug), 1 (Error), 2 (State change), 3 (Informational), 4 (Verbose). | 1 |
| CA Certificate File Path | tls.ca_file | Absolute path to CA certificate file. | none |
| Certificate File Path | tls.crt_file | Absolute path to certificate file. | none |
| Private Key File Path | tls.key_file | Absolute path to private key file. | none |
| Private Key Path Password | tls.key_passwd | Optional password for tls.key_file file. | none |
| TLS SNI Hostname Extension | tls.vhost | Hostname to be used for TLS SNI extension. | none |