Confluent Cloud

Confluent Cloud source plugin

The Confluent Cloud source plugin lets you retrieve data from Confluent Cloud and ingest it into Telemetry Pipelines.

Configuration parameters

The Confluent Cloud source plugin provides these configuration parameters. Items in the Name column display in the Calyptia Dashboard. Items in the Key column are the YAML keys to use in pipeline configuration files.

Metadata

NameKeyDescriptionDefault
NameNamePlugin instance name for identification purposes.none

General

NameKeyDescriptionDefault
Confluent Cloud Bootstrap ServersbrokersRequired. The Confluent Cloud bootstrap found within the configuration settings.[YOUR_BOOTSTRAP_SERVER].confluent.cloud:9092
Confluent Cloud TopictopicsRequired. The Confluent Cloud Topic to read information from.none
Confluent Cloud API Keyrdkafka.sasl.usernameThe Confluent Cloud API Key.none
88Confluent Cloud API Secret**rdkafka.sasl.passwordRequired. The Confluent Cloud API Secret.none

Advanced

NameKeyDescriptionDefault
Minimum Queued Messagesrdkafka.queued.min.messagesMinimum number of messages per topic+partition Calyptia Core tries to maintain in the local consumer queue.10
Session Timeout (ms)rdkafka.session.timeout.msThe timeout associated with how long to wait prior to terminating a session connection.45000
Security Protocolrdkafka.security.protocolThis is the security protocol for Azure Event Hub. If you require OAuth or OpenID, open a support ticket prior to changing this setting.SASL_SSL
SASL Mechanismrdkafka.sasl.mechanismThe transport mechanism for the SASL connection.PLAIN

Security and TLS

NameKeyDescriptionDefault
TLStlsEnable or disable TLS/SSL support.none
TLS Certificate Validationtls.verifyTurn TLS/SSL certificate validation on or off. TLS must be on for this setting to be enabled.on
TLS Debug Leveltls.debugSet TLS debug verbosity level. Accepted values: 0 (No debug), 1 (Error), 2 (State change), 3 (Informational), 4 (Verbose).1
CA Certificate File Pathtls.ca_fileAbsolute path to CA certificate file.none
Certificate File Pathtls.crt_fileAbsolute path to certificate file.none
Private Key File Pathtls.key_fileAbsolute path to private key file.none
Private Key Path Passwordtls.key_passwdOptional password for tls.key_file file.none
TLS SNI Hostname Extensiontls.vhostHostname to be used for TLS SNI extension.none