Redpanda Cloud DataSet destination plugin

The Redpanda Cloud destination plugin lets you send Chronosphere Telemetry Pipeline data to the Redpanda Cloud service.

Configuration parameters

The Redpanda Cloud destination plugin provides these configuration parameters.

General

NameKeyDescriptionDefault
BrokersbrokersRequired. List of Kafka Brokers. For example, 192.168.1.3:9092, 192.168.1.4:9092none
TopicstopicsRequired. Single entry or comma-separated list of topics that Fluent Bit uses to send messages to Kafka. If only one topic is set, that one will be used for all records. If multiple topics exist, the topic set in the record by Topic_Key is used.calyptia-core
FormatformatRequired. Specify a data format (msgpack or json).json

Advanced

NameKeyDescriptionDefault
Security Protocolrdkafka.security.protocolThe Security Protocol used to communicate with Redpanda.sasl_ssl
SASL Mechanismrdkafka.sasl.mechanismsThe SASL authentication mechanism for the API.SCRAM-SHA-256
Redpanda Usernamerdkafka.sasl.usernameYour Redpanda username.none
Redpanda Passwordrdkafka.sasl.passwordRequired. Password for your Redpanda username.none
Message Keymessage_keyOptional Key to store the message.none
Message Key Fieldmessage_key_fieldIf set, the value of Message_Key_Field in the record will indicate the message key. If not set nor found in the record, Message_Key will be used if set.none
Timestamp Keytimestamp_keySet the key to store the record timestamp.none
Timestamp Formattimestamp_formatSet the format to iso8601 or double.double
Body Keybody_keySpecify the key which contains the body.none
Queue Full Retriesqueue_full_retriesFluent Bit queues data into rdkafka library. If the underlying library can't flush the records the queue might fill and block new addition of records. This option sets the number of local retries to enqueue the data. The interval between each retry is 1 second. Setting queue_full_retries to 0 to set an unlimited number of retries.10