Azure Event Hubs destination plugin
Azure Event Hubs is a cloud-based data streaming platform that enables you to ingest and process large volumes of event data from various sources in real-time. It lets you collect, store, and analyze data from millions of events generated by your applications and services, and enables you to take real-time actions based on that data.
Azure Event Hubs provides a highly scalable and reliable platform for event streaming. Use the Azure Event Hubs destination plugin to configure your Calyptia Core pipeline to stream your logs and metrics data directly to Azure Event Hubs.
Configuration parameters
The Azure Event Hubs destination plugin provides these configuration parameters.
General
| Key | Description |
|---|---|
| Event Hub Namespace | The EventHub Namespace that can be found within the configuration settings. |
| Event Hub Topic | The Event Hub Topic to write information to. |
| Connection String Key | The Event Hub Connection String from within the Connection Access Policy set for the source. |
Advanced
| Key | Description |
|---|---|
| Message Key | Optional Key to store the message. |
| Message Key Field | If set, the value of Message_Key_Field in the record will indicate the message key. If not set nor found in the record, Message_Key will be used (if set). |
| Timestamp Key | Set the key to store the record timestamp. |
| Timestamp Format | Set the format to iso8601 or double. |
| Body Key | Specify the key which contains the body. |
| Queue Full Retries | Fluent Bit queues data into rdkafka library, if for some reason the underlying library cannot flush the records the queue might fills up blocking new addition of records. The queue_full_retries option set the number of local retries to enqueue the data. The default value is 10 times, the interval between each retry is 1 second. Setting the queue_full_retries value to 0 sets an unlimited number of retries. |
| SASL Username | SASL username. |
| Security Protocol | This is the security protocol for Azure Event Hub. If you require OAuth or OpenID, open a support ticket prior to changing this setting. |
| SASL Mechanism | This is the transport mechanism for the SASL connection. |