Amazon Kinesis Firehose source plugin
Amazon Kinesis Firehose is a fully managed service provided by Amazon Web Services (AWS) that enables the collection, transformation, and delivery of streaming data to various data stores and analytics services. It's designed to provide a scalable and cost-effective way to process and analyze large volumes of data in real time.
Kinesis Firehose can automatically capture streaming data from various sources, such as IoT devices, mobile applications, social media, and clickstreams, making it an ideal candidate for your telemetry data.
You can use the Amazon Kinesis Firehose source plugin to configure your Calyptia Core pipeline to collect data from your Amazon Kinesis Firehose instances.
Configuration parameters
The Amazon Kinesis Firehose source plugin provides these configuration parameters.
General
| Key | Description |
|---|---|
| Port | TCP port used for listening for incoming messages. |
Advanced
| Key | Description |
|---|---|
| Tag Key | Specify the key name to overwrite a tag. If set, tag is overwritten by a value of the key. |
| Buffer Max Size | Specify the maximum buffer size in KB to receive a JSON message. |
| Buffer Chunk Size | Sets the chunk size for incoming JSON messages. Chunks are then stored and managed in the space available by buffer_max_size. |
| Successful Response Code | Allows setting of successful response codes. Supported values: 200, 201, 204. |
Security and TLS
| Key | Description |
|---|---|
| TLS | Enable or disable TLS/SSL support. |
| TLS Certificate Validation | Turn TLS/SSL certificate validation on or off. TLS must be on for this setting to be enabled. |
| TLS Debug Level | Set TLS debug verbosity level. Accepted values: 0 (No debug), 1 (Error), 2 (State change), 3 (Informational), 4 (Verbose). |
| CA Certificate File Path | Absolute path to CA certificate file. |
| Certificate File Path | Absolute path to certificate file. |
| Private key File Path | Absolute path to private key file. |
| Private Key Path Password | Optional password for tls.key_file file. |
| TLS SNI Hostname Extension | Hostname to be used for TLS SNI extension. |