Amazon Kinesis Firehouse

Amazon Kinesis Firehose source plugin

Amazon Kinesis Firehose is a fully managed service provided by Amazon Web Services (AWS) that enables the collection, transformation, and delivery of streaming data to various data stores and analytics services. It's designed to provide a scalable and cost-effective way to process and analyze large volumes of data in real time.

Kinesis Firehose can automatically capture streaming data from various sources, such as IoT devices, mobile applications, social media, and clickstreams, making it an ideal candidate for your telemetry data.

You can use the Amazon Kinesis Firehose source plugin to configure your Calyptia Core pipeline to collect data from your Amazon Kinesis Firehose instances.

Configuration parameters

The Amazon Kinesis Firehose source plugin provides these configuration parameters.

General

KeyDescription
PortTCP port used for listening for incoming messages.

Advanced

KeyDescription
Tag KeySpecify the key name to overwrite a tag. If set, tag is overwritten by a value of the key.
Buffer Max SizeSpecify the maximum buffer size in KB to receive a JSON message.
Buffer Chunk SizeSets the chunk size for incoming JSON messages. Chunks are then stored and managed in the space available by buffer_max_size.
Successful Response CodeAllows setting of successful response codes. Supported values: 200, 201, 204.

Security and TLS

NameKeyDescriptionDefault
TLStlsEnable or disable TLS/SSL support.none
TLS Certificate Validationtls.verifyTurn TLS/SSL certificate validation on or off. TLS must be on for this setting to be enabled.on
TLS Debug Leveltls.debugSet TLS debug verbosity level. Accepted values: 0 (No debug), 1 (Error), 2 (State change), 3 (Informational), 4 (Verbose).1
CA Certificate File Pathtls.ca_fileAbsolute path to CA certificate file.none
Certificate File Pathtls.crt_fileAbsolute path to certificate file.none
Private Key File Pathtls.key_fileAbsolute path to private key file.none
Private Key Path Passwordtls.key_passwdOptional password for tls.key_file file.none
TLS SNI Hostname Extensiontls.vhostHostname to be used for TLS SNI extension.none