Amazon Kinesis Firehouse

Amazon Kinesis Firehose source plugin

Amazon Kinesis Firehose is a fully managed service provided by Amazon Web Services (AWS) that enables the collection, transformation, and delivery of streaming data to various data stores and analytics services. It's designed to provide a scalable and cost-effective way to process and analyze large volumes of data in real time.

Kinesis Firehose can automatically capture streaming data from various sources, such as IoT devices, mobile applications, social media, and clickstreams, making it an ideal candidate for your telemetry data.

You can use the Amazon Kinesis Firehose source plugin to configure your Calyptia Core pipeline to collect data from your Amazon Kinesis Firehose instances.

Configuration parameters

The Amazon Kinesis Firehose source plugin provides these configuration parameters.

General

KeyDescription
PortTCP port used for listening for incoming messages.

Advanced

KeyDescription
Tag KeySpecify the key name to overwrite a tag. If set, tag is overwritten by a value of the key.
Buffer Max SizeSpecify the maximum buffer size in KB to receive a JSON message.
Buffer Chunk SizeSets the chunk size for incoming JSON messages. Chunks are then stored and managed in the space available by buffer_max_size.
Successful Response CodeAllows setting of successful response codes. Supported values: 200, 201, 204.

Security and TLS

KeyDescription
TLSEnable or disable TLS/SSL support.
TLS Certificate ValidationTurn TLS/SSL certificate validation on or off. TLS must be on for this setting to be enabled.
TLS Debug LevelSet TLS debug verbosity level. Accepts these values: 0 (No debug), 1 (Error), 2 (State change), 3 (Informational), 4 (Verbose).
CA Certificate File PathAbsolute path to CA certificate file.
Certificate File PathAbsolute path to certificate file.
Private key File PathAbsolute path to private key file.
Private Key Path PasswordOptional password for tls.key_file file.
TLS SNI Hostname ExtensionHostname to be used for TLS SNI extension.