S3 Input (SQS) source plugin
The S3 Input (SQS) source plugin lets you retrieve data from S3 Input (SQS) and ingest it into Telemetry Pipelines.
Configuration parameters
The S3 Input (SQS) source plugin provides these configuration parameters. Items in the Name column display in the Calyptia Dashboard. Items in the Key column are the YAML keys to use in pipeline configuration files.
Required
| Name | Key | Description | Default |
|---|---|---|---|
| AWS Access Key | aws_access_key | Required. Enter the AWS access key path. | none |
| AWS Secret Key | aws_secret_key | Required. Enter the AWS secret key path. | none |
| AWS Bucket Name | aws_bucket_name | Required. AWS S3 bucket name to fetch logs from. For example, logs. | none |
| AWS Bucket Region | aws_bucket_region | Required. AWS region where the bucket is. For example: us-east1. | none |
| AWS SQS Queue Name | sqs_queue_name | Name of the queue in SQS to use. For example, testqueue. | none |
| AWS SQS Queue Region | sqs_queue_region | Name of the region. (For example: us-east-1) | none |
| Regular Expression Object Match | match_regexp | Regular Expression used to match or exclude objects from S3 from SQS queue. | none |
| Delete Message from SQS | delete_messages | Delete the message from the SQS queue after processing. | false |
Advanced
| Name | Key | Description | Default |
|---|---|---|---|
| AWS S3 Endpoint | aws_s3_endpoint | The URL of the S3 endpoint. | none |