S3 Input (SQS) source plugin
The S3 Input (SQS) source plugin lets you retrieve data from S3 Input (SQS) and ingest it into Telemetry Pipeline.
Supported telemetry types
This plugin supports these telemetry types:
| Logs | Metrics | Traces |
|---|---|---|
Configuration parameters
Use the parameters in this section to configure your plugin. The Telemetry Pipeline web interface uses the values in the Name column to describe the parameters. Items in the Key column are the YAML keys to use in pipeline configuration files.
Required
| Name | Key | Description | Default |
|---|---|---|---|
| AWS Access Key | aws_access_key | Required. Your AWS access key path. | none |
| AWS Secret Key | aws_secret_key | Required. Your AWS secret key path. | none |
| AWS Bucket Name | aws_bucket_name | Required. The name of the AWS S3 bucket to fetch logs from. For example, logs. | none |
| AWS Bucket Region | aws_bucket_region | Required. The name of the AWS region where the bucket is. For example: us-east1. | none |
| AWS SQS Queue Name | sqs_queue_name | The name of the queue in SQS to use. For example, testqueue. | none |
| AWS SQS Queue Region | sqs_queue_region | The name of the region. For example, us-east-1. | none |
| Regular Expression Object Match | match_regexp | The regular expression used to match or exclude objects from S3 from SQS queue. | none |
| Delete Message from SQS | delete_messages | Whether to delete the message from the SQS queue after processing. | false |
Advanced
| Name | Key | Description | Default |
|---|---|---|---|
| AWS S3 Endpoint | aws_s3_endpoint | The URL of the S3 endpoint. | none |