Complimentary Gartner® Report! 'A CTO's Guide to Open-Source Software: Answering the Top 10 FAQs.'Read more

AWS S3

Supported Types

MetricsLogsTraces
✓✓✓

​The AWS S3 destination saves telemetry into timestamped JSON files in an S3 bucket.
​

Configuration

ParameterTypeDefaultDescription
telemetry_types*telemetrySelector["Logs", "Metrics", "Traces"]Specifies which types of telemetry to export.
region*enumus-east-1AWS region of the bucket to export telemetry to.
bucket*string""Name of the S3 Bucket to export telemetry into.
prefixstring""The root directory of the bucket to export telemetry into.
file_prefixstring""Prefix for the name of exported telemetry files.
granularity*enumminuteThe granularity of the timestamps in the S3 key, either "minute" or "hour".
*required field

Credentials

​
With AWS S3, users are required to provide some form of authentication. There are two ways to configure this: either entering profile credentials manually or using the CLI, or environment variables that specify access keys for user accounts.
​

note

In the AWS CLI getting started guide it will instruct you to install for your current user or all users.
The observIQ OTel Collector runs as root by default, meaning the AWS CLI and credentials should be installed under the collector system's root account.

CLI

The easiest way to configure this is using the aws CLI program provided by AWS. The AWS CLI Getting Started guide describes how to install the CLI and configure it with credentials. The AWS S3 destination uploads telemetry to the specified bucket, so the credentials configured should be associated with an account that has s3:PutObject permissions for that bucket.

Environment Variables

Alternatively, AWS Environment variables can be specified to override a credentials file. You can modify the collector's environment variables by configuring a systemd override.
Run sudo systemctl edit observiq-otel-collector and add your access key, secret key, and region:

text
1[Service]
2Environment=AWS_ACCESS_KEY_ID=******
3Environment=AWS_SECRET_ACCESS_KEY=******
4Environment=AWS_DEFAULT_REGION=us-east-1

After making that change, reload Systemd and restart the collector service.

bash
1sudo systemctl daemon-reload
2sudo systemctl restart observiq-otel-collector