Docs Menu
Docs Home
/
Atlas
/ /

AWS S3 Connections

Atlas Stream Processing supports only sink connections to AWS S3 buckets.

To add an S3 connection to your stream processing instance's connection registry:

1

Follow the procedure described in Set Up Unified AWS Access.

Ensure that you grant your IAM role ListAllMyBuckets and PutObject permissions.

Note the ARN value in Statement.Principal.AWS for later in this procedure.

2

Warning

Navigation Improvements In Progress

We're currently rolling out a new and improved navigation experience. If the following steps don't match your view in the Atlas UI, see the preview documentation.

  1. If it's not already displayed, select your desired organization from the Organizations menu in the navigation bar.

  2. If it's not already displayed, select your desired project from the Projects menu in the navigation bar.

  3. Do one of the following steps:

    • Select Project Access from the Access Manager menu in the navigation bar.

    • Next to the Projects menu, expand the Options menu, click Project Settings, and click Access Manager in the sidebar.

    The Project Access Manager page displays.

3

The Create One Connection API endpoint requires digest authorization when creating an S3 Connection. To support this, you must create an API Key.

  1. In the Project Access Manager, select the Applications tab, then click API Keys.

  2. Click Create API Key. Provide a short description for the key.

  3. In the Project Permissions dropdown menu, select both the Project Stream Processing Owner and Project Owner roles. Click Next.

  4. Save both the public and private keys for later in this procedure.

4

The Atlas Administration API provides an endpoint to Create One Connection. You must send this request using digest authorization.

In your HTTP request interface, enable digest authorization. For the username, provide the public key you generated previously. For the password, provide the private key you generated previously.

For an AWS S3 connection, set the following key-value pairs:

Key
Value

type

"S3"

aws.roleArn

Value of the ARN noted in an earlier step.

AWS S3 sink connections support only the $emit stage, not the $merge stage. For more information, see $emit.

Back

HTTPS Connections

On this page