Skip to main content

​
Overview

Amazon Simple Storage Service (S3) is an object storage service offering industry-leading scalability, availability, and durability. Datazone provides native integration with AWS S3 to read data files directly from your S3 buckets.

​
Connection Parameters

​
Required Permissions

The AWS IAM user account needs the following permissions on the specified S3 bucket:
  • s3:GetObject - For reading files from the bucket
  • s3:ListBucket - For listing contents of the bucket
  • s3:GetBucketLocation - For determining the bucket’s region

​
Limitations

Be aware of the following limitations when working with AWS S3 CSV sources:
  • CSV, TXT, Parquet, JSON files are supported
  • UTF-8 encoding is recommended
  • Individual file size limits apply based on your AWS S3 configuration
  • The S3 bucket and Datazone instance should ideally be in the same region for optimal performance
  • Cross-region access may incur additional AWS charges

​
Next Steps

After configuring your AWS S3 source:
  1. Create extracts to specify which CSV files to ingest
  2. Configure scheduling for recurring extracts
  3. Integrate the source into your data pipelines
For more information about working with extracts and pipelines, refer to their respective documentation sections.