> ## Documentation Index > Fetch the complete documentation index at: https://docs.sync.cdata.com/llms.txt > Use this file to discover all available pages before exploring further. # Amazon S3 You can use the Amazon S3 connector from the CData Sync application to move data from any supported source to the Amazon S3 destination. To do so, you need to add the connector, authenticate to the connector, and complete your connection. ## LakeBridge Connector for Delta Parquet and Apache Iceberg The **Delta Parquet** and **Apache Iceberg** file formats require the LakeBridge connector. Before you configure the Amazon S3 destination with either of these file formats, install the LakeBridge connector in Sync. When Sync starts, it launches the LakeBridge server as a background service on the local machine. When a Delta Parquet or Apache Iceberg job runs, the LakeBridge server starts a dedicated Spark JVM for that job and shuts it down after the job finishes. This isolates each job's memory and allows multiple jobs to run in parallel with independent Spark sessions. By default, up to three LakeBridge jobs can run concurrently. You can change this limit with the `MaxConcurrentLakeBridgeJobs` setting in **System Settings** > **Advanced** > **Other Settings**. For details, see [Memory Management](https://docs.sync.cdata.com/26.4/en/getting-started/installation-and-configuration/memory-management.md). To install the LakeBridge connector:
  1. In Sync, navigate to **Connections**.
  2. Select **... > Update Connector** at the end of the Amazon S3 row. > [!NOTE] > > Before you complete this step, you must add the Amazon S3 connector. For instructions, see "Add the Amazon S3 Connector" below.
  3. Select **Add New Version** in the **Update Connector** dialog.
  4. Upload the `lakebridge.zip` file that is provided by the CData Sync support team.
  5. Click **Update**.
When you install a newer version of the LakeBridge connector, the LakeBridge server stops and restarts automatically on the next job run. A Sync restart is not required. ## Microsoft Windows Prerequisites for Delta Parquet Before you configure the Amazon S3 destination with the **Delta Parquet** file format in the Microsoft Windows operating system (OS), make sure that your environment meets the requirements explained below. These prerequisites ensure that Sync can interact correctly with Delta Lake by locating the required Hadoop binaries under Windows. Configure your Windows OS, as follows: This configuration is necessary because Delta Lake (on Spark) uses Hadoop's file system APIs to access local storage, the Hadoop Distributed File System (HDFS), and cloud object stores like Amazon S3. Under Windows, Spark must be able to locate the Hadoop binaries (including winutils.exe and other native libraries) to function correctly. Without this configuration, operations such as writing Delta tables, managing checkpoints, or accessing cloud storage can fail with permission or file-system errors. ## Supported File Formats When Sync writes data to Amazon S3, you can choose the file format for the exported data. The following file formats are supported for the Amazon S3 destination: * (Default) **Delta Parquet:** A format that uses a Delta Lake storage layer on top of the Parquet file format that is used by Sync to support delta processing. *Delta processing* is a method where, after your initial job run, only new or modified files are written or read in subsequent runs, which can reduce job times and resource use. **Limitations:** * **Naming restrictions:** Table and column names cannot include special characters or reserved SQL and Delta Lake keywords. Examples of special characters include spaces, commas, semicolons, braces, parentheses, equal signs, and the newline (`\n`) and tab (`\t`) characters. * **Primary keys:** Primary key constraints are not supported. Sync uses the source primary keys for incremental replication. * **Data types:** Unlike traditional databases, Delta Lake does not support column-size definitions (for example, `VARCHAR(100)`). It supports only a fixed set of data types and allows type widening when necessary. * **Schema changes:** The ALTER TABLE command supports only adding new columns. Changing the data type of an existing column (for example, from INT to VARCHAR) is not supported. * **Delete operations:** In standard jobs, both hard and soft deletions are supported. In CDC and enhanced CDC jobs, only soft deletions are supported. * **Apache Iceberg:** A high-performance table format that supports atomicity, consistency, isolation, and durability (ACID) transactions and schema evolution. * **CSV:** Plain text comma-separated values. * **Avro:** A row-based binary format that supports schema evolution. * **Parquet:** A columnar storage format that is optimized for analytics. ## Add the Amazon S3 Connector To enable Sync to use data from Amazon S3, you first must add the connector, as follows:
  1. Open the **Connections** page of the Sync dashboard.
  2. Click **Add Connection** to open the **Select Connectors** page.
  3. Click the **Destinations** tab and locate the **Amazon S3** row.
  4. Click the **Configure Connection** icon at the end of that row to open the **New Connection** page. This action opens the **Add Connection** dialog. **Note:** If the **Configure Connection** icon is not available, click the **Download Connector** icon to install the Amazon S3 connector.
  5. Enter a name for your connection in the **Add Connection** dialog.
  6. Click **Add** to open the **Settings** tab for your connector.
For more information about installing new connectors, see [Connections](https://docs.sync.cdata.com/26.4/en/connections/connections.md). ## Authenticate to Amazon S3 After you add the connector, you need to set the required properties. * **File Format:** Select the file format that you want to use: **Delta Parquet**, **Apache Iceberg**, **CSV** (default), **Avro**, or **Parquet**. * **URI:** Enter the path of your bucket and folder (for example, `s3://BucketName/FolderName`). * **AWS Region:** Select the hosting region for Amazon Web Services. The default region is **NORTHERNVIRGINIA**. CData Sync supports authenticating to Amazon S3 in several ways, based on the file format that you select. * [**AWS Root Keys**](#aws-root-keys) (default) * [**AWS EC2 Roles**](#aws-ec2-roles) * [**AWS IAM Roles**](#aws-iam-roles) * [**Active Directory Federation Services**](#active-directory-federation-services) * [**Okta**](#okta) * [**PingFederate**](#pingfederate) * [**AWS Temporary Credentials**](#aws-temporary-credentials) * [**AWS Credentials File**](#aws-credentials-file) * [**Azure Active Directory**](#azure-active-directory) **Note:** The full list of authentication methods above are for all file formats except **Delta Parquet**. That format uses only the **AWS Root Keys** method. ### AWS Root Keys To connect with your account root credentials, specify the following properties: * (Optional) **MFA Serial Number:** Enter the serial number for your multifactor authentication (MFA) device, if you are using such a device. * (Optional) **MFA Token:** Enter the temporary token that is available from your MFA device. * **Temporary Token Duration:** Enter the duration, in seconds, that you want for your temporary credentials. The default duration is **3600**. ### AWS EC2 Roles When you run CData Sync on an EC2 instance, CData Sync can authenticate by using the IAM role that is assigned to the instance. Select **AwsEC2Roles** for **Auth Scheme** to use that role. No additional properties are required. ### AWS IAM Roles To connect with your IAM user credentials, specify the following properties: * (Optional) **MFA Serial Number:** Enter the serial number for your multifactor authentication (MFA) device, if you are using such a device. * (Optional) **MFA Token:** Enter the temporary token that is available from your MFA device. * **Temporary Token Duration:** Enter the duration, in seconds, that you want for your temporary credentials. The default duration is **3600**. ### Active Directory Federation Services To connect with single sign-on (SSO) via Active Directory Federation Services (ADFS), specify the following properties: * **Auth Scheme:** Select **ADFS**. * **User:** Enter the username that you use to authenticate to your ADFS account. * **Password:** Enter the password that you use to authenticate to your ADFS account. * **SSO Login URL:** Enter the login URL that is used by your SSO provider. * **Use Lake Formation:** Select whether you want the AWS Lake Formation service to retrieve temporary credentials. These temporary credentials enforce access policies against the user based on the configured IAM role. You can use this service when you authenticate through AzureAD, Okta, ADFS, and PingFederate, while providing a Security Assertion Markup Language (SAML) assertion. By default, the **Enable** checkbox is not selected. * (Optional) **SSO Properties:** Enter a semicolon-separated list of the single sign-on (SSO) properties that you want to use (for example, SSOProperty1=Value1;SSOProperty2=Value2; ...). ### Okta To connect with single sign-on (SSO) via Okta, specify the following properties: * **Auth Scheme:** Select **Okta**. * **User:** Enter the username that you use to authenticate to your Okta account. * **Password:** Enter the password that you use to authenticate to your Okta account. * **SSO Login URL:** Enter the login URL that is used by your SSO provider. * **Use Lake Formation:** Select whether you want the AWS Lake Formation service to retrieve temporary credentials. These temporary credentials enforce access policies against the user based on the configured IAM role. You can use this service when you authenticate through AzureAD, Okta, ADFS, and PingFederate, while providing a Security Assertion Markup Language (SAML) assertion. By default, the **Enable** checkbox is not selected. * (Optional) **SSO Properties:** Enter a semicolon-separated list of the single sign-on (SSO) properties that you want to use (for example, *SSOProperty1*=*Value1*;*SSOProperty2*=*Value2*;...). ### PingFederate ### AWS Temporary Credentials To connect with AWS temporary credentials, specify the following properties: * **Auth Scheme:** Select **AwsTempCredentials**. * **AWS Access Key:** Enter the access key that is associated with your Amazon Web Services (AWS) account. This value is accessible from your AWS security credentials page. * **AWS Secret Key:** Enter the secret key that is associated with your AWS account. This value is accessible from your AWS security credentials page. * **AWS Session Token:** Enter your AWS session token. This token is provided with your temporary credentials. For more information, see [AWS Identity and Access Management: User Guide](https://docs.aws.amazon.com/IAM/latest/UserGuide/id_credentials_temp_use-resources.html). ### AWS Credentials File To connect with a credentials file, specify the following properties: ### Azure Active Directory To connect with an Azure Active Directory (AD) user account, specify the following properties: * **Auth Scheme:** Select **AzureAD**. * **Use Lake Formation:** Select whether you want the AWS Lake Formation service to retrieve temporary credentials. These temporary credentials enforce access policies against the user based on the configured IAM role. You can use this service when you authenticate through AzureAD, Okta, ADFS, and PingFederate, while providing a Security Assertion Markup Language (SAML) assertion. By default, the **Enable** checkbox is not selected. * **OAuth Client Id:** Enter the client Id that you were assigned when you registered your application with an OAuth authorization server. * **OAuth Client Secret:** Enter the client secret that you were assigned when you registered your application with an OAuth authorization server. ## Complete Your Connection To complete your connection: 1. Specify the following properties: **For all formats:** (Optional) **Storage Base URL:** Enter the URL of your cloud-storage service provider. **For the Delta Parquet, Apache Iceberg, and CSV file formats only:** * **FMT:** Enter the format that you want to use to parse all text files. The default format is **CsvDelimited**. * **Aggregate Files:** Specify whether you want to aggregate all the files that are located in the URI directory and that have the same schema into a single table named AggregatedFiles. The default option is **False**. * **Include Column Headers:** Select whether you want to obtain column headers from the first lines of the specified files. By default, the **Enable** checkbox is already selected. **For all file formats except Delta Parquet:** * **Data Model:** Select the data model that you want to use to parse documents for your format and to generate the database metadata. The default data model is **Document**. * **Aggregate Files:** Select whether you want to aggregate all the files that are located in the URI directory and that have the same schema into a single table named AggregatedFiles. By default, the **Enable** checkbox is not selected.
  1. Define advanced connection settings on the **Advanced** tab. (In most cases, though, you should not need these settings.)
  2. Click **Create & Test** to create your connection.
This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.