Key Features
- Change Data Capture: offers change data capture (CDC) across multiple data warehouses, which enables you to move data where you need it without overextending resources to do so.
- Events: uses events to incorporate external information into your data pipeline flow. Events provide flexibility around performing stored procedures before and after your jobs.
- Clustering: Scalability is important so you can meet demand without sacrificing performance or availability. offers clustering deployment options for all types of data needs. Clustering provides better scalability by distributing job execution between each node.
- Host On-Premises or in the Cloud: You can deploy where you need your data pipelines executed, whether your systems are on-premises or in the cloud.
- Incremental Replication: retrieves only changesets to minimize bandwidth use and latency of synchronization.
- Logging and Transaction Monitoring: enables you to monitor changes that are made to the database and the data source.
- Point-and-Click Configuration: administration is simple, with straightforward job scheduling and data transformations.
- Replication to Major Data Warehouses: supports popular databases like SQL Server, PostgreSQL, Snowflake, Amazon, and so on.
- Single Sign-On: supports single sign-on through OAuth in order to prevent password fatigue and to ensure enterprise security.
- Standard Enterprise-Class Security Features: offers encrypted client-server communications by using either the Transport Layer Security (TLS) protocol or the Secure Sockets Layer (SSL) protocol, depending on which protocol is supported.
- Transformations: offers multiple ways to perform advanced transformations across your data in preparation for use in analytics, machine-learning algorithms, and more.
Core Concepts
- Connection: A connection is a link either to a source or to a destination. For more information, see Connections.
- Connector: A connector is a specific connection type. For example, you can make multiple connections to different Salesforce accounts by using the Salesforce connector. For more information, see Connections and Jobs.
- Destination: A destination connection is the location to which your data flows. For more information, see Destinations.
- Event: An event provides the ability to integrate external information into data-flow tasks. offers pre-job and post-job events. These events enable you to inject query parameters or to trigger other external processes by using APIScript, an XML-based language that is included with . For more information, see Events.
- Job: A job is a unit of execution that includes the source connection, the destination connection, and a set of one or more tasks that represent data flows for different tables. For more information, see Jobs.
- Source: A source connection is the origin from which your data flows. For more information, see Sources.
- Tasks: A task is an assigned unit of work that accomplishes an activity. In , tasks control the data flow from a source into a destination table. For more information, see Tasks.
- Transformation: A transformation is the ability to manipulate the format of the data so that it is in the state that you want in order to use it. offers in-flight and post-job transformation capabilities with advanced SQL queries and dbt core or dbt cloud integrations. For more information, see Transformations.
Quick-Start Guide
This section provides links to specific sections of documentation that explain how to use the application. In addition, you can find support resources in the Getting Support section.
Supported Web Browsers
You access the web UI through a web browser. supports the following browsers:
- Google Chrome
- Microsoft Edge
- Mozilla Firefox
- Safari
Other browsers might not support all features. As a result, strongly recommends that you use a browser from the list of supported browsers.
Using
- See Creating Connections for instructions about how to create connections to sources and destinations.
- See Adding a New Job for information about how to create a job.
- See Transformations for information about configuring ELT and ETL transformations.
- See REST API for a full list of actions and parameters that the Admin API supports.
Getting Support
For assistance with using , use either of these resources:- This documentation, which provides detailed information about each feature of the platform as well as how to use and configure them.
- Technical Support