Accessing Tasks in a Job
To access tasks in your job:- Click Jobs in the navigation bar to open the Jobs page.
- Select your job and click the Task tab to open a table of tasks for the job.
Adding a Task to a Job
To add a task to a job:- Open the Task tab for your job.
-
Select the tables that you want to add to your job from the tables list. You also can enter the name of a table in the Search field to locate a specific table.
By default, Sync displays all tables and views in the Add Tasks dialog. However, you can choose to display a list of tables only or views only by selecting the type that you want to see from the drop-down menu above the tables list.- To include all tables and views, select the checkbox next to the job source and destination at the top of the list.
- When you search or filter tables and views, schemas with no matching results are automatically hidden.
When you select Only Tables or Only Views and no list appears for the entity that you choose, the following message is displayed:
- Click Add Tasks. Sync creates tasks from the selected tables and adds them to your job.
- Select the checkbox next to individual tasks that you want to run in your job (on the Task tab). If you want to include all tasks, select the checkbox next to the job source and destination at the top of the table.
-
Run the tasks that you want by selecting the checkboxes to the left of those tasks. Then click Run in the bulk edit bar that is displayed. You can also run a specific task by clicking the Run arrow at the end of the task row.
CData Sync automatically builds the replication tasks and saves your job. When a task runs correctly, Sync displays the message
Successfulappears in the Last Run column.
- If you select the Sync All option as the replication type when you create your job, all available tables and views are added automatically as replication tasks to the job. Each time the job executes, Sync first searches for any new tables or views in your source and appends additional replication tasks to your job so that they are included in the run.
- If you want to exclude certain tasks from the job, select the tasks on the Task tab and click Exclude. When you do this, future job executions ignore those tables.
-
Click the Refresh button (
) on the Task tab to clear the metadata cache and obtain the most up-to-date table listing.
Pausing and Resuming Tasks
CData Sync enables you to pause and resume tasks. A task’s Active or Paused status only determines whether the task runs when the entire job is executed (either on a schedule or manually). However, you can still run a paused task directly at any time.Pause Tasks
To pause a task, do one of the following:-
Pause multiple tasks: From the Task tab in your job, select the checkboxes for one or more tasks. When the bulk edit bar appears at the top of the table, click Pause.
-
Pause a single task: Click the options menu (…) at the end of the task’s row and select Pause. You do not need to select the checkbox next to the task name when you use this method.
Even though a task is paused, you can still run it by selecting the task and clicking Run on the bulk edit bar or by selecting … > Run at the end of the task row.
Resume Tasks
To resume paused tasks, use either of the following methods:- Resume multiple tasks: Select the checkboxes for the tasks. Then, click Resume on the bulk edit bar.
- Resume a single task: Select … > Resume at the end of the task row. You do not need to select the checkbox next to the task name to use this method.
Task Settings
You can configure each task in your job individually by clicking a row on the Task tab. This action opens the task’s properties page where you can adjust the task settings that are described in the following sections.Source Information
The Source Information category provides an overview of the source table’s capabilities and key features:- Key/Index Column: Specifies the column or columns that make up the primary key index for the table.
- Incremental Check Column: Specifies the column that is used by CData Sync to identify new or modified records during subsequent replication intervals. See Incremental Check Column for more information.
- Captures Deletes: Specifies whether Sync can detect when data has been deleted in the source. See Deletion Captures for more information.
Destination Information
The Destination Information category gives you full control over where to land your source data. This category provides an overview of the following options:- Schema Name: The schema name is inherited from the Destination Schema advanced job option. For destinations that support multiple schemas, select from a list of available schemas in your database.
- Table Name: By default, Sync creates a new table with the same name as the source table in the target destination where you want to replicate the data. You can rename that table by clicking the edit icon in the Destination Information category and then renaming the table in the Table Name field of the Destination Information dialog.
Column Mapping
The Columns tab gives you more control over which data to retrieve from your source table and how you want that data to be represented in the target table. See Mapping Columns for information about how to remove or adjust column mappings and apply different transformations to each task.Replication Options
Replication options control the flow from your source application to your target destination. While you can set replication options in your job that affect the job as a whole, replication options that you set in the query only affect that specific query. By default, each replication option that you set in the job is inherited by each query, and any replication option that you set in the query overrides those values.Write Custom Queries
The task settings on the Overview tab automatically update the REPLICATE query as you make changes in the dialog. In addition, you can click the Query tab to edit the generated query manually. See Custom Querying: REPLICATE Command for REPLICATE command syntax; see Custom Querying: CHECKCACHE Command for CHECKCACHE command syntax. Each of these pages contain common examples, as well.Load Folder
For connectors that support the Load Folder job type, Sync enables you to configure a singleLoadFolder task that continuously replicates files from a directory or bucket into a single destination table. Connectors that support the Load Folder job type include the following:
- Amazon S3
- Azure Blob Storage
- Azure Data Lake Storage
- Azure One Lake
- CSV
- Google Cloud Storage
- Local File Storage (Sync Self-Hosted only)
LoadFolder task, it compares the last modified date of each source file to the value stored in the destination table. To help facilitate this task, Sync adds these required system columns to your destination table:
Configuring Load-Folder Task Settings
To configureLoadFolder task settings, select Load > Task Settings. The Task Settings page is divided into two categories: Source Information and Destination Information.
Click Edit (
) in the Source Information category. In the Source Information dialog, you can configure the following properties:
- Modified Action: Determines how updates are handled when a previously replicated file changes:
- APPEND: Appends all rows from the modified file.
- UPSERT: Updates existing rows and inserts new rows as needed.
- Folder: Specify the folder or subpath folder from which files are replicated.
- File Mask: Defines a search pattern to match specific file names within the folder.
) in the Destination Information category. In the Destination Information dialog, you can configure the following properties:
- Schema Name: Select one or more schemas. For destinations that support multiple schemas, you can select from a list of available schemas in your database.
- Table Name: Select the destination table name. By default, Sync creates a new table with the same name as the job name in the target destination where you want to replicate the data. You can rename the table by selecting Create New Table.