Execute Replication Jobs

Overview

Replicate Preview allows you to efficiently execute a replication job at the following levels in a workspace:

Target Level: Executes the replication job for the replications associated with one or more source datastores.
Source Level: Executes the replication job for the replications associated with the selected source datastore.
Group Level: Executes the replication job for a group of replications.
Replication Level: Executes the replication job for a single replication.

When executing a replication job for the Snapshot replication type, Replicate Preview first validates the source and target connections and truncates all the records in the target table before inserting records from the source table.

Note
If you execute replication jobs at group, source, or target level, Replicate Preview executes replications based on the priority assigned to each replication and its dependencies.

Some replications may depend on the completion of other replications. Replicate Preview honors replication dependencies and allows you to define replication dependencies, such that a replication job for a replication will only run after its dependent replications have successfully completed. Some conditions could exist, where certain replications are triggered based on the results of previous executions.

Replicate Preview organizes replication jobs across a defined number of threads, preventing the Replication Engine from being overloaded by excessive parallel processing. To achieve optimized performance when replicating large number of source tables, Replicate Preview creates an execution sequence based on the replication dependencies, replication priorities, and initial duration taken to execute each replication.

Execute a Replication Job

Replication jobs can be executed at the above-mentioned levels in a workspace, but the steps to execute it and the execution process remains the same. Replicate Preview considers your local time zone when executing replication jobs.

To execute a replication job:

Identify and select the required replication, group, source datastore, or target datastore from its corresponding panels in a workspace.
Note
Use the column filter icon of any panel to search for the required replication, group, source datastore, or target datastore. Note that names are case-sensitive.
Click the Execute Replications icon to start or execute the replication job. A confirmation dialog box is displayed.
Click Confirm. The replication job is started successfully.

For each replication job, a workflow of Replicate type is created in the Orchestrate module to store the execution history of the same replication job. Refer to Replicate Workflows in Orchestrate for more information.

After the first execution, you can validate the data replicated of the target table in your target system, (if required) modify field mappings, replication dependencies, and re-execute the replication job to replicate the data as required in the target table. Furthermore, you can schedule replication jobs to pull in the latest records from the source system or extract data from target snapshot tables for post-load reporting use case.

Replication Job Progress and Status

Whenever a replication job is executed at any level, the Progress column displays a replication job’s real-time updates. It allows you to track what operation that a replication job is processing in real-time, providing enhanced user experience through continuous feedback along with the records and its data size being processed, replication completion percentage, and duration.

Clicking a status value in the Progress column allows you to access and monitor the latest execution, view the execution history of the same replication job, and troubleshoot logs for failed executions. Once a replication job is completed, the time taken to complete the job is displayed in the Duration column of its corresponding panels.

Note
You can filter the Progress Status column by a specific status value, then use the multi-select checkboxes to select the required replications and perform bulk actions on them.

The following statuses are displayed in the Progress Status column based on the state of the replication job:

Preparing: Denotes that a replication job is performing initial analysis to execute dependent replications, pre-execution or post-execution workflows.
Queued: Denotes that a replication job is waiting in the queue to be executed when system resources become available.
Scheduled: Denotes that a replication job has been scheduled to run at a specific time but has not yet started execution.
In Progress: Denotes that a replication job for the selected object is running.
Paused: Denotes that a replication job has been temporarily suspended by the user and can be resumed to continue from where it left off.
Finalizing: Denotes that a replication job is completing its final tasks, such as cleanup operations, status updates, or post-replication workflow and verification processes.
Success: Denotes that a replication job for the selected object is completed successfully without an error.
Completed with Errors: Denotes that a replication job has run successfully; however, one or a few replications has failed. This status is not applicable when you execute a single replication.
Errored: Denotes that a replication job for the selected object is errored out.
Canceled: Denotes that a replication job for the selected object is canceled before it is completed.

View Logs for a Replication

To view or debug recent logs for the past replication executions:

In the Datastores tab, identify the required Target and Source Datastores in their corresponding panels.
In the Replications panel, select the required replication and click the Logs tab or click More Actions > Show Logs. The Execution Logs dialog box is displayed. This dialog box displays logs for the past replication executions, allowing you to troubleshoot if the execution fails.
If you want to view only replication-specific logs, turn on the Exclude Common Logs toggle button.
Note
This button filters out common logs unrelated to replication replications, such as metadata logs and logs from services running on-site.
To view logs for previous executions of the same replication, you need to access the Orchestrate module. Refer to Replicate Workflows in Orchestrate for more information.

Stop a Replication Job

Warning!
If you stop a replication job while it is running, all progress that it made will be lost.

To stop a replication job:

Identify and select the required replication, group, source, or target that is running from its corresponding panels in a workspace.
Click the Stop Execution icon. The replication job gets terminated immediately.

Replication Job Notifications

Replicate Preview sends notifications in the Syniti Knowledge Platform and via email (if you have turned on the Receive Email Notifications toggle on the My Profile page) to the user who have executed replication jobs that resulted in Error or Completed with Errors status. Refer to Notifications for more information.