ETL Tasks at the Release Level
  • 14 Mar 2024
  • 2 Minutes to read
  • Contributors
  • Dark
    Light

ETL Tasks at the Release Level

  • Dark
    Light

Article Summary

This topic relates to the following sections:

Overview

ETL Jobs are accessed from all four levels of the Mappings page. Each ETL icon when clicked displays that level of the overall ETL Job with rows of Job Tasks all linked together. View the following page by navigating to Migrate > Mappings on the Syniti Migrate Homepage.

Mappings

The Release level ETL Jobs list contains a single row for each Dataset of the Release. This level can run through each Dataset conversion in sequence. It includes all steps of the conversion, refresh of all reports, and updates for all readiness flags. Each Dataset may be run or the entire Release with multiple datasets may be run in sequence. This level can run multiple Datasets in sequence of the Release.

In the example below, there are three Datasets assigned to the Release and each is listed as a Task of this Job list. The field Action provides a link to view the lower level for Dataset for the Transform Tasks. The auto generated tasks are set as Delete inactive. The Edit icon will allow for changes to Active status and comments only.

While executing the ETL Job it may be stopped at a task by editing that task to provide active Debug. Refer to section Setting a Task for Debug for details.

Mappings: Release: ETL Job List

Within header of this page there are Quick Use icons:

Icon

Name

Use

ETL Build

This icon builds or rebuilds all ETL Tasks at this level .

Add

This icon adds a new task to the current list.

Refresh

Refresh icon updates the page to the latest data.

Search

Allows for a search of the Tasks grid by Column.

Execute

The execute icon in Header runs every active task in sequence.

The ETL Job grid displays the following Columns:

Heading

Description

Index

Sequence of the tasks. Value increases by a factor of 10 for each new entry.

ETL ID

The GUID for the ETL.

Active

Toggle to set status of the task. NOTE:  Defaults as Active.

Execute

The Execute icon runs the task in a job queue. See section Setting a Task for Debug.

Description

The description for the task.

Task Type

The type of task being run. (Ex: RUN_ETL, Insert Rule, Update Rule, Stored Procedure, Refresh Snapshot Table)

Action

Action performed against the task (provides the next lower level link).

Action Description

Provides the scripting of the task or rule name (not applicable at this level).

Target

The target affected by the task. (Ex: Dataset)

Data Element

The field affected by the task (not applicable at this level).

Affected Object

The table affected by the task (not applicable at this level).

Comment

Provides a link to detailed comments for the task.

Record Count

Count of records affected by the last run (not applicable at this level).

Duration

Duration of the last run.

Status Message

If a step fails during the run, this field displays the error message for the failure.

Created By

The user who added the task.

Created On

The date/time the user added the task.

Datasource

The database affected by the task.

StatusValidation Status ID

Status of last run for the task.

Add a Complex Rule

Refer to section ETL Tasks Add Complex Rule Manually for details of this process that works the same at all levels of the Mappings to include Release, Dataset, Target, and Source levels.

Execute the ETL Job at the Release Level

Refer to section Migrate > Mappings > Migration ETL Job > Execution of the ETL Jobs List for details of this process.


Was this article helpful?