- 14 Mar 2024
- 2 Minutes to read
- Contributors
- Print
- DarkLight
ETL Tasks at the Release Level
- Updated on 14 Mar 2024
- 2 Minutes to read
- Contributors
- Print
- DarkLight
This topic relates to the following sections:
Overview
ETL Jobs are accessed from all four levels of the Mappings page. Each ETL icon when clicked displays that level of the overall ETL Job with rows of Job Tasks all linked together. View the following page by navigating to Migrate > Mappings on the Syniti Migrate Homepage.
Mappings
The Release level ETL Jobs list contains a single row for each Dataset of the Release. This level can run through each Dataset conversion in sequence. It includes all steps of the conversion, refresh of all reports, and updates for all readiness flags. Each Dataset may be run or the entire Release with multiple datasets may be run in sequence. This level can run multiple Datasets in sequence of the Release.
In the example below, there are three Datasets assigned to the Release and each is listed as a Task of this Job list. The field Action provides a link to view the lower level for Dataset for the Transform Tasks. The auto generated tasks are set as Delete inactive. The Edit icon will allow for changes to Active status and comments only.
While executing the ETL Job it may be stopped at a task by editing that task to provide active Debug. Refer to section Setting a Task for Debug for details.
Mappings: Release: ETL Job List
Within header of this page there are Quick Use icons:
Icon | Name | Use |
---|---|---|
ETL Build | This icon builds or rebuilds all ETL Tasks at this level . | |
Add | This icon adds a new task to the current list. | |
Refresh | Refresh icon updates the page to the latest data. | |
Search | Allows for a search of the Tasks grid by Column. | |
Execute | The execute icon in Header runs every active task in sequence. |
The ETL Job grid displays the following Columns:
Heading | Description |
---|---|
Index | Sequence of the tasks. Value increases by a factor of 10 for each new entry. |
ETL ID | The GUID for the ETL. |
Active | Toggle to set status of the task. NOTE: Defaults as Active. |
Execute | The Execute icon runs the task in a job queue. See section Setting a Task for Debug. |
Description | The description for the task. |
Task Type | The type of task being run. (Ex: RUN_ETL, Insert Rule, Update Rule, Stored Procedure, Refresh Snapshot Table) |
Action | Action performed against the task (provides the next lower level link). |
Action Description | Provides the scripting of the task or rule name (not applicable at this level). |
Target | The target affected by the task. (Ex: Dataset) |
Data Element | The field affected by the task (not applicable at this level). |
Affected Object | The table affected by the task (not applicable at this level). |
Comment | Provides a link to detailed comments for the task. |
Record Count | Count of records affected by the last run (not applicable at this level). |
Duration | Duration of the last run. |
Status Message | If a step fails during the run, this field displays the error message for the failure. |
Created By | The user who added the task. |
Created On | The date/time the user added the task. |
Datasource | The database affected by the task. |
StatusValidation Status ID | Status of last run for the task. |
Add a Complex Rule
Refer to section ETL Tasks Add Complex Rule Manually for details of this process that works the same at all levels of the Mappings to include Release, Dataset, Target, and Source levels.
Execute the ETL Job at the Release Level
Refer to section Migrate > Mappings > Migration ETL Job > Execution of the ETL Jobs List for details of this process.