Target Report Remediation

This topic is related to the following sections:

• Mappings

• Create Reports

• Maintain Target Reports

• Reporting Features

About Target Report Remediation

Target Report Remediation is the act of running a target report against a field contains Check Table values or Required values in order for the data to save in the load to the target system. The remediation of a field reports the invalid entry, and then as a secondary step, update the field to a valid entry that prevents the record from failing due to this field.

The theory is to prevent unnecessary errors during loading to the target system. Fields marked for Remediation have the following criteria:

• The field is a required field in the target system

• The field remediation must not also produce an error.

The Remediation process supports Dynamic Remediation (Use of sub views in the report to provide a min value or a value that depends upon other values, etc.). Remediations are based upon the selected 'Remediation Field' that is stored within the Target Report Details page.

Dynamic Remediation - the remediated value is derived and may be contingent upon other criteria. The user must build the remediation to supply a correct value for each situation.

• An example would be defaulting the correct State value based upon the Country value - Calculate it as (MIN(REGIO) where COUNTRY = xxx).

• Another example is to set a static value as the aliased field within the view - 'US' as Country

In the case of a Dynamic Remediation, the user builds an additional view using the _010 extension that is added to the report. This view determines a value to load as the remediated value. The Remediated Value field has an alias of "XX_REMEDIATE" where the XX represents the field to remediate. The field Remediate Value is left blank within Migration Report Details page.

Project Setup Release Remediation

Target Report Remediation is activated at the Release level within Project Setup. In this way, the entire Release has active or inactive remediation. During the first few Mock loads, the remediation flag in the Release should be toggled active as shown below:

Within the Project Setup page, each Release provides a Toggle for Remediation.

If the Remediation toggle is on the Project Setup page is set to active, all reports with remediation of a field display the field and the remediated field as shown below. Downloading this report provides the same columns.

If the Remediation toggle on the Project Setup page is set to inactive, all reports with remediation of a field display without the remediated field column, and downloads of the reports do not include the remediated column.

Target Report Remediation fields

Follow pathway:  Migrate > Mappings > Targets > Reports to view this section.

Select a report of type that provides for remediation (See section Readiness Flags for Reporting and Remediation) and click on the Edit  icon to view the details. Within target report details, the user may elect to enter a Remediation Field value. Should remediation be set to active at the Release level, the conversion process runs these reports capturing the records that are invalid or missing a value.

Note

If the field for remediation update (Ex: ABDC_REMEDIATE) is not included within the report view, the Save fails.

Remediation Execution Flag

Target reports that have a remediation field value assigned, and the proper set up of the associated view, display in the Target Reports page with a Remediation Field icon. Once the ETL is processed, should the report contain rows of data for remediation, this icon displays as a Processed Remediation Field icon. The date of processing and count of records updated is provided in the hover details for the icon.

If the Remediation toggle on the Project Setup page is set to inactive, the ETL processing displays the Remediate Execution Flag as not processed.

Note

If the Target Reports Refresh icon or Refresh All Reports button is executed, these remediation values are reset to blank. The refreshing of reports through Target Reports page only updates the report, and does not process remediation.

Remediation Report Details

During the execution of ETL processing either through Data Services or within Migrate these remediation reports update the Remediate Field with the Remediate Value in the target table. This may over write an invalid entry or enter a value where the field is null or blank.

Within SQL Server, database REPORT stores the target reports and the snapshot of the data stored at the time it was run. This stores the information from prior to the Remediation update that changes field values.

Readiness Flags for Reporting and Remediation

Finally, the target table for the conversion also stores details of the remediation. During the processing in the ETL, an update rule adds the Error Log messages stored at the Report level within field Error Log Msg. For those fields that are remediated, the Error Message contains both the Type of Report and an 'R' to indicate that Remediation was run for that field. Within section Administer > Advanced > Report Types the Stage Ready Report Type defaults as allow remediation.

This action is modifiable for the remaining reports.

Target Report Types are:

B - Business Ready

D - Data Ready

S - Stage Ready

T - Target Ready

Field ZERROR_LOG concatenates all of the errors produced during the running of target reports into the field.