PMO Dashboard Metric Calculations

This topic is related to the following sections:

• PMO Dashboard

• Working with PMO Dashboard

• Execute Metric Calculations

About PMO Dashboard Metric Calculations

This section of the PMO Dashboard provides the methods by which each metric is calculated and totaled to roll up to the three main metrics of Conversion Readiness, Build Status, and Enrich Status. The metrics pull values from sections of the system including the Dataset within Dataset Design, the Mappings of the Source Datasource to Target table, the Reporting, the Enrichment, and Data Defects. There are determined values and manually input values for these metrics.

Note

Central Wave or Central Relevancy Subject Areas and Datasets are not relevant for PMO Dashboard Metric calculations when the user roles are Dataset Designer or Mapper. These objects for Central Wave will only be part of the metrics calculations for the Migration team roles such as Developer or Project Manager.

Conversion Readiness

PMO Milestone level -

The overall score for Conversion Readiness is composed of these values:

• Load Rate %

• Load Accuracy %

• Construct/Enrich %

• Defects %

The value is provided using a average percentage of the count of metric items - in this case each percentage is considered .25% of the total or EVENLY WEIGHTED.

Note

In the future, there is consideration for ability to set the weight of each metric item. 

This overall calculation is built from the following individual metrics

Load Rate = (# of records loaded) / (# relevant records)

Numerator:     COUNT of records whose zINTARGETSYS or zLOADED= 1

Denominator:     COUNT of all records in target table.

Load Accuracy = 1 - ((# of records loaded with known errors & issues) / (# records loaded))

Numerator:     COUNT of records whose (zINTARGETSYS or zLOADED= 1) AND (zREMEDIATED or zSTAGE_READY or zTARGET_READY or zDATA_READY= 0)

Denominator:     COUNT of all records in target table where (zINTARGETSYS or zLOADED= 1)

Construct/Enrich  =  (# of completed/constructed records) / (# records to be constructed/enriched)

Numerator:     COUNT of Denominator records in which zENRICH_STATUS = 'COMPLETE’.

Denominator:     COUNT of all records with zACTIVE = 1 in active Enrich tables.

Defects   = a calculated penalty determined by the team and manually entered into the Metric Execution section

Enter a value from 0 - 100 to calculate manually the Defect metric  

Milestone and Subject Area Levels

On both the Milestone and Subject Areas sections, the content of the Conversion Readiness tab displays as this example.

Note the following regarding the metric details:

• All related metrics are listed on the left-hand side. (Ex: Load Rate, Load Accuracy)

• The color of the value on these metrics should match the metric's overall threshold/alert level (red/yellow/green).

• The background color should be red when the metric itself is red.

• Clicking one of these metrics updates the chart shown on the right-hand side of the tab. 

Regarding the chart:

• The data displayed is the selected metric by the selected object's children. (Ex: Subject Areas on the milestone level)

• Items are sorted from lowest-to-highest value.

• The title of the chart is reflected in the selected metric.

• The color of each item on the chart reflects that objects threshold/alert level. (red/yellow/green)

• Hovering over an item on the chart displays the objects name and value.

• Clicking on an item "drills-into" that item (updating the dashboard so that item is now selected).

Clicking the "View Data" option replaces the tabs content with a grid, showing all related data by Dataset:

Dataset Level

The tab content on the Dataset-level is slightly different.

Functionality is largely the same as on the Milestone or Subject Area levels, though the chart is different depending on whether the selected metric is calculated at the Interface/Dataset, or the Interface Target level:

Interface-Level metrics - all Conversion Readiness metrics are included on graph, by Dataset.

Interface-Target-Level metrics - all Interface Targets are graphed, by the selected metric (see below page shot)

Build Status

PMO Milestone level -

The overall score for Build Status is composed of the 10 base metrics, rolled up into 3 top level metrics:

• Design % - Design and Mapping

• Build % - Build & Test

• Construct % - Data Construction & Enrich

The value is provided using a average percentage of the count of metric items - in this case each percentage is considered .25% of the total or EVENLY WEIGHTED.

Note

In the future, there is consideration for ability to set the weight of each metric item.

Design -

This overall calculation is built from the following individual metrics

Data Design = Step-wise based on status of Dataset:

0% =     No dataset exists.

25% = "Review Status" of "NS - Not Started".

50% = "Review Status" of "IP - In Progress".

75% = Dataset is imported into project.

100% = "Review Status" of "C - Complete" or "RR - Re-Review".

Relevancy = Percentage of datasets with completed Relevancy rule 

Either 0% or 100% based upon the field Relevancy Rule being filled in each Dataset details page / (# Datasets)

Mapping = Percentage of Mapping Opportunities whose "Map Status" field is "Complete"

(# of records mapped as Complete) / (# records)

Build -

This overall calculation is built from the following individual metrics:

Development = Percentage of all mapping opportunities whose "Build Status" field is set to "Complete"

(# of records marked as Build Complete) / (# of fields in Mapping)

TUT = Percentage of interfaces with a TUT defined

Either 0% or 100% based upon value in field TUT Completion Date stored in Dataset Design > Dataset details  / (# Datasets)

FUT = Percentage of Interfaces with a FUT defined

Either 0% or 100% based upon value in field FUT Completion Date stored in Dataset Design > Dataset details  / (# Datasets)

Reporting = Step-wise percentage based on report existence

0%     = no reports exist

25%     = unpublished reports exist

50%    = at least 1 published Preload report

75%    = at least 1 published Postload report

100%    = at least 1 published Preload and Postload report

These values per Dataset are then averaged over the total # of Datasets

Load Program = Percentage of datasets with completed Load Program

Either 0% or 100% based upon value in field Load Program stored in Dataset Design > Dataset details / (# Datasets)

Construct -

This overall calculation is built from the following individual metrics

Enrich/Construct Design = Percentage of all datasets requiring enrichment (Ex: containing either a Construct or Enrich mapping rule), which have at least one associated Construct Page

(# of records marked as Enrich/Construct with Construct Page)  / (# of records marked as Enrich/Construct)

Construct Build = Percentage of all associated Construct Pages whose 'Page Status' is set to 'Released'

(# of Construct Pages set to Released) / (# of Construct Pages for Dataset)

Note

Metric calculations for Construct Build are applied with a 80/20 margin against the calculations for Construct Design since the build is much more work than the design.

Cleansing Status

PMO Milestone level -

The overall score for Cleansing Status is composed from one metric calculation:

Cleansing Status % - % of Enrich completed over % of time used

The value is provided by calculating the Percent Work Completed / Percent Time Used.

Percent Work Completed = Percent of Total Records Marked Complete / Total Records

Percent Time Used = Percent of Construct Start Date / Construct End Date