Data Quality

The Data Quality Parameters allow you to configure settings specific to the Quality module of the Syniti Knowledge Platform, specifically to

• Limit the number of records downloaded to the data store

• Limit the number of records returned by a query

• Enable and configure data retention to clean up historical data

To configure data quality parameters:

1. Verify you’re in the Admin module of the Syniti Knowledge Platform.
   Or
   Select Admin from the Profile menu to navigate to the Admin module of the Syniti Knowledge Platform.

2. Under Parameters, click Data Quality in the Admin menu.

3. Click the Edit Parameters icon.

For details about a specific field, hover over the Help icon.

For more information about data quality parameters, click the Page help icon on the Navigation menu.

Clean Up Historical Data

View historical data on the Execution History tab of an implementation. If historical data quality failed data is not cleaned up, it eventually will cause problems, such as running out of disk space or incurring incrementally high storage costs.

There are two ways to clean up historical failed data quality data:

1. Utilize the data retention settings in the Syniti Knowledge Platform

2. Use Amazon S3 or Azure Container settings to manage retention. Or, if using MS SQL Server as a data store, create a process to drop old tables on a periodic basis.

To utilize the data retention settings in the Syniti Knowledge Platform to clean up historical data:

1. Verify you’re in the Admin module of the Syniti Knowledge Platform.
   Or
   Select Admin from the Profile menu to navigate to the Admin module of the Syniti Knowledge Platform.

2. Under Parameters, click Data Quality in the Admin menu.

3. Click the Edit Parameters icon.

4. Turn on Enable Retention.

5. Populate the Failed Data Retention Period in Days and the Execution History Display Period in Days fields.

6. Click Save.

For details about a specific field, hover over the Help icon.

For more information about data quality parameters, click the Page help icon on the Navigation menu.

Test Data Retention Permissions

Test the permissions on the data quality retention data store to ensure the configuration has permissions to remove files or tables. In order to be able to delete files (S3 or Azure) or tables (MS SQL Server), the credentials used in the data store must have the required access to perform the deletion. If not, the Syniti Knowledge Platform will attempt to delete and will fail due to an authorization issue.

To test the retention parameters:

1. Verify you’re in the Admin module of the Synit Knowledge Platform.
   Or
   Select Admin from the Profile menu to navigate to the Admin module of the Syniti Knowledge Platform.

2. Under Parameters, click Data Quality in the Admin menu.

3. Click the Test retention permissions button.

This process creates and deletes a file or table from the data store to verify the permissions of the data store.

For details about a specific field, hover over the Help icon.

For more information about data quality parameters, click the Page help icon on the Navigation menu.