Edit Snapshot Tables or Columns

This topic is related to the following sections:

• Snapshot Management

• Snapshot Datasource Build Import XML

• Snapshot Datasource View Import XML

About Editing Snapshot Management Tables or Columns

On the Snapshot Datasources multi-panel page, the Snapshot Datasource Tables are maintained under the Datasource Tables panel.  The Columns for each Table are maintained within the panel for Datasource Columns as shown below.  The Tables and Columns behave much the same as in Catalog > Datasources for Source Datasources. 

Note

Refer to section Migrate > Snapshot Management for details of the process for Adding or Removing tables in a Snapshot Datasource.

Within the Snapshot Datasource Tables grid, resides the list of the tables that have been added with description. The Snapshot Datasource Tables grid displays the following:

Within the Datasource Columns grid is a list of associated columns for the highlighted table.  The Datasource Columns grid displays the following:

Note

As with any page grid of data, on the right upper corner, click the Hamburger Details icon to view the options for show or hide column, filter of rows, and column width. This is extremely handy for situations where the data is fluid and changes or when there are many records that are hard to review in the small window provided for the list. Refer to section Page Grid Options for details.

Note

Deleted field applies where a Datasource Column is added to the table within Syniti Migrate, and then selected for use in a Dataset, but the field is not actually setup in the table in the Datasource.  Should the user decide to Import Metadata for this table, the field does not really exist, and therefore is removed from the table.  However, if the field is selected and active in a Dataset, the system marks the field as Deleted (rather than actually remove it).

Note

At the Column level, the Do Not Import toggle allows for excluding fields that are not needed in the import of data.  This is helpful for GUID type fields or for tables that contain many fields that creates long import times.  The button SET DO NOT IMPORT FLAGS is used to default the Do Not Import toggle to active for ALL fields except Key fields, and then user may toggle off for the valid fields - in scenario where many fields are not relevant. 

Additional Options Icon for a Snapshot Datasource Table

Within the Additional Options  icon of the Snapshot Datasource Table details there are two options:  Import Metadata and Repopulate Snapshot Data. Refer to section below that discusses these options and use.

Import Metadata

Builds a job queue that imports the table Metadata such as columns and constraints for each table included in the import list for this datasource table.  Filtering is based upon criteria setup in Administer > Applications.

Note

The table must have valid columns setup in the database.  A table without valid columns fails to import as shown below. 

Repopulate Snapshot Data

Select this option to produce a job queue to refresh the data in this Snapshot Datasource table.

Build Import XML for a Snapshot Table

This process applies to Snapshot Datasources only where the ETL tool is SAP Data Services. Click the BUILD IMPORT XML button to start a job queue to generate XML scripting for this table.

Note

This is not the norm. Usually, the Datasource is set for Build Import XML for all tables. However, should a new table be added to the Snapshot Datasource, the user may build the import XML for that one table in this process. Refer to section  Migrate > Snapshot Management for details on the definition and use of a Snapshot Datasource. All maintenance of Snapshot Datasources are handled within Snapshot Management pages. 

See below for field definitions for adding Table XML Info:

Note

The section for XML is visible within Datasource details IF the ETL Tool <> Syniti Migrate (Ex: Data Services or Informatica). If the ETL Tool field within Administer > Setup > Parameters page is set to Syniti Migrate, the XML section is hidden.

Manually Repopulate Table Data Rows

While viewing the Snapshot Datasource Details from the Snapshot Management main page snapshot tables can have data refreshed:

1. Click on the Repopulate icon for active tables to refresh the data.

2. A confirm message displays to check if you want to repopulate this table with data from the system.

3. Click OK to proceed.

The job queue populates the data from system datasource to snapshot datasource just as the ETL would using the Import jobs.  Currently, the system can import from both RFC and ODBC connections. 

Click the Debug Log  icon to view details of the job including the count of records imported.  In this case, the job failed to import table data for KNA1. 

Edit Snapshot Table Details

The Snapshot Table Details page contains a left side panel with Table Details fields that may be edited. On the right side of this page are two tabbed pages - Columns and Constraints.

Refer to section Catalog > Datasources > Adding & Editing System Datasources > Adding & Editing Tables or Columns for details of this process.  Tables and Columns are generally the same in both sections of the system.  However, a Snapshot Datasource Table allows for these additional items:

• Grouping the tables for use in Refreshing data from the System Datasource. 

• The details also contain a section for Snapshot Details specific fields for the Snapshot Datasource only and a section for Table Info. 

SAP Data Services Import Group field within the Snapshot Datasource Table Details

This field assists in building out the XML scripting to support grouping Datasources into Import Groups.  The field is not visible for a Working database or System Datasources.  It is only relevant to the Snapshot Datasource Table Details which Imports Data.  It allows for grouping of tables to allow for import and refreshing of the groups. 

Snapshot Table Details

This section of the Details panel on the left side of the Snapshot Datasource Details page provides the following Snapshot only related fields:

The Link  icon next to field Snapshot System Table Name opens an additional page with the same table details for the linked System Datasource table. 

The Specific SDR Replication icon provides each replication job built in the Syniti Replicate system to select for this Snapshot Datasource Table.

Note

The Snapshot System Where Clause filters data from the System Datasource to the Snapshot Datasource using Syniti Replicate.

Note

If the replication exists in Syniti Replicate prior to adding a value to this field, the next repopulate attempts to add the Where Clause to the replication and save the change.

Note

Once the Where Clause has been stored in the replication, this job may be run from either Syniti Replicate or from Syniti Migrate with the same outcome.

The Where Clause value is included in the Import Dataflow XML Build for the ETL.  The scripting of the table within the XML displays the same Where Clause -

Within the ETL - Data Services in this case, the Query connection of system datasource table import to source datasource table now contains a Where clause statement as shown below -

Edit Snapshot Column Details

Snapshot Datasource Columns are very similar to the System Datasource Columns so refer to section Adding & Editing Columns within pathway Catalog > Datasources > Adding & Editing Tables or Columns for details and use.