- Print
- DarkLight
Edit Snapshot Tables or Columns
This topic is related to the following sections:
About Editing Snapshot Management Tables or Columns
On the Snapshot Datasources multi-panel page, the Snapshot Datasource Tables are maintained under the Datasource Tables panel. The Columns for each Table are maintained within the panel for Datasource Columns as shown below. The Tables and Columns behave much the same as in Catalog > Datasources for Source Datasources.
Note
Refer to section Migrate > Snapshot Management for details of the process for Adding or Removing tables in a Snapshot Datasource.
Within the Snapshot Datasource Tables grid, resides the list of the tables that have been added with description. The Snapshot Datasource Tables grid displays the following:
Heading | Definition |
---|---|
Name | The name of the table listed. |
Schema | Allows for the table to have a specific schema per table for specific table. |
Description | The description of the table. |
System Datasource | The system datasource from which the rows of data are pulled for this table. |
Record Count | The count of records currently stored in this table. |
Type | Type of Datasource table. A free form field that is part of the catalog of attributes associated with a table. |
References | This field provides a count of where this table is actively being used. |
Import Group | Identify a group name to import this table within.
|
Active For Value Mapping | Toggle to indicate that this table is a check table that is active for Value Mapping. |
System Table | The System Table associated with this table. |
Owner | Person responsible for this Datasource. |
Within the Datasource Columns grid is a list of associated columns for the highlighted table. The Datasource Columns grid displays the following:
Heading | Definition |
---|---|
Index | Sequence of the columns in the table. Value increases by a factor of 10 for each new entry. (Required) |
Name | The name for the column. |
Description | The description of the column. |
Data Type | Data type for the column. Data types are unique to the database management or software system of the datasource. |
Length | Length of the column field. |
Key Field | Toggle to indicate the table field is a key field and part of the primary key. |
Nullable | Toggle to indicate the field can contain a NULL value. |
Do Not Import | Toggle to specify that this column is not included in the XML Import scripting for the ETL.
|
Snapshot System Column Name | The Snapshot column name for this datasource column. Allows for specific renaming of fields < 30 Char for the Snapshot. |
Check Table | Provides the table used for drop down list against this column. |
Encrypt | Toggle to mark the field as using encryption. |
Deleted | Provides status of deletion of the column (See Note below). Display Only |
Note
As with any page grid of data, on the right upper corner, click the Hamburger Details icon to view the options for show or hide column, filter of rows, and column width. This is extremely handy for situations where the data is fluid and changes or when there are many records that are hard to review in the small window provided for the list. Refer to section Page Grid Options for details.
Note
Deleted field applies where a Datasource Column is added to the table within Syniti Migrate, and then selected for use in a Dataset, but the field is not actually setup in the table in the Datasource. Should the user decide to Import Metadata for this table, the field does not really exist, and therefore is removed from the table. However, if the field is selected and active in a Dataset, the system marks the field as Deleted (rather than actually remove it).
Note
At the Column level, the Do Not Import toggle allows for excluding fields that are not needed in the import of data. This is helpful for GUID type fields or for tables that contain many fields that creates long import times. The button SET DO NOT IMPORT FLAGS is used to default the Do Not Import toggle to active for ALL fields except Key fields, and then user may toggle off for the valid fields - in scenario where many fields are not relevant.
Additional Options Icon for a Snapshot Datasource Table
Within the Additional Options icon of the Snapshot Datasource Table details there are two options: Import Metadata and Repopulate Snapshot Data. Refer to section below that discusses these options and use.
Import Metadata
Builds a job queue that imports the table Metadata such as columns and constraints for each table included in the import list for this datasource table. Filtering is based upon criteria setup in Administer > Applications.
Note
The table must have valid columns setup in the database. A table without valid columns fails to import as shown below.
Repopulate Snapshot Data
Select this option to produce a job queue to refresh the data in this Snapshot Datasource table.
Build Import XML for a Snapshot Table
This process applies to Snapshot Datasources only where the ETL tool is SAP Data Services. Click the BUILD IMPORT XML button to start a job queue to generate XML scripting for this table.
Note
This is not the norm. Usually, the Datasource is set for Build Import XML for all tables. However, should a new table be added to the Snapshot Datasource, the user may build the import XML for that one table in this process. Refer to section Migrate > Snapshot Management for details on the definition and use of a Snapshot Datasource. All maintenance of Snapshot Datasources are handled within Snapshot Management pages.
See below for field definitions for adding Table XML Info:
Field | Definition |
---|---|
Datastore | Name of the Data Services Datastore from which Import Jobs pull the Source data. This Datastore is used in the Syniti Migrate automation XML. |
Import Group | Identify a group name to import this table within. (Only used for Snapshot Datasource Tables) |
Load File Date | Date when the BUILD IMPORT XML file was generated. Field is contingent upon a build executed. |
Note
The section for XML is visible within Datasource details IF the ETL Tool <> Syniti Migrate (Ex: Data Services or Informatica). If the ETL Tool field within Administer > Setup > Parameters page is set to Syniti Migrate, the XML section is hidden.
Manually Repopulate Table Data Rows
While viewing the Snapshot Datasource Details from the Snapshot Management main page snapshot tables can have data refreshed:
Click on the Repopulate icon for active tables to refresh the data.
A confirm message displays to check if you want to repopulate this table with data from the system.
Click OK to proceed.
The job queue populates the data from system datasource to snapshot datasource just as the ETL would using the Import jobs. Currently, the system can import from both RFC and ODBC connections.
Click the Debug Log icon to view details of the job including the count of records imported. In this case, the job failed to import table data for KNA1.
Edit Snapshot Table Details
The Snapshot Table Details page contains a left side panel with Table Details fields that may be edited. On the right side of this page are two tabbed pages - Columns and Constraints.
Refer to section Catalog > Datasources > Adding & Editing System Datasources > Adding & Editing Tables or Columns for details of this process. Tables and Columns are generally the same in both sections of the system. However, a Snapshot Datasource Table allows for these additional items:
Grouping the tables for use in Refreshing data from the System Datasource.
The details also contain a section for Snapshot Details specific fields for the Snapshot Datasource only and a section for Table Info.
SAP Data Services Import Group field within the Snapshot Datasource Table Details
This field assists in building out the XML scripting to support grouping Datasources into Import Groups. The field is not visible for a Working database or System Datasources. It is only relevant to the Snapshot Datasource Table Details which Imports Data. It allows for grouping of tables to allow for import and refreshing of the groups.
Snapshot Table Details
This section of the Details panel on the left side of the Snapshot Datasource Details page provides the following Snapshot only related fields:
The Link icon next to field Snapshot System Table Name opens an additional page with the same table details for the linked System Datasource table.
Heading | Definition |
---|---|
System Datasource | This drop down provides the System Datasource value. |
Snapshot System Table Name | The name for the Snapshot system table. For Oracle db limit to < 30 characters. |
Snapshot System Where Clause | A filter of the system data for import to the Snapshot Datasource provides a WHERE clause. (Ex: CLIENT = '100' and LANGU = 'E') See NOTE. |
Specific SDR Replication | Select from the list the Replication job for this Snapshot Datasource Table. |
The Specific SDR Replication icon provides each replication job built in the Syniti Replicate system to select for this Snapshot Datasource Table.
Note
The Snapshot System Where Clause filters data from the System Datasource to the Snapshot Datasource using Syniti Replicate.
Note
If the replication exists in Syniti Replicate prior to adding a value to this field, the next repopulate attempts to add the Where Clause to the replication and save the change.
Note
Once the Where Clause has been stored in the replication, this job may be run from either Syniti Replicate or from Syniti Migrate with the same outcome.
The Where Clause value is included in the Import Dataflow XML Build for the ETL. The scripting of the table within the XML displays the same Where Clause -
Within the ETL - Data Services in this case, the Query connection of system datasource table import to source datasource table now contains a Where clause statement as shown below -
Edit Snapshot Column Details
Snapshot Datasource Columns are very similar to the System Datasource Columns so refer to section Adding & Editing Columns within pathway Catalog > Datasources > Adding & Editing Tables or Columns for details and use.