Note
The SAP Data Services ETL Tool is deprecated. It is recommended to use Syniti Migrate as the preferred ETL tool going forward. While the SAP Data Services integration and documentation is retained for the existing implementations, new implementations should use Syniti Migrate for all ETL-related processes.
The Datasources page in Catalog > Datasources lists all datasources with specific Datasource Purpose configured within Migrate using the system and datastore components from the SKP Catalog module. Refer to the Datasource Purpose section for more information.
To view details of the datasources, click on the Edit 
icon to display the Datasource Details page. The details of the datasource depend upon the type of datasource as a System, Migrate, Report, Snapshot, or Working type.
For the Datasource with the Snapshot datasource purpose, the Snapshot Datasource Tables (Replications) are maintained in the Snapshot Management workspace. Refer to Snapshot Management Workspace for more information.
Datasources: Datasource Details: Tables and Columns
Within the Snapshot Datasource Tables grid, resides the list of the tables that have been added with description. The Snapshot Datasource Tables grid displays the following:
Heading | Definition |
|---|---|
Name | The name of the table listed. |
Schema | Allows for the table to have a specific schema per table for specific table. |
Description | The description of the table. |
Record Count | The count of records currently stored in this table. |
Type | Type of Datasource table. A free form field that is part of the catalog of attributes associated with a table. |
References | This field provides a count of where this table is actively being used. |
Import Group | Identify a group name to import this table within. Refer to the SAP Data Services Import Group section for more information. |
Active For Value Mapping | Toggle to indicate that this table is a check table that is active for Value Mapping. |
Active | Toggle to include this table in replication. |
Within the Datasource Columns grid is a list of associated columns for the highlighted table. The Datasource Columns grid displays the following:
Heading | Definition |
|---|---|
Index | Sequence of the columns in the table. Value increases by a factor of 10 for each new entry. (Required) |
Name | The name for the column. |
Description | The description of the column. |
Data Type | Data type for the column. Data types are unique to the database management or software system of the datasource. |
Length | Length of the column field. |
Key Field | Toggle to indicate the table field is a key field and part of the primary key. |
Nullable | Toggle to indicate the field can contain a NULL value. |
Do Not Import | This toggle was previously used to exclude columns from being imported during replication. This functionality has been replaced by the Field Mappings feature in the Replications panel. Refer to Performing Field Mappings for more information.
|
Check Table | Provides the table used for drop down list against this column. |
Encrypt | Toggle to mark the field as using encryption. |
Deleted | Provides status of deletion of the column (See Note below). Read-Only |
Columns in grids throughout the Syniti Knowledge Platform (SKP) can be individually customized, sorted, and filtered. You can also search for names or values for in columns that have the Search feature enabled. The selected settings are remembered per user. Refer to SKP Grid Searching, Sorting, and Filtering for more information.
Note
Deleted field applies where a Datasource Column is added to the table within Syniti Migrate, and then selected for use in a Dataset, but the field is not actually setup in the table in the Datasource. Should the user decide to Import Metadata for this table, the field does not really exist, and therefore is removed from the table. However, if the field is selected and active in a Dataset, the system marks the field as Deleted (rather than actually remove it).
Note
At the Column level, the Do Not Import check box indicates whether fields are excluded from data import. This is helpful for GUID-type fields or for tables that contain many fields that create long import times.
Build Import XML for a Snapshot Table
This process applies to Snapshot Datasources only where the ETL tool is SAP Data Services. Click the BUILD IMPORT XML button to start a job queue to generate XML scripting for this table.
Note
This is not the norm. Usually, the Datasource is set for Build Import XML for all tables. However, should a new table be added to the Snapshot Datasource, the user may build the import XML for that one table in this process. Refer to Snapshot Management Workspace for details on the definition and use of a Snapshot Datasource. All maintenance of Snapshot Datasources are handled within Snapshot Management pages.
Datasource: Edit Details: BUILD IMPORT XML
See below for field definitions for adding Table XML Info:
Field | Definition |
|---|---|
Datastore | Name of the Data Services Datastore from which Import Jobs pull the Source data. This Datastore is used in the Syniti Migrate automation XML. |
Import Group | Identify a group name to import this table within. (Only used for Snapshot Datasource Tables) |
Load File Date | Date when the BUILD IMPORT XML file was generated. Field is contingent upon a build executed. |
Note
The section for XML is visible within Datasource details IF the ETL Tool <> Syniti Migrate (Ex: Data Services or Informatica). If the ETL Tool field within Administer > Setup > Parameters page is set to Syniti Migrate, the XML section is hidden.
Edit Table Details
The Table Details page contains a left side panel with Table Details fields that may be edited. On the right side of this page are two tabbed pages - Columns and Constraints.
Refer to section Catalog > Datasources > Adding & Editing System Datasources > Adding & Editing Tables or Columns for details of this process. Tables and Columns are generally the same in both sections of the system. However, a Snapshot Datasource Table includes the following items:
Grouping the tables for use in Refreshing data from the System Datasource.
The details also contain a section for Snapshot Details specific fields for the Snapshot Datasource only and a section for Table Info.
SAP Data Services Import Group field within the Snapshot Datasource Table Details
This field assists in building out the XML scripting to support grouping Datasources into Import Groups. The field is not visible for a Working database or System Datasources. It is only relevant to the Snapshot Datasource Table Details which Imports Data. It allows for grouping of tables to allow for import and refreshing of the groups.
Snapshot Datasource Details: Import Group field
Table Details
This section of the Details panel on the left side of the Snapshot Datasource Details page provides the following read-only replication related fields:
Snapshot Datasource Details: Snapshot Details
The Snapshot System Where Clause field populates filter conditions from a Replication’s Source Filter field in the workspace. If the replication exists in Syniti Replicate prior to adding a value to this field, the next repopulate attempts to add the Where Clause to the replication and save the change.
The Where Clause value is included in the Import Dataflow XML Build for the ETL. The scripting of the table within the XML displays the same Where Clause -
Snapshot Datasource: View XML for Dataflow
Within the ETL - Data Services in this case, the Query connection of system datasource table import to source datasource table now contains a Where clause statement as shown below -
ETL: Import Dataflow: Where Clause