Syniti Migrate

Maintain Working Datasources

This topic relates to the following sections:

This page contains the following sections:

About Working Datasources
Prerequisites
Add a Working Datasource
Edit a Working Datasource
Delete a Working Datasource

About Working Datasources

In the scenario where a project uses a DEV and LOAD environment, the user creates additional Datasources for working database for each environment. Within a Development Area there may be multiple environments and each is assigned a Datasource. The DEV working datasources is created manually as part of the migration build - They are critical to the mapping of fields, reporting, and XML scripting.

The Development Area is assigned to the Subject Area within Project Setup and assigned to the Dataset imported for the same subject area by default. This value determines where the SQL tables are built for the Target and Working tables of the Mapping - as part of the DDL scripting, and the Default (DEV) value is used.

This section of the system is extremely important. Each Development Area may contain multiple Environments. (Ex: wrkMDG_D and wrkMDG_L)

Prerequisites

As part of the build of a working datasource, the user manually adds the working database to the database using a prefix of WRK (this will include SQL Server, HANA DB, or Oracle Server).

The prerequisite steps are now complete.

This section refers to specifically working datasources created within the Development Areas section of the system.

Refer to section Catalog > Datasources > Adding & Editing Datasource to Add or Edit a System Datasource.
Refer to section Migrate > Snapshot Management to Add or Edit a Snapshot Datasource.
Refer to section Administer > Setup > Development Areas > Adding & Editing Report Datasource to Add or Edit a Report Datasource.

A wizard is used to create the Migration Working Datasources. The user should build each datasource from within Development Areas as they build out the Environments.

View the following page by navigating to Administer > Setup > Development Areas from Syniti Migrate Homepage or from within the Guided Setup process. Select the development area and within the panel Environment Datasources and a list of environments will display. Each Environment will link to a working datasource as shown in the image below.

Development Areas

Click the MANAGE DATASOURCES button to open the Datasource Instance Working Databases for the Development Area selected. Working datasources are provided in a grid in the Datasources panel. To add a working datasource to the Working Database, click the Add icon to start the wizard process.

Development Areas: Manage datasources

Add a Working Datasource

Click Add icon open the wizard for Create a new datasource window.

Datasource Usage Tab

This is a step by step setup that includes providing values to the Usage, Details, Connection, and Attributes tabs of the Wizard process.

The Usage tab will determine the type of Datasource (Working). These are the databases used to convert and migrate the data - Stored in Migration Working Database Application Ex; WRKOTC, WRKPTP

Datasource wizard: Add New Datasource: Usage

As the user completes field values, supportive fields will then become available for entry. The fields will vary by response of a prior field.

Section	Field	Description
Usage	Datasource Purpose*	The value will display as Working. (Required)

Click on the NEXT button to proceed to the page tab - Details.

Datasource Details Tab

The Details tab is standard for all Datasource Purpose types.

Datasources: Add New Datasource: Details

Fill in the details for the working datasource.

Section	Field	Description
Details	Application*	The Application is provided as display only.
Details	Instance*	Select the Instance. (Required)
Details	Datasource Name*	Enter the datasource name. (Required)
Details	Description	The description of the datasource.
Details	Active	Toggle to make the datasource Active/Inactive. NOTE: Defaults as Active.
Details	Environment*	Select Environment for this datasource. (Required)
Details	Comments	Enter descriptive comments to support this datasource.

NOTE: Once required fields are entered, the NEXT button will become active.

Click on the NEXT button to proceed to next page tab - Connection.

Datasource Connection Tab

Connection details are entered into this tab of the Datasource.

NOTE: Fields on the Connection tab are contingent upon the Server selected, so if there were no connection for this Datasource, the user could click on Next immediately to pass onto the tab for Attributes. The server is the Migration Working Server.

Based upon the structure of this setup, should the Connection section be left empty, the following will happen:

If the user does not provide any connection info, the connection status is set to 'unknown' (no test is performed). This allows the user to create a datasource and fill in the server later (which happens often in the field).
If the user provides server information (server name, database name) but does not provide the username and password, the system will attempt to test the connection using the credentials from the server, and will update the status accordingly.

From within the grid, if the user clicks to test a datasource that does not have server information, the system will now prompt the user to enter the connection info, and the validation status will be set to unknown. This will persist until the datasource actually has server info configured.

Select the Server from the list of servers created within the Guided Setup for Servers.

Datasources: Add New Datasource: Connection

Once a Server is selected, the associated fields and requirements will update. In this example, SQL Server is the database and the connection is one made to the Migration server. The fields and requirements may change depending upon the Server selected.

Datasources: Add New Datasource: Connection: SQL Server

Fill in the Details for this Datasource Connection.

Section	Field	Description
Connection	Server	Select from the drop-down list the available Datasource Server. Refer to section Administer > Setup > Servers for details.
Connection	Database Name*	Enter the Database Name. (Contingent upon Server) (Required)
Connection	Default Schema*	Enter the Default Schema. (Ex: dbo) (Required)
Connection	Timeout(seconds)	If a timeout other than 30 seconds is needed for this Connection, enter one otherwise leave the default as blank.
Connection	User Name	This field is contingent upon the setup of the Datasource Server and value may become required.
Connection	Password	This field is contingent upon the setup of the Datasource Server and value may become required. Click on the Show/Hide icon to view the Password entered.
XML	Datastore	Name of the Data Services Datastore from which Jobs will pull Source data. This Datastore is used in the Syniti Migrate automation XML.

NOTE: All Server and Datasource Passwords are encrypted while at rest in the Database providing a secure environment for client data and access through the Internet. Once the user Name and Password have been saved into a Datasource, only the Admin role will have access to view the Password going forward. The Show/Hide icon for viewing the password will not be available to anyone who is not provided the Role of Admin.

NOTE: The section for XML will be visible within Datasource details IF the ETL Tool <> Syniti Migrate (EX: Data Services). If the ETL Tool field within Administer > Setup > Parameters page is set to Syniti Migrate, the XML section will be hidden.

Click NEXT button to proceed to the Attributes page tab.

New Datasource Attributes Tab

The tab for Attributes is the final step in the setup for a working datasource. Entries are optional and based upon the configuration settings wiithin Administer > Advanced > Attributes.

Datasources: Add New Datasource: Attributes

Fill in the Attributes fields for this Datasource. There may be Attributes and Stakeholders stored on this tab.

Select the value for Owner which is required, and click FINISH button to Save and close the wizard.

Errors during Save

Should the Datasource have issues from the setup, an error will display and the data will not save.

Datasources: Add Datasource: Error message

Verify the Connection(s)

Upon saving the new Datasource, the user should verify that the connection is active. Select the Datasource and click on Connection Icon to initiate a check against the system. If the connection is successful a message will display "Primary - Connection success".

Datasources: Verify Connection

If the Connection is not successful, the tables and columns will not import and metadata will not process successfully. The Job Queue will run, but no outcome of data will be present. This verification is extremely important as well as the setup of the Datasource and Snapshot.

Datasources: Verify Connection: Error Messages

Subsequent Tasks

Upon saving the new Datasource, the user should attempt to Import metadata (import the tables and fields as they exist in the tables in the system identified). Refer to section Catalog > Datasources > Adding & Editing Datasources > Import metadata for details of this subsequent process in Migration.

Edit a Working Datasource

To edit an existing Working Datasource, click on the Edit icon to display the Datasource Details page.

Datasources: Edit Details

NOTE: Once the User Name and Password have been saved into a Datasource, only the Admin role will have access to view the Password going forward. The Show/Hide icon for viewing the password will not be available to anyone who is not provided the Role of Admin.

The Details page for Datasource is very similar to Instance and Application in that there is a left side panel with Details, and the tabbed section on the right side panel that contains associated object data.

Section	Field	Description
Details	Application*	Select the Application. (Display Only)
Details	Instance*	Select the Instance. (Required)
Details	Datasource Name*	Enter the datasource name. (Required)
Details	Description	The description of the datasource.
Details	Active	Toggle to make the datasource Active/Inactive. NOTE: Defaults as Active.
Details	Environment*	Select an environment.
Details	Comments	Enter descriptive comments to support this datasource.
Syniti Catalog System	Import from Catalog Systems	Toggle to indicate that this datasource links to an Agent and Connection within Knowledge Platform Data Catalog system.
Connection	Server	Select from the drop-down list the available Datasource Server. Refer to section Administer > Setup > Servers for details.
Connection	Database Name*	Enter the Database Name. (Contingent upon Server)
Connection	Default Schema*	Enter the Default Schema (Ex: dbo) Contingent upon Server
Connection	Timeout (seconds)	The number of seconds this Datasource will refresh before it is stopped. Prevents excessive clocking. The default with no value is set by the Job Queue and Job Type, but generally defaults to 30 seconds
Connection	User Name	This field is contingent upon the setup of the Datasource Server and value may become required
Connection	Password	This field is contingent upon the setup of the Datasource Server and value may become required. Click on the Eye icon to view the Password entered.
Stakeholders	Owner*	Select the Owner responsible for this Datasource. (Required)
Metadata	Import All	Toggle to flag import metadata for all tables of the Datasource.
Metadata	Last Refresh Date	Displays the last date of a refresh to import metadata for this Datasource.
SAP Data Services	Datastore	Source data. This Datastore is used in the Syniti Migrate automation XML.
SAP Data Services	CREATE SNAPSHOT TABLES	Button to create all Snapshot Datasource Tables listed within the working Database system.
SAP Data Services	BUILD IMPORT XML	Button to build the automation XML scripting for Datasource Import within the ETL.
SAP Data Services	VIEW IMPORT XML	Button to view the automation XML scripting for Datasource Import within the ETL.
Migration Details	Report Flag	Toggle to indicate that this datasource is set as Datasource Purpose of Report.
Migration Details	Working DB Flag	Toggle to indicate that this datasource is set as Datasource Purpose of Working.
Migration Details	Snapshot Flag	Toggle to indicate that this datasource is set as Datasource Purpose of Snapshot.
Audit	Various	These are the system generated values for auditing the work.

At this point, the user may add new Tables and Columns to the existing Datasource. They may also edit the details section to update field values.

The left side of the Datasource Details page will contain the Datasource Details fields. These fields are supportive of the Datasource Details, Connections, Metadata Import, Usage, Attributes, and Content Review. Each section of this panel will store valuable information. At the header of this left side panel there are quick use icons as shown below:

Icon	Name	Use
	Save	The Save icon will save the current entries.
	Cancel	The Cancel icon will leave the current page without saving changed data.
	Help	The Help icon will link to the page in Syniti help text to provide detailed explanation of this section and use.
	Additional Options	The Additional Options icon will allow for selection of: Import metadata - pull data for all active table/fields listed for this Datasource. Filtering will be based upon criteria setup in Administer > Applications View Debug Logs - Display the Debug Log for the most recent action for this datasource. View History - Provides a list of changes for this datasource.

When finished with edits, click the Save icon to complete.

Delete a Working Datasource

Should the working datasource not be needed, it may be deleted from the system if there are no tables referenced.

Datasources: Datasource: Delete

Datasources: Datasource: Delete Error message

Datasource Objects

On the right side of this page is the Tab for Tables & Columns. The Administrator or IT Lead is responsible for this tab of data. This page provides two panels - one for Datasource Tables, and one for Datasource Columns. Refer to section Catalog > Datasources > Adding & Editing Tables or Columns for more details on this topic.