In this section: |
This section describes how to build your first Plan using iWay Data Quality Center (DQC).
Perform the following steps to start iWay Integration Tools and access the DQC Explorer.
To start iWay Integration Tools:
C:\Program Files\iWay60\iIT_DQC
During the startup sequence, the Workspace Launcher dialog box is displayed and prompts you to select a workspace location. For example:
iWay Integration Tools opens, as shown in the following image.
By default, DQC Explorer is located in the left pane, as shown in the following image.
Perform the following steps to create a new project for iWay Data Quality Center (DQC) and associated project folders using the DQC Explorer.
To create a new project:
The New Project dialog box opens.
The new DQC project node (SampleProject) is added in the left pane, as shown in the following image:
The New Folder dialog box opens.
The new folder node (bin) is added in the left pane, as shown in the following image:
The New Folder dialog box opens.
The new folder node (data) is added in the left pane, as shown in the following image:
The core of any DQC project is a Plan. A Plan defines the logic and rules to be applied to the input data in order to produce the desired output. Plans are created by placing Steps onto a canvas and connecting them together. Steps are data processing algorithms that can be used to read, write, transform and analyze data, among other actions.
Existing files can be added to DQC for use as input data for a Plan, for example. Files can be added by dragging and dropping from the file system to the desired project in the DQC Explorer or by copying them from destination folder to the desired project folder inside the workspace folder in the file system.
The sample DQC Plan you are creating will read input values from a simple text file, apply basic logic, and produce a formatted output. Perform the following steps to create a simple text file for your input:
The New Text File dialog box opens.
The new text file (hello_in.txt) is added in the left pane, as shown in the following image:
In the right pane, a text file editor is opened in a new tab (hello_in.txt), which allows you to create your input text file.
firstname;lastname John;Smith Daniel;Deutch
For example:
You must now add metadata to the input text file.
To use an input file in a Plan, it must first be assigned metadata describing the format of the data. Perform the following steps to add metadata to the input text file.
The Edit File Metadata window opens.
The Edit File Metadata window provides options for how to read the file, such as the type of delimiter used, the data types of each column, and whether the file contains header rows. The result data can be previewed in the lower panel of the editor to examine the results of the metadata settings.
The Update columns dialog box opens.
This dialog box allows you to specify the line number from your text file that contains the column names you want to use.
You are returned to the Edit File Metadata window, which now contains the updated column names.
You are returned to the DQC Explorer.
Notice that the hello_in.txt file node now has a small green icon attached. This green icon indicates that metadata has been added to the input file.
You are now ready to create a DQC Plan.
To create a DQC Plan:
The New DQC Plan File dialog box opens.
The new DQC Plan (Hello.plan) is added in the left pane, as shown in the following image:
In the right pane, the Plan editor consists of a canvas where the Plan logic is defined (by connecting Steps together) and a palette where the various Steps are listed.
A Text File Reader is generated, as shown in the following image.
You can also select the Connection object from the palette in the right pane and select the output from Text File Reader and then the input from Column Assigner.
The following image shows a completed connection between Text File Reader and Column Assigner.
The Properties of Column Assigner window opens.
The following configuration pane opens.
The Create Shadow Column dialog box opens.
"Hello " + firstname + " " + lastname
Note: The values in the expression are case sensitive.
Tip: As you are composing the expression, you can press Ctrl+Space to open a shortcut menu that provides a list of defined values that you can select from. For example:
You are returned to the DQC Explorer.
You can also select the Connection object from the palette in the right pane and select the output from Column Assigner and then the input from Alter Format.
The following image shows completed connections between Text File Reader, Column Assigner, and Alter Format.
The Properties of Alter Format window opens.
The Fill Columns dialog box opens.
You are returned to the Properties of Alter Format window.
You are returned to the DQC Explorer.
You can also select the Connection object from the palette in the right pane and select the output from Alter Format and then the input from Text File Writer.
The following image shows completed connections between Text File Reader, Column Assigner, Alter Format, and Text File Writer.
The Properties of Text File Writer window opens.
The Select File dialog box opens.
You are returned to the Properties of Text File Writer window.
You are returned to the DQC Explorer.
Your DQC Plan is complete. You are now ready to test and run your DQC Plan.
This section describes how to test and run your DQC Plan.
To test and run your plan:
The DQC plan is compiled and tested. The Console tab displays the status of this process, as shown in the following image.
A Task completed successfully message indicates that your DQC Plan is running properly and no errors have been generated.
A new output text file called Hello_out.txt is now available, which has been generated by your DQC Plan.
In the right pane, the content and formatting of the new output text file is displayed, as shown in the following image.
iWay Software |