An iWay Data Quality Center (DQC) user who is responsible for system maintenance. There are two categories of administrators, System administrator and Reference data administrator.
A form of iWay DQC execution. There are two basic types of application modes, batch mode and online mode.
An iWay DQC user who is responsible for embedding the iWay DQC application into the system architecture at the customer site.
A type of online mode in which processing requests are awaiting a response until iWay DQC completes such requests. iWay DQC sends its response to the client address instead.
A type of iWay DQC application mode in which requests are processed in sequence.
A type of dictionary file that stores lookup data in binary file format.
A definition of correspondence between a column and an appropriate step parameter. This term is also used to denote the column values bounded to a parameter.
A list of records forbidden in a dictionary file.
From a business implementation point of view, a black list can be a list of values of key identifiers (for example, date of birth, company ID, or health insurance number) that represent bad or test data, which, when found in the input data, indicates that records with such a value should be excluded from customer consolidation. For such records, special unification rules are applied. Records are unified into separate groups and ideally reported to business analysts as needed.
For additional information, refer to the term Universal list in this Glossary.
A type of expression whose resulting value is Boolean (yes or no).
An iteration of the iWay DQC application and its associated data files.
An iWay DQC user who prepares iWay DQC solution concepts for system implementers and consults with customers about the solution.
A representation of customer data management functions.
The most general element of the documentation structure. Chapters contain sections.
A definition of a set of characters.
It can be a simple list of characters (for example, aeiouy) or combined with the use of predefined character classes. These classes can be used anywhere in the definition. If the characters [ ] : (square brackets and colon) need to be defined for a particular group, they cannot be written in a "[:" or ":]" form. They must be escaped and cannot follow each other.
An enumeration of characters that belong in a continuous range can be simplified by the minus (-) character to define an interval of characters. For example, the string “abcdef” can be simplified with an a-f interval. If the character minus (-) is needed in the character group and is not used by the interval definition, it must be at the start or at the end of the characters property. For example, “a-r-” defines a character group of any lowercase characters between the character a and r and -.
Predefined character classes can also be used in the following form
[:predefined_character_class:-list_of_omissions:]
where:
Is one of the predefined character classes.
Can contain one of the following:
Enumeration of characters. For example, the following means all lowercase characters except a, b and c:
[:lowercase:-abc:]
Interval(s) of characters. For example, the following means all letters except intervals a-d and X-Z:
[:letter:-a-dX-Z:]
Another predefined character class. For example, the following means all non-digits:
[:all:-digit:]
It is also possible to define the complement of a set. The complement of a set might be:
[:-abc:]
[:-a-dX-Z:]
[:-digit:]
An iWay DQC step property that is part of another parent property.
A value stored in the scorer explanation column after scoring. The clearing code is a textual description of detected scoring situations.
A part of the iWay DQC application whose purpose is to communicate with the iWay DQC server component. There are two types of client components available for iWay DQC, the iWay DQC Graphical User Interface (GUI) and the console.
A named set of data values of a specific data type, one for each row of the input data source.
A data type defined in iWay DQC. It can be Boolean, day, datetime, float, or integer. Columns that are processed in iWay DQC must be of a column type.
A control combining a list box and a text box that allows a user to enter a value or select an item from a list.
Text added to an iWay DQC component (for example, Plan file, step, column) to describe details of the component.
A type of documentation created by iWay DQC users through an appropriate online forum.
A complex service consisting of simpler business services.
A type of documentation describing a high-level view of iWay DQC concepts and principles. The documentation is provided at the iWay DQC wiki Web site.
A step property (Boolean expression) that restricts application of the step for the currently processed record. The step is applied to a given record only if the condition expression is evaluated as true.
A link between two steps with a defined direction.
A character-based interface to an operating system. Commands for iWay DQC are written to the console.
A menu for a specific object that pops up when you right-click the object name or icon.
A part of an iWay DQC application that provides operations (for example, cleaning, deduplication) according to client tasks.
Values that are stored in a dictionary file in the same record as the lookup value. Typically these values represent official, registered, cleansed, or standard values for an appropriate attribute, or additional data corresponding to the lookup value.
A characteristic indicating whether a data item represents, for example, a number, date, or character string. In iWay DQC, there are two groups of data types, column and property.
A value that a field assumes unless an explicit value is entered for that field.
A graphical visualization of the Plan. Steps are displayed as icons, and connections are displayed as arrows between the steps.
The large central area of the iWay DQC workbench where Plans are visualized in the form of diagrams or as XML code.
A pop-up modal child window, also called a dialog box, that requests interaction from the user.
A file containing combinations of lookup values and corresponding values. The presence of the corresponding values in a dictionary file is optional. Typically the lookup value is the search value (key) within the dictionary, and the corresponding value is a return value (appropriate official, clean, or standardized value, or additional data related to the lookup value).
The Integrated Development Environment (IDE) for iWay DQC configuration.
A universal tool platform providing core frameworks and services upon which all plug-in extensions are created.
A Plan that is included in another Plan.
A set of characters that has been mapped to a numeric value code that pairs a set of natural language characters with a set of numbers.
A socket in a step from/to which a connection can lead.
A message displayed in iWay DQC when a critical problem occurs. Errors prevent iWay DQC from running.
Types of return codes that indicate that the iWay DQC application finished with an error.
A single character, which in a sequence of characters, signifies that what is to follow takes an alternative interpretation.
An iWay DQC display mode in which the Plan is shown as an XML structure rather than as a diagram.
A column that describes scoring situations for applicable steps.
A combination of column names, functions, operations, keywords, and constants, which is formed by certain rules. Expressions can be split, according to the type of evaluation result, into Boolean expressions and value expressions.
A character that separates particular fields in a text data file.
A Boolean variable that may be set to either true or false.
A directed movement of data between steps. There are two flow categories, input flow and output flow.
A variable containing a link to a directory. Folder shortcuts may be used in steps in place of the full path definition.
Text that appears at the bottom of a text data file.
A subroutine that performs a specific task that may be called from an expression.
A set of step types displayed in the same category of the palette.
Text that appears at the beginning of a text data file, usually stored in just one record. The header often contains names of the columns stored in the text data file.
A type of service that uses the HTTP protocol for communication and allows transference of not only the XML files, but also the CSV files.
An iWay DQC user responsible for realization of the iWay DQC solution defined by the architect.
A data flow that brings input to a step.
Data sources that store input data, for example, databases or text files.
A type of step used for retrieving/storing data from/to external storage.
The method by which iWay DQC communicates with the outside world. There are three basic types of interfaces: Web service, HTTP service, and messaging.
A task performed by a computer system.
A character that separates lines in a text data file.
A component that provides users with a scrollable list of options from which to choose.
A group of related step properties shown in the iWay DQC GUI. If the properties in the list are of a simple type such as string or integer, then the corresponding XML structure keeps their values in the format:
<LIST_NAME>
<PROPERTY_NAME>PROPERTY_VALUE</PROPERTY_NAME>
</LIST_NAME> The main working area of an iWay DQC application. The local workspace is a virtual directory that allows the user to gather various Plan files and data resources and work with them as a cohesive unit.
Additional data that is not part of iWay DQC but provides it with information necessary for some steps. A search key is defined within such data.
A value that is part of a dictionary file row and is used as a search key within the file.
A menu associated with the main iWay DQC window.
A Plan that is not included in any other Plan. It is a root in the Plan hierarchy.
A property that must be supplied. Otherwise, a critical error occurs when a user attempts to start iWay DQC.
A system enabling asynchronous communication between multiple programs by sending messages between each other.
Data that is used to describe other data.
A situation that occurs when a mandatory step parameter is not supplied. Such a situation causes an error message to appear in the Properties view.
A mode of iWay DQC execution in which iWay DQC runs continually and communicates with other programs through interfaces. The online mode may be either synchronous or asynchronous.
Inputs of an operation.
A data flow that stores the output of a step.
An area of the iWay DQC Plan editor from which you can drag step types and place them on the canvas for use inside a Plan.
An iWay DQC step property that contains another step property (a child property).
The smallest element of the documentation structure. Parts are grouped into sections.
A sequence of steps that describes iWay DQC processing of the input data.
A hierarchy specifying relations between particular Plan files. A Plan in the relation can be either embedded or main.
A small information window that appears over a control when a user moves the mouse on the control.
A class (identified by a given name) of certain characters that are accessible by using the class name. Predefined character classes can be used in descriptions of typical sets of characters (for example, digits, letters) when defining an acceptable character set (a typical use is in the definition in an algorithm solving syntactic analysis). For example, instead of a list definition [a,b,c,..z] or [a-z], only the class name can be used: [:lowercase:]. Available predefined character classes are: letter, lowercase, uppercase, digit, white (space, tab, and special characters like CR and LF).
A type of documentation describing iWay DQC steps and components. The documentation is distributed with the iWay DQC software and is created during each build.
A name of the iWay DQC product used internally by the development team.
An official name of the iWay DQC product.
An official version of the iWay DQC product.
Either the internal build number or product marketing version.
A set of multiple Plans, usually focused on solving a specific business task.
A tab in the iWay DQC GUI that displays warnings and errors.
A parameter of a step. Properties can be organized into hierarchies by relations of parent/child properties. Properties can be managed either through the appropriate XML configuration file or in the step dialog.
A data type that specifies types of step properties (for example, Java data types).
A value set to the corresponding property.
A type of binding used by a step to specify input for one of its parameters.
A type of binding used by a step to specify input for one of its parameters or to specify storage of output values.
A single item that is stored in input data resources (for example, database or text file).
Dictionaries that provide information used in steps, such as names and addresses or inventories.
An iWay DQC user responsible for maintaining reference data (such as creating new dictionaries or updating the current dictionaries).
A return status from the iWay DQC application that specifies whether or not problems occurred during the run.
The period of time during which the iWay DQC application is executing.
Parameters of the iWay DQC application that are set during its startup.
A number representing the result of scoring.
A step element that contains basic settings of the scoring within the corresponding step.
A process that evaluates the information quality of a data row.
A column that stores the score for the appropriate scoring situation.
A set of parameters describing a concrete scoring situation.
A Boolean flag indicating whether the appropriate scoring situation has been detected or not. If the situation is detected and the corresponding scoringEntry is defined, the scoring entry is then applied or activated (that is, the specified score is added and the specified scoringKey is written).
An identifier uniquely denoting a scoring entry.
A documentation structure element that contains parts. Sections are grouped into chapters.
A character used to separate text components. There are two types of separators: field and line.
A part of the iWay DQC application that receives and processes tasks from iWay DQC clients.
A part of the iWay DQC GUI workbench that displays a list of various Plan files and data sources.
A new column that is added to the original set of columns, typically used as output storage.
An indivisible element of a Plan providing a specified logic.
A dialog that allows editing of step properties.
A concrete implementation of a step defined by its type, name, and properties.
A class representing a certain logic. In the iWay DQC GUI, it is represented as a palette item.
A character that is used to enclose text fields.
A character used to escape string qualifiers inside a string field.
A type of online mode in which iWay DQC processing requests are pending and await iWay DQC responses as they are received.
An iWay DQC user responsible for the application administration (for example, patches or batch administration).
An iWay DQC user who creates Plans. System implementers realize solutions designed by the business implementer.
Typically a small rectangular box (usually containing a text label or graphical icon) associated with a view pane.
A type of documentation describing iWay DQC implementation design. The documentation is created in Unified Modeling Language (UML) and provides an accurate view of iWay DQC from the development perspective.
A type of dictionary file that stores data in the text file format.
A horizontal bar within the window that contains buttons for the most frequently used commands.
A part of the step dialog that displays a hierarchy of the step properties.
Information about the expected structure of the corresponding type in input.
From a business implementation point of view, a universal list (list of universal values) represents a list of values that are used by end user systems collecting input data for key identifiers (for example, date of birth, company ID, or health insurance number) with unknown or unspecified values. When you do not know the right value for such an attribute, type any known value that is acceptable to the system (the value can be temporary only, until you verify the right value). When the universal value is then detected within the input data, it is ignored for customer consolidation. Only the rest of the attributes creating a matching key for consolidation are taken into account. Another term relating to this term is Black list.
A person either using or supporting the iWay DQC application.
A list of non-standard records defined by the user that will be added to the resulting dictionary file.
A Plan that has been validated successfully (that is, it is without errors).
A process of configuration checking in which the accuracy of step settings is tested. Errors and warnings can be generated during this process.
A type of expression with a resulting value of any column type (other than Boolean).
A message displayed in the iWay DQC Properties view in the case of non-critical issues or unexpected or incomplete step settings. Warnings do not prevent iWay DQC from running.
A piece of software that makes itself available over the Internet and uses a standardized XML messaging system.
The iWay DQC graphical environment as a whole. It includes views, menus, toolbars, editors, explorers, and more.
A type of binding used by a step for data output.
| iWay Software |