x

• Connection. This step relates two or more steps together.
• Comment. This step allows you to document your MDS Plan within the workbench.
• New Include. This step allows you to call another MDS Plan within the one you are building.

With the following categories, clicking on any of the Steps Categories expands to show you the various options for each step. Clicking the step category again, collapses the category.

x

• Dbf File Reader. This step reads data from an input file representing a DBF (database) data source.
• Excel File Reader. Reads rows of a table from one sheet of an Excel spreadsheet file.
• Fixed Width File Reader. Reads data from a standard text file data source.
• Integration Input. An input step in a Plan file in a component step creates an endpoint named by the input step.
• Jdbc Reader. This step reads data records from the results of a specified query executed on a specified JDBC database table.
• Text File Reader . Reads data from a text file with columns separated by delimiters.
• Xml Reader. Reads data from an XML file and puts them into one or more output endpoints.

x

• Excel File Writer. Creates a new Excel file, or writes to an existing Excel file, and fills the specified sheet with rows of data.
• Integration Output. An output step in a Plan file in a component step creates an endpoint named by the output step.
• Jdbc Writer. Writes data to a JDBC (database) data source.
• Text File Writer. Writes data into a text file with columns separated by delimiters.
• Trash. Reads all data from the specified input and no operation is performed. Output data records are neither persisted to disk, nor passed along to other processing steps.
• Xml Writer . The data output is a standard XML file containing records stored as XML elements.

x

• Alter Format. Performs transformation of the input data format. The output data is given new data formats, either by removing or adding new column definitions.
• Buffer. Sends data through Buffer, breaks producer-consumer performance dependency in data flow.
• Cluster. Distributes work of part of plan to more computers.
• Condition. Filters data flow across multiple branches as determined by the defined conditional expression.
• Extract Filter. This step extracts records from a data source.
• Filter. Controls the processing of each data record and determines if the record can pass through in the data flow.
• Join. This step joins two separate input data flows into a single output data flow based on corresponding input data flow keys.
• Multiplicator. This step duplicates input data and sends them into several output flows.
• Selector. Selects the best record from each group generated by a multiplicative step.
• Sort. Sorting step that will sort according to a specified key.
• Union. This step merges input formats of two defined inputs into a single output format.
• Union Same. This step combines multiple separate data flows into single data flow.

x

• Apply Replacements. This step performs replacements of all known (defined) strings within the given text string, where the final value is stored in the data output.
• Column Assigner. This step assigns the result of a defined expression to a specified column.
• Group Assigner. Calculates aggregated expressions on group generated by a multiplicative step.
• Matching Values. The step creates matching values of specified expressions and stores them in output columns.
• Multiplicative Pattern Parser. Parses and validates any string against a dictionary file and returns all possible matches.
• Multiplicative Regex Matching. This step extracts values from the input expression and tries to apply them to regular expressions in order to extract values to output columns.
• Pattern Parser. Parses and validates any string against a dictionary file.
• Regex Matching. Parses and extracts values in the input string using defined patterns of Regular expressions.
• SQL Execute. Executes a defined SQL command/procedure call over the input data and writes its output values.
• SQL Select. This step reads some data from a database using a SQL command that maybe parameterized with some data from the input row.
• Selective Transliterate. Transforms a specified set of characters from the input column"in" to another character set, and sends the result text to the output column "out".
• Splitter. Creates a new record for each word in a defined expression.
• Tokenizer. This step splits content provided by the input columns into specified output columns using the defined tokenizer.
• Transliterate. Transliterates a defined set of input strings to a defined set of strings.

x

• Character Groups Analyzer. This step serves as a profiler of input characters.
• Data Quality Indicator. Computes boolean expressions for each input row and gives results of them to the output together with input rows.
• Frequency Analysis. Generates frequency analysis (a histogram), computes value counts in a given data set, either using all discrete values or using determined intervals.
• Group Aggregator. Produces output similar to using SELECT ... GROUP BY ... SQLstatements.
• Profiling. Computes statistics and generates other data analysis measures.
• Relation Analysis. Analyzes two sets of keys coming from two input data flows and calculates occurrences of several relation types.
• Scoring. Scores and flags input records by defined rules.
• Scoring Simple. Scores and flags input records by defined rules.
• Statistics. This step is capable of multiple analytical operations in a single pass over multiple columns of input data.
• Word Analyzer. This step identifies words by parsing input column values using a specified separator and replaces them with symbols – names of dictionaries specified by step properties.

x

• Validate Vin. This step validates a VIN (Vehicle Identification Number) and returns its verified value.

x

• Guess Name Surname. The step identifies a first name and a last name from specified data input.
• Multiplicative Guess Name Surname. Parses and validates names and returns all possible matches.
• RVN Validator. Validates the German personal identification number.
• SIN Validator. Validates Canadian Social Insurance Number.
• Smart Swap Name Surname. Swaps the first name and the last name in the input("firstName" and "lastName") string.
• Strip Titles. Removes titles (academic, social, etc.) from person names.
• Transform Legal Forms. Transforms legal forms in the input string.
• Update Gender. Determines gender based on first and last name.
• Validate ID Card. Validates the format of a card number.

x

• Address Doctor. This step encapsulates the AddressDoctor software library.
• Address Identifier CA. This step performs address identification based on reference data and a parsing rule definition.
• Address Identifier US. Cleanses US addresses.
• Multiplicative Address Doctor. his step encapsulates the AddressDoctor software library.
• Multiplicative Validate Phone Number. This step verifies the validity of a phone number.
• Validate Email. This step checks the validity of an email address according to a valid email address format.
• Validate Phone Number. Parses and validates phone numbers.

x

• Dictionary Lookup Identifier. Identifier that uses dictionary based lookups. Identifies the input record possibly down to its primary key.
• Extended Unification. Some operations in MDS are based on certain record groupings.
• Incremental Manual Override Builder. Manages a set of rules for manual overriding against a single existing unification rule within the repository.
• Lookup. Searches for input values in a table dictionary file and writes corresponding values from the dictionary file to the output.
• Manual Override Builder. Manages a set of rules for manual overriding against the existing unification rules within the repository.
• Multiplicative Lookup. Searches an input value in a dictionary file and writes corresponding values from the dictionary files.
• Representative Creator. This step computes a set of representative records from source data utilizing a process where records are classified by a specified rule and grouped by an appropriate key.
• Simple Group Classifier. Classifies groups of records with roles representing overall data quality of the groups from the Unification process.
• Soap Call. It calls for each input record a soap service.
• Soap Multi Call. It calls for each input record a soap service.
• Unification. Unifies and groups records by the defined strategy and matching keys.
• Web Lookup. Reads values from a web page defined by the input value.

x

• Dictionary Lookup Builder. Generates reference data from a single input stream.
• Dictionary Lookup Reader. Reads given dictionary and creates a row for each entity.
• Extended Repository Reader. Reads data from Repository used by Extended unification.
• Lookup Builder. This step creates a lookup file/dictionary for matching lookup operations.
• Lookup Reader. Reads data from a Matching Lookup type dictionary file.
• Record Counter. Logs the run into a text file or the console.
• Repository Key Converter. This step generates unification keys based on unification constraints so that the output file can be used by the Repository Writer step to build the repository.
• Repository Reader. This step reads all valid items from a specified file representing a local repository storing incremental changes for database identification keys.
• Repository Writer. This step writes all valid items from a specified source to a local repository storing incremental changes for database identification keys.

x

• Indexed Table Reader.
• Matching Lookup Reader.
• Selective Matching Lookup Reader.
• String Lookup.
• String Lookup Reader.
• Table Matching.

x

• Issue Importer.
• Issue Reader.

x