Tokenizer Properties

Name

Type

Required

Description

When Condition

String

No

Expression that must be satisfied for this step to be executed.

Id

String

No

Step identification string.

Columns

List of Tokenizer Column

Yes

This section associates individual column tags representing inputs/outputs. Individual column definitions are processed in sequence as they are defined within this configuration section.

Separator

String

No

Global separator value. If not defined, a default value of ' ' is used.

Tokenizer Config

Configurable Tokenizer Config

Yes

Configurable tokenizer Settings.


iWay Software