Project Directory Conventions

In this section:

The following image shows the complete structure of a sample project file system used in iWay DQC. All the key directories are shown.

Sample project file system (complete)

Typically, depending on the particular project, only a subset of the complete structure is used. The next image shows the structure of a typical project file system.

Typical project file system

You may use a small subset of the complete structure. The following image shows the structure of a small project file system.

Small project file system

Each directory is described in the following table.

Directory

Description

bat

iWay DQC batch load files

bin

iWay DQC Plans for data cleansing and match and merge processing

data

err

Error messages for etl (extract, transfer, load) process (used rarely)

 

ext

External etalons and lists of replacements

in

Input data

log

Log files of iWay DQC process

out

Output data

reports

Generated reports

pro

Profiling output data

rep

Repository (internal data storage for incremental form of data processing)

rpt

Report design files (used as report templates in the Reporting step)

doc

Documentation (help)

examples

Used rarely

lib

iWay DQC core libraries for batch Plan launching

tools

Used rarely



x
External Data Sources - Dictionaries

The following image shows a file system containing external etalons and lists of replacements. It applies to the indexed forms used up to iWay DQC 5.x.x.

File system with indexed forms up to iWay DQC 5.x.x

The file system in the next image applies to the indexed forms used since iWay DQC 6.0.0.

File system with indexed forms since iWay DQC 6.0.0

Each directory is described in the following table.

Directory

Description

bat

Batch load files for generating etalons and lists of replacements

cif

Indexed forms of etalons used by iWay DQC procedures (format used up to iWay DQC 5.x.x)

lkp

Indexed forms of etalons used by iWay DQC procedures (format used since iWay DQC 6.0.0)

src

Source forms of etalons (txt, csv) from which lkp or cif files are generated

xx-adr

File system of an international address etalon (xx is country code or top-level domain)

uir-adr

File system of uir-adr etalons, for Czech environments only

xml

iWay DQC scripts for generating etalons and lists of replacements

Batch files from the bat directory call scripts from the xml directory. This procedure converts etalons from the source files *.txt or *.csv in the src directory into their respective indexed forms. It saves them, respectively, in the lkp or cif directory. Indexed forms are used by cleansing scripts stored in the bin directory. The structure used for the address etalons is very similar to that of the ext directory.


iWay Software