In this section: |
The following image shows the complete structure of a sample project file system used in iWay DQC. All the key directories are shown.
Typically, depending on the particular project, only a subset of the complete structure is used. The next image shows the structure of a typical project file system.
You may use a small subset of the complete structure. The following image shows the structure of a small project file system.
Each directory is described in the following table.
Directory |
Description | ||
---|---|---|---|
bat |
iWay DQC batch load files | ||
bin |
iWay DQC Plans for data cleansing and match and merge processing | ||
data |
err |
Error messages for etl (extract, transfer, load) process (used rarely) | |
ext |
External etalons and lists of replacements | ||
in |
Input data | ||
log |
Log files of iWay DQC process | ||
out |
Output data | ||
reports |
Generated reports | ||
pro |
Profiling output data | ||
rep |
Repository (internal data storage for incremental form of data processing) | ||
rpt |
Report design files (used as report templates in the Reporting step) | ||
doc |
Documentation (help) | ||
examples |
Used rarely | ||
lib |
iWay DQC core libraries for batch Plan launching | ||
tools |
Used rarely |
The following image shows a file system containing external etalons and lists of replacements. It applies to the indexed forms used up to iWay DQC 5.x.x.
The file system in the next image applies to the indexed forms used since iWay DQC 6.0.0.
Each directory is described in the following table.
Directory |
Description |
---|---|
bat |
Batch load files for generating etalons and lists of replacements |
cif |
Indexed forms of etalons used by iWay DQC procedures (format used up to iWay DQC 5.x.x) |
lkp |
Indexed forms of etalons used by iWay DQC procedures (format used since iWay DQC 6.0.0) |
src |
Source forms of etalons (txt, csv) from which lkp or cif files are generated |
xx-adr |
File system of an international address etalon (xx is country code or top-level domain) |
uir-adr |
File system of uir-adr etalons, for Czech environments only |
xml |
iWay DQC scripts for generating etalons and lists of replacements |
Batch files from the bat directory call scripts from the xml directory. This procedure converts etalons from the source files *.txt or *.csv in the src directory into their respective indexed forms. It saves them, respectively, in the lkp or cif directory. Indexed forms are used by cleansing scripts stored in the bin directory. The structure used for the address etalons is very similar to that of the ext directory.
iWay Software |