Initialize Data Quality parameters. More...
Go to the source code of this file.
Initialize Data Quality parameters.
[in] | ds_in_dq_config | parameter table containing the list of AnalysisData keys and related RuleSet keys |
[out] | ds_out_dq_config | Output table containing a record for each combination of AnalysisData key, RuleSet key and rule JSON |
This node converts the structure of the input table into a table with one record for each combination of AnalysisData key and the corresponding RuleSet key and rule JSON
The structure of the input table RMC_CFG.DQ_CONFIG is as follows:
CONFIG_NAME | CONFIG_VALUE | CONFIG_VALUE_DESC |
---|---|---|
ANALYSIS_DATA_KEY_LIST | <AnalysisDataKey1> <AnalysisDataKey2> .. <AnalysisDataKeyN> | Space separated list of Analysis Data Keys |
DQ_RULE_SET_KEY_LIST | <RuleSetKey1> <RuleSetKey2> .. <RuleSetKeyN> | Space separated list of Rule Set Keys |
DQ_DETAILS_FLG | <Y/N> | Controls whether to produce detailed data quality information |
RULES_JSON | JSON string | JSON string describing all rules |
GL_RECONCILIATION_FLG | <Y/N> | Controls whether to aggregate portfolio data and compare with GL Account data |
GENERAL_LEDGER_KEY | <GLAnalysisDataKey> | GL Analysis Data Key |
The structure of the output table ST_STG.DQ_CONFIG is as follows:
ANALYSIS_DATA_KEY | DQ_RULE_SET_KEY | DQ_DETAILS_FLG | RULE_JSON | GL_RECONCILIATION_FLG | GL_ANALYSIS_DATA_KEY |
---|---|---|---|---|---|
<AnalysisDataKey1> | <RuleSetKey1> | <Y/N> | JSON describing rule 1 | <Y/N> | <GLAnalysisDataKey1> |
<AnalysisDataKey2> | <RuleSetKey2> | <Y/N> | JSON describing rule 2 | <Y/N> | <GLAnalysisDataKey2> |
... | ... | <Y/N> | <Y/N> | ... | |
<AnalysisDataKeyN> | <RuleSetKeyN> | <Y/N> | JSON describing rule N | <Y/N> | <GLAnalysisDataKeyN> |
In addition the following macro utilities are called:
Macro name | Description | Further information |
---|---|---|
irm_session_prepare | Reads RUN_OPTION table and sets logging options | irm_session_prepare.sas |
irm_session_cleanup | Removes all non-IRM WORK datasets/views and deletes all user-created macro variables from workspace session | irm_session_cleanup.sas |
Definition in file irmst_node_dq_init.sas.