Network Data Quality


Simple item page
dc.contributor.authorRazzaghi, Hanieh
dc.contributor.authorDickinson, Kimberley
dc.contributor.authorWieand, Kaleigh
dc.contributor.authorBailey, Charles
dc.contributor.otherPEDSnet Data Coordinating Center
dc.date.accessioned2025-09-18T20:00:47Z
dc.date.created2025-09
dc.descriptionThe package currently (as of 09/2025) contains 10 distinct analysis types that can be configured to run innumerable data quality checks. See the table below for a list of the current offerings. | Analysis Type | Description | Functions | |----------------|--------------------|--------------------------------| | [Data Cycle Changes](https://pedsnet.org/metadata/entities/dqcheck/6153f809-274b-4b53-9fe7-d12e0c0bbcfb) | Computes row & patient counts in the specified tables for both the current data model version and a previous data model version in order to assess changes across data extractions. | [check_dc](https://pedsnet.github.io/ndq/reference/check_dc.html) <br> [process_dc](https://pedsnet.github.io/ndq/reference/process_dc.html) | | [Domain Concordance](https://pedsnet.org/metadata/entities/dqcheck/2960fa1a-4181-4087-8e87-e55fa958ae65) | Given the details of a pair of clinical events, this function will determine the count of patients OR visits that meet criteria for the first event, the second event, and both events. | [check_dcon](https://pedsnet.github.io/ndq/reference/check_dcon.html) <br> [process_dcon](https://pedsnet.github.io/ndq/reference/process_dcon.html) | | [Date Plausibility](https://hdl.handle.net/20.500.14642/1229) | Identifies the proportion of rows in each fact type that have an implausible date, where implausibility is defined as a date that falls before the associated visit start date, after the associated visit end date, or before the patient's birth date. | [check_dp](https://pedsnet.github.io/ndq/reference/check_dp.html) <br> [process_dp](https://pedsnet.github.io/ndq/reference/process_dp.html) | | [Best Mapped Concepts](https://pedsnet.org/metadata/entities/dqcheck/d9f9a811-08b5-4e14-b8e6-a8632a65bd20) | Identifies the existing concepts within the specified field so the user can assess which of these concepts are acceptable ("best") or should not be used in that field ("not best"). | [check_bmc](https://pedsnet.github.io/ndq/reference/check_bmc.html) <br> [process_bmc](https://pedsnet.github.io/ndq/reference/process_bmc.html) | | [Expected Concepts Present](https://pedsnet.org/metadata/entities/dqcheck/3e8dfcc4-4660-4809-a67b-a41f494cbf18) | Identifies the count of patients who have at least one occurrence of the concept defined in the associated concept set and the proportion of patients who have the concept based on the user-provided denominator cohort. | [check_ecp](https://pedsnet.github.io/ndq/reference/check_ecp.html) <br> [process_ecp](https://pedsnet.github.io/ndq/reference/process_ecp.html) | | [Clinical Fact Documentation](https://pedsnet.org/metadata/entities/dqcheck/bb5d7ae7-328e-456e-9080-2174b6aacf3d) | Identifies visits that do and do not link to at least one of each user-specified clinical fact type. Will also compute the counts of patients who have at least one visit that does / does not link to the specified fact type. | [check_cfd](https://pedsnet.github.io/ndq/reference/check_cfd.html) <br> [process_cfd](https://pedsnet.github.io/ndq/reference/process_cfd.html) | | [Missing Field: Visit ID](https://pedsnet.org/metadata/entities/dqcheck/a69049ec-8bd0-457a-8c00-a9047864025e) | Checks to see if the `visit_occurrence_id`/`encounterid` in a given fact table also exists in the `visit_occurrence`/`encounter` table and identify cases where the ID is missing entirely (NULL). | [check_mf_visitid](https://pedsnet.github.io/ndq/reference/check_mf_visitid.html) <br> [process_mf_visitid](https://pedsnet.github.io/ndq/reference/process_mf_visitid.html) | | [Unmapped Concepts](https://pedsnet.org/metadata/entities/dqcheck/c33887c8-1a94-418c-b3f8-912f49bcbe7a) | Evaluates the count and proportion of unmapped concepts associated with the fact type of interest. Can also be executed longitudinally by year. | [check_uc](https://pedsnet.github.io/ndq/reference/check_uc.html) <br> [process_uc](https://pedsnet.github.io/ndq/reference/process_uc.html) | | [Valueset Conformance](https://pedsnet.org/metadata/entities/dqcheck/8dbd9910-c838-4d71-88a0-ff9f071d1257) | Intakes a limited valueset that is expected to make up the entire contents of a field (minus the specified `null_values`) and identifies if any non-permitted values exist in the field (and how often). | [check_vs](https://pedsnet.github.io/ndq/reference/check_vs.html) <br> [process_vs](https://pedsnet.github.io/ndq/reference/process_vs.html) | | [Vocabulary Conformance](https://pedsnet.org/metadata/entities/dqcheck/3e0a0ef3-4618-4d25-af4a-ca2086836044) | Use a provided vocabulary definition table to identify the vocabulary of each concept and determine how many rows comply with the standard vocabularies expected for that field. | [check_vc](https://pedsnet.github.io/ndq/reference/check_vc.html) <br> [process_vc](https://pedsnet.github.io/ndq/reference/process_vc.html) | | [Facts Over Time](https://pedsnet.org/metadata/entities/dqcheck/8847bb72-329a-40b8-bd38-db67f149070e) | Computes the number of rows, patients, and (optionally) visits associated with the fact of interest within a specified time period. | [check_fot](https://pedsnet.github.io/ndq/reference/check_fot.html) <br> [process_fot](https://pedsnet.github.io/ndq/reference/process_fot.html) {.dqcheck-table}
dc.description.abstractThe [Network Data Quality (NDQ)](https://pedsnet.github.io/ndq/) package contains several data quality modules intended to evaluate the overall condition of the data in a clinical research network. These modules, which cover a broad range of data quality domains from conformance to plausibility, are flexible and can be configured to execute checks specific to desired use cases in both the OMOP and PCORnet common data models (CDMs). <br><br> ##### [View pkgdown summary here.](https://pedsnet.github.io/ndq/)
dc.identifier.urihttps://hdl.handle.net/20.500.14642/1195
dc.publisherPEDSnet
dc.rightsa Mozilla Public License Version 2.0.
dc.rights.urihttps://www.mozilla.org/en-US/MPL/2.0/
dc.subjectR
dc.titleNetwork Data Quality
dc.title.alternativendq
dspace.entity.typeCode
local.code.githubhttps://github.com/PEDSnet/ndq
local.code.packageremotes
local.subject.DataModelPEDSnet Data Model
local.subject.DataModelOMOP Data Model
local.subject.DataModelPCORnet Data Model
relation.isConceptSetOfCodef8a78a76-a0ab-493c-94c9-7f764927b90a
relation.isConceptSetOfCode.latestForDiscoveryf8a78a76-a0ab-493c-94c9-7f764927b90a
relation.isDQCheckOfCodedb768c1b-1610-4eac-9d72-5c1da1ba64d3
relation.isDQCheckOfCode2960fa1a-4181-4087-8e87-e55fa958ae65
relation.isDQCheckOfCode3e8dfcc4-4660-4809-a67b-a41f494cbf18
relation.isDQCheckOfCodea69049ec-8bd0-457a-8c00-a9047864025e
relation.isDQCheckOfCode8847bb72-329a-40b8-bd38-db67f149070e
relation.isDQCheckOfCoded9f9a811-08b5-4e14-b8e6-a8632a65bd20
relation.isDQCheckOfCodec33887c8-1a94-418c-b3f8-912f49bcbe7a
relation.isDQCheckOfCodebb5d7ae7-328e-456e-9080-2174b6aacf3d
relation.isDQCheckOfCode3e0a0ef3-4618-4d25-af4a-ca2086836044
relation.isDQCheckOfCode8dbd9910-c838-4d71-88a0-ff9f071d1257
relation.isDQCheckOfCode6153f809-274b-4b53-9fe7-d12e0c0bbcfb
relation.isDQCheckOfCode.latestForDiscoverydb768c1b-1610-4eac-9d72-5c1da1ba64d3

Files

Domains

Reusable Code