Feasibility of Machine Learning Analysis for the Identification of Patients with Possible Primary Ciliary Dyskinesia
Bibliographic record
Abstract
BACKGROUND: Significant diagnostic delays are common in primary ciliary dyskinesia (PCD), a rare disease that is significantly underdiagnosed. Scalable screening methods could improve early identification and health outcomes. RESEARCH QUESTION: Can machine learning (ML) be used to screen for PCD in pediatric patients? STUDY DESIGN AND METHODS: We evaluated the feasibility of a random forest model to screen for PCD using data from the PCD Foundation Registry and a national claims database. We identified a cohort of pediatric patients with diagnostic codes indicative of conditions potentially associated with PCD, and studied diagnostic, procedural, and pharmaceutical codes associated with PCD to develop ML features. Models were trained on composite claims data from confirmed patients with PCD, patients with Q34.8 (Specific Congenital Malformation of the Respiratory System) diagnosed within six months of an Electron Microscopy procedure (Q34.8+EM), and a randomly-selected, matched control group. Model performance was tested through 5-fold cross-validation. RESULTS: Using 82 confirmed PCD cases and 4,161 matched controls, the model demonstrated variable performance (positive predictive value 0.45-0.73, sensitivity 0.75-0.94). Synthetic data augmentation did not improve results (positive predictive value 0.45-0.67, sensitivity 0.71-1.00). Expanding the dataset to include 319 Q34.8+EM patients and 8,214 controls improved performance (positive predictive value 0.51-0.54, sensitivity 0.82-0.90), suitable for screening. In a cohort of 1.32 million pediatric patients, 7,705 were classified as positive, consistent with the estimated prevalence of PCD (1:7,554). INTERPRETATION: This study demonstrates the feasibility of using ML to screen for PCD using claims data, even in the absence of a specific International Classification of Disease (ICD) code. Such screening approaches may aid in the identification of individuals who may benefit from timely diagnostic testing and targeted interventions.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.023 | 0.042 |
| Meta-epidemiology (narrow) | 0.001 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.002 |
| Bibliometrics | 0.002 | 0.001 |
| Science and technology studies | 0.000 | 0.001 |
| Scholarly communication | 0.001 | 0.001 |
| Open science | 0.001 | 0.001 |
| Research integrity | 0.001 | 0.001 |
| Insufficient payload (model declined to judge) | 0.001 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".