Reliability and sensitivity of two clock drawing test rubrics as screening measures for mild cognitive impairment
Bibliographic record
Abstract
Abstract Background Early identification of mild cognitive impairment (MCI) is critical, as MCI precipitates disability and may be a precursor to major neurocognitive disorder. The Clock Drawing Test (CDT) is a widely adopted screening measure for dementia however it is not known whether paper‐and‐pencil CDT scoring rubrics are sensitive to subtle losses consistent with MCI. We examined the reliability and sensitivity to MCI of two free‐drawn Clock Drawing Test rubrics ‐ the 10‐point Rouleau, and the 20‐point Clock Drawing Interpretation Scale (CDIS) in community‐dwelling older adults. Method 345 adults enrolled in a study of functional cognition completed the Montreal Cognitive Assessment (MoCA), the Alzheimer’s Disease Cooperative Study Scale (ADCS‐ADL), and freely‐drawn clocks scored with CDIS and Roleau rubrics. We computed Cronbach’s alpha, receiver operating characteristic (ROC) analyses using the MoCA as the index measure, and one‐way ANOVAs with the ADCS‐ADL for each rubric. Result Our sample was 74% female, 83.2% white. Mean age was 70.01 ±8.89, and mean education was 15.5 ±3.735 years. Average scores were 24.28 ±3.44 (MoCA), 74.85 ±4.16 (ADCS), 8.8 ±1.68 (Rouleau) and 18.17 ±2.09 (CDIS). alphas were .65 for the CDIS and .479 for the Rouleau. ROC analyses using MoCA scores consistent with any impairment (<26) resulted in a CDIS AOC of .677, with sensitivity of .681 and specificity of .58 at a cut score of 19. The Rouleau AOC was .684, with sensitivity of .542 and specificity of .76 at a cut score of 9. ANOVAs indicated that individuals classified as impaired by the CDIS ((F = 13.095, p<.001) or the Rouleau (F = 22.2, p<.001) rubrics reported significantly more ADL/IADL difficulties than those classified as unimpaired with either rubric. Differences between impaired and unimpaired groups were larger for the CDIS, suggesting this rubric is more sensitive to ADL/IADL deficits. Conclusion Both rubrics produced generally similar results when compared to the MoCA and adequately identified individuals needing further evaluation given reported functional problems. The CDIS produced more robust differences suggesting that it may be more appropriate for community screening to identify individuals in need of comprehensive cognitive and functional evaluation.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.018 | 0.054 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.002 | 0.001 |
| Science and technology studies | 0.000 | 0.001 |
| Scholarly communication | 0.001 | 0.001 |
| Open science | 0.001 | 0.001 |
| Research integrity | 0.001 | 0.001 |
| Insufficient payload (model declined to judge) | 0.001 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".