MétaCan
Menu
Back to cohort
Record W4390084902 · doi:10.1017/s1355617723003661

48 Psychometric properties of DCTclock™ with commonly used neuropsychological tests and their combined ability to predict Beta-Amyloid Positron Emission Tomography Status

2023· article· en· W4390084902 on OpenAlexaboutno aff
Sheina Emrani, Jennifer Strenger, Zachary J. Kunicki, Alyssa N. De Vito, Stephen Salloway, Louisa I. Thompson

Bibliographic record

VenueJournal of the International Neuropsychological Society · 2023
Typearticle
Languageen
FieldMedicine
TopicDementia and Cognitive Impairment Research
Canadian institutionsnot available
Fundersnot available
KeywordsNeuropsychologyPsychologyNeuropsychological assessmentVerbal fluency testPositron emission tomographyDementiaCognitionNeuropsychological testExecutive functionsAudiologyClinical psychologyCognitive psychologyMedicinePsychiatryInternal medicineDiseaseNeuroscience

Abstract

fetched live from OpenAlex

Objective: Sensitive and non-invasive methods of screening for early-stage Alzheimer’s disease (AD) are urgently needed. The digital clock drawing test (DCTclockTM) is an established and well-researched neuropsychological tool that can aid in early detection of dementia. Other simple, yet sensitive, neuropsychological measures able to detect early stages of AD include Trail Making Tests (TMT). We investigated the psychometric properties of DCTclockTM with TMT-A and TMT-B. We then sought to understand the degree to which neuropsychological tools (i.e., DCTclockTM, TMT-A, and B) versus the Montreal Cognitive Assessment (MoCA) predict beta-amyloid (Aß) positron emission tomography (PET) status (positive or negative) in cognitively normal individuals. Participants and Methods: Participants included a sample of cognitively normal older adults (n= 59, M age = 69.2, F = 64%) recruited from the Butler Memory and Aging Program. The Linus Health DCTclockTM uses a digital pen to capture traditional clock drawing test performance and advanced analytics to evaluate the drawing process for indicators of cognitive difficulty. DCTclockTM may have overlapping cognitive properties with TMT measures, like efficiency, processing speed, and spatial reasoning. We compared latency measures (i.e., process efficiency, clock face speed, average latency, and processing speed) and spatial reasoning of the DCTclockTM to z-scores of TMT-A and TMT-B to detect any overlapping psychometric properties. Verbal fluency was included for discriminant validity. We then ran logistic regressions on a subset of the sample to compare neuropsychological tests (DCTclockTM total score [score that captures overall performance], TMT-A/B, and verbal fluency) to the MoCA, a commonly used cognitive screening tool, in determining PET status. Results: Highly correlated (r > .7) DCTclockTM variables were excluded. We found statistically significant correlations between some DCTclockTM measures and TMT-A/B, like DCTclockTM drawing process efficiency and TMT-A and TMT-B (r= .45, p< .001, r=.29, p< .026, respectively), and DCTclockTM average latency and TMT-A and TMT-B (r=.3, p< .024, r= .26, p< .044, respectively). No statistically significant associations were found between any DCTclockTM measures and verbal fluency, or between DCTclockTM spatial reasoning and TMT-A/B. We then investigated the effect of these neuropsychological tests (DCTclockTM total score, TMT-A/B, verbal fluency) and age on the likelihood of PET positivity (subset of sample, total PET, n=31). The model was statistically significant (x2 (5) = 15.35, p< .01). The model explained 53% (Nagelkerke R2) of the variance in PET status and correctly classified 74.2% of cases. DCTclockTM was the only significant predictor (p< .02), after controlling for TMT-A, TMT-B, verbal fluency, and age. Comparatively, there was no effect of MoCA and age (total PET, n= 29) on the likelihood of PET positivity. Conclusions: Overall, these results suggest psychometric convergence on elements of DCTclockTM and TMT-A/B, while there was no association in spatial operations between DCTclockTM and TMT measures. Further, when compared to the MoCA, DCTclockTM and these commonly used neuropsychological tests (verbal fluency and TMT-A/B) were better predictors of PET status, primarily driven by the DCTclockTM. Digitized neuropsychological tools may provide additional metrics not captured by pen-and-paper tests that can detect AD-associated pathology.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.010
metaresearch head score (Gemma)0.033
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.010
Threshold uncertainty score0.052

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0100.033
Meta-epidemiology (narrow)0.0010.000
Meta-epidemiology (broad)0.0010.002
Bibliometrics0.0020.001
Science and technology studies0.0000.001
Scholarly communication0.0010.002
Open science0.0010.001
Research integrity0.0010.001
Insufficient payload (model declined to judge)0.0030.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.039
GPT teacher head0.317
Teacher spread0.278 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2023
Admission routes1
Has abstractyes

Explore more

Same venueJournal of the International Neuropsychological SocietySame topicDementia and Cognitive Impairment ResearchFrench-language works237,207