MétaCan
Menu
← Back to cohort
Record W4367302974 · doi:10.1212/wnl.0000000000202460

Examining a Preclinical Alzheimer’s Cognitive Composite for Telehealth Administration, the tPACC, for Reliability between In-Person and Remote Cognitive Testing (P6-6.002)

2023· article· en· W4367302974 on OpenAlexaboutno aff
Tuğçe Duran, Sarah A. Gaussoin, Samuel N. Lockhart, Melissa M. Rundle, Mark A. Espeland, Benjamin J. Williams, Timothy M. Hughes, Suzanne Craft, Bonnie C. Sachs, James R. Bateman

Bibliographic record

VenueNeurology · 2023
Typearticle
Languageen
FieldMedicine
TopicDementia and Cognitive Impairment Research
Canadian institutionsnot available
Fundersnot available
KeywordsDementiaCognitionConcordanceMontreal Cognitive AssessmentAudiologyMedicineBoston Naming TestVerbal fluency testCognitive declineReliability (semiconductor)NeuropsychologyPsychologyCognitive impairmentPsychiatryDiseaseInternal medicine

Abstract

fetched live from OpenAlex

Objective: To evaluate the concordance of tPACC scores from in-person and remote testing. Background: The clinical trial landscape in Alzheimer’s disease (AD) and related dementias is focused on targeting individuals in preclinical stages. The preclinical Alzheimer’s cognitive composite (PACC) was developed for in-person administration to capture subtle cognitive decline in amyloid positive individuals compared to amyloid negative. It is desirable to have a transportable, composite measurement sensitive to detecting cognitive changes across cognitively normal (NC) and impaired (MCI and dementia) participants. Design/Methods: We examined in-person cognitive data from 662 adults (70.2±8.1y) from the Wake Forest AD Research Center’s Clinical Core, who received clinical evaluation, cognitive testing, and adjudication. The PACC in-person only was calculated using RAVLT Delayed Recall, Digit Symbol Coding (DSC), semantic fluency, Craft Story Delayed Verbatim, and MMSE total scores using baseline NC participants as a reference. The tPACC used measurements that were available at both in-person and remote visits with modifications from the in-person PACC; Montreal Cognitive Assessment (MoCA) was used in place of MMSE, and DSC was not included. A subset analysis with PACC in-person and tPACC remote from a pilot study examined reliability between in-person and remote testing. We performed correlation analysis and generated Bland-Altman plots. Results: Of the 662 adults studied, 434 (66%) were female, 522 (79%) were White, 206 (34%) were APOE4 carriers, and mean education was 15.9±4.1 years. At baseline, there is a significant positive relationship between in-person tPACC and PACC (Overall group; r2=0.94, p=<0.0001, n=640). Although there is a good agreement in both subgroups (Impaired: r2=0.86, p=<0.0001, n=301 and NC: r2=0.90, p=<0.0001, n=328), tPACC overestimates cognitive performance compared to PACC for those with lower scores. We also found good agreement between in-person PACC and remote tPACC (r2=0.83, p=<0.0001, n=38). Conclusions: There is generally good agreement between tPACC and PACC for NC and impaired individuals. Disclosure: Miss Duran has nothing to disclose. The institution of Ms. Gaussoin has received research support from NIH. The institution of Dr. Lockhart has received research support from NIH. Dr. Rundle has nothing to disclose. The institution of Dr. Espeland has received research support from Alzheimer’s Association. The institution of Dr. Espeland has received research support from National Institutes of Health. Dr. Espeland has received personal compensation in the range of $500-$4,999 for serving as a Consultant with National Institutes of Health. Dr. Williams has nothing to disclose. Tim Hughes has nothing to disclose. Suzanne Craft has received personal compensation in the range of $500-$4,999 for serving as a Consultant for Cognito Therapeutics. Suzanne Craft has received personal compensation in the range of $500-$4,999 for serving on a Scientific Advisory or Data Safety Monitoring board for T3D Therapeutics. Suzanne Craft has received personal compensation in the range of $500-$4,999 for serving on a Scientific Advisory or Data Safety Monitoring board for Cyclerion Therapeutics. Suzanne Craft has received personal compensation in the range of $500-$4,999 for serving as a member, Board of Scientific Counselors with NIA. Bonnie Sachs has received research support from NIH. Bonnie Sachs has received research support from Alzheimer’s Association. The institution of Dr. Bateman has received research support from NIA.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.009
metaresearch head score (Gemma)0.016
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.009
Threshold uncertainty score0.046

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0090.016
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.001
Bibliometrics0.0010.001
Science and technology studies0.0010.000
Scholarly communication0.0010.001
Open science0.0010.001
Research integrity0.0010.001
Insufficient payload (model declined to judge)0.0030.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.221
GPT teacher head0.436
Teacher spread0.215 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2023
Admission routes1
Has abstractyes

Explore more

Same venueNeurology→Same topicDementia and Cognitive Impairment Research→French-language works237,207→