MétaCan
Menu
Back to cohort
Record W4281621803 · doi:10.1080/23279095.2022.2079088

CVLT-II short form forced choice recognition in a clinical dementia sample: Cautions for performance validity assessment

2022· article· en· W4281621803 on OpenAlexafffund
Karl S Grewal, Michaella Trites, Andrew Kirk, Stuart MacDonald, Debra Morgan, Rory Gowda-Sookochoff, Megan E. O’Connell

Bibliographic record

VenueApplied Neuropsychology Adult · 2022
Typearticle
Languageen
FieldMedicine
TopicDementia and Cognitive Impairment Research
Canadian institutionsUniversity of VictoriaUniversity of Saskatchewan
FundersCanadian Institutes of Health ResearchAlzheimer SocietySaskatchewan Health Research FoundationConsortium canadien en neurodégénérescence associée au vieillissementUniversity of Saskatchewan
KeywordsClinical Dementia RatingDementiaCalifornia Verbal Learning TestPsychologyClinical psychologyAudiologyCognitionCognitive impairmentVerbal learningPsychiatryDiseaseMedicineInternal medicine

Abstract

fetched live from OpenAlex

Performance validity tests are susceptible to false positives from genuine cognitive impairment (e.g., dementia); this has not been explored with the short form of the California Verbal Learning Test II (CVLT-II-SF). In a memory clinic sample, we examined whether CVLT-II-SF Forced Choice Recognition (FCR) scores differed across diagnostic groups, and how the severity of impairment [Clinical Dementia Rating Sum of Boxes (CDR-SOB) or Mini-Mental State Examination (MMSE)] modulated test performance. Three diagnostic groups were identified: subjective cognitive impairment (SCI; n = 85), amnestic mild cognitive impairment (a-MCI; n = 17), and dementia due to Alzheimer’s Disease (AD; n = 50). Significant group differences in FCR were observed using one-way ANOVA; post-hoc analysis indicated the AD group performed significantly worse than the other groups. Using multiple regression, FCR performance was modeled as a function of the diagnostic group, severity (MMSE or CDR-SOB), and their interaction. Results yielded significant main effects for MMSE and diagnostic group, with a significant interaction. CDR-SOB analyses were non-significant. Increases in impairment disproportionately impacted FCR performance for persons with AD, adding caution to research-based cutoffs for performance validity in dementia. Caution is warranted when assessing performance validity in dementia populations. Future research should examine whether CVLT-II-SF-FCR is appropriately specific for best-practice testing batteries for dementia.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.277
metaresearch head score (Gemma)0.333
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.277
Threshold uncertainty score0.891

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.2770.333
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0030.002
Bibliometrics0.0020.002
Science and technology studies0.0030.005
Scholarly communication0.0040.002
Open science0.0040.002
Research integrity0.0020.004
Insufficient payload (model declined to judge)0.0010.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.096
GPT teacher head0.418
Teacher spread0.322 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations8
Published2022
Admission routes2
Has abstractyes

Explore more

Same venueApplied Neuropsychology AdultSame topicDementia and Cognitive Impairment ResearchFrench-language works237,207