MétaCan
Menu
Retour à la cohorte
Enregistrement W4393375382 · doi:10.1001/jamanetworkopen.2024.4266

Reliability and Validity of Smartphone Cognitive Testing for Frontotemporal Lobar Degeneration

2024· article· en· W4393375382 sur OpenAlexaffabout
Adam M. Staffaroni, Annie L Clark, Jack C. Taylor, Hilary W. Heuer, Mark Sanderson‐Cimino, Amy B. Wise, Sreya Dhanam, Yann Cobigo, Amy Wolf, Masood Manoochehri, Leah K. Forsberg, Carly Mester, Katherine P. Rankin, Brian S. Appleby, Ece Bayram, Andrea Bozoki, David Clark, R. Ryan Darby, Kimiko Domoto‐Reilly, Julie A. Fields, Douglas Galasko, Daniel H. Geschwind, Nupur Ghoshal, Neill R. Graff‐Radford, Murray Grossman, Ging‐Yuek Robin Hsiung, Edward D. Huey, David T. Jones, Maria I. Lapid, Irene Litvan, Joseph C. Masdeu, Lauren Massimo, Mario F. Mendez, Toji Miyagawa, Belén Pascual, Peter Pressman, Vijay K. Ramanan, Eliana Marisa Ramos, Katya Rascovsky, Erik D. Roberson, Maria Carmela Tartaglia, Bonnie Wong, Bruce L. Miller, John Kornak, Walter K. Kremers, Jason Hassenstab, Joel H. Kramer, Bradley F. Boeve, Howard J. Rosen, Adam L. Boxer, Liana G. Apostolova, Sami J. Barmada, Hugo Botha, Danielle Brushaber, Bradford Dickerson, Dennis W. Dickson, Fanny M. Elahi, Kelley Faber, Anne M. Fagan, Jamie Fong, Tatiana M. Foroud, Ralitza H. Gavrilova, Tania F. Gendron, Jill Goldman, Jonathan Graff‐Radford, Ian Grant, Matthew Hall, Chadwick M. Hales, Lawrence S. Honig, Eric J. Huang, David J. Irwin, Noah R. Johnson, Kejal Kantarci, David S. Knopman, Tyler Kolander, Justin Kwan, Argentina Lario Lago, Shannon B. Lavigne, Suzee Lee, Gabriel C. Léger, Peter A. Ljubenkov, Diane Lucente, Ian R. Mackenzie, Scott McGinnis, Corey T. McMillan, Joie Molden, Georges Naasan, Chiadi U. Onyike, Alexander Pantelyat, Emily W. Paolillo, Henry L. Paulson, Leonard Petrucelli, Rosa Rademakers, Meghana Rao, Kristoffer Rhoads, Jessica E. Rexach, Aaron Ritter, Emily Rogalskı, Julio C. Rojas, Rodolfo Savica, William W. Seeley, Allison Snyder, Anne C. Sullivan, Jeremy M. Syrjanen, Philip W. Tipton, Marijne Vandebergh, Arthur W. Toga, Lawren VandeVrede, Sandra Weıntraub, Dylan Wint, Zbigniew K. Wszołek, Jennifer Yokoyoma

Notice bibliographique

RevueJAMA Network Open · 2024
Typearticle
Langueen
DomaineMedicine
ThématiqueAmyotrophic Lateral Sclerosis Research
Établissements canadiensOccupational Cancer Research CentreUniversity of TorontoUniversity of British Columbia
Organismes subventionnairesNational Institute of Neurological Disorders and StrokeNational Institute of Mental HealthNational Institute on AgingNational Institutes of HealthLarry L. Hillblom Foundation
Mots-clésFrontotemporal lobar degenerationIntraclass correlationMedicineNeuropsychologyNeuropsychological assessmentCognitionConcurrent validityMemory clinicCohortReliability (semiconductor)Physical medicine and rehabilitationPhysical therapyPsychologyDementiaClinical psychologyFrontotemporal dementiaDiseasePsychiatryPsychometricsCognitive impairmentInternal consistencyInternal medicine

Résumé

récupéré en direct d'OpenAlex

Importance: Frontotemporal lobar degeneration (FTLD) is relatively rare, behavioral and motor symptoms increase travel burden, and standard neuropsychological tests are not sensitive to early-stage disease. Remote smartphone-based cognitive assessments could mitigate these barriers to trial recruitment and success, but no such tools are validated for FTLD. Objective: To evaluate the reliability and validity of smartphone-based cognitive measures for remote FTLD evaluations. Design, Setting, and Participants: In this cohort study conducted from January 10, 2019, to July 31, 2023, controls and participants with FTLD performed smartphone application (app)-based executive functioning tasks and an associative memory task 3 times over 2 weeks. Observational research participants were enrolled through 18 centers of a North American FTLD research consortium (ALLFTD) and were asked to complete the tests remotely using their own smartphones. Of 1163 eligible individuals (enrolled in parent studies), 360 were enrolled in the present study; 364 refused and 439 were excluded. Participants were divided into discovery (n = 258) and validation (n = 102) cohorts. Among 329 participants with data available on disease stage, 195 were asymptomatic or had preclinical FTLD (59.3%), 66 had prodromal FTLD (20.1%), and 68 had symptomatic FTLD (20.7%) with a range of clinical syndromes. Exposure: Participants completed standard in-clinic measures and remotely administered ALLFTD mobile app (app) smartphone tests. Main Outcomes and Measures: Internal consistency, test-retest reliability, association of smartphone tests with criterion standard clinical measures, and diagnostic accuracy. Results: In the 360 participants (mean [SD] age, 54.0 [15.4] years; 209 [58.1%] women), smartphone tests showed moderate-to-excellent reliability (intraclass correlation coefficients, 0.77-0.95). Validity was supported by association of smartphones tests with disease severity (r range, 0.38-0.59), criterion-standard neuropsychological tests (r range, 0.40-0.66), and brain volume (standardized β range, 0.34-0.50). Smartphone tests accurately differentiated individuals with dementia from controls (area under the curve [AUC], 0.93 [95% CI, 0.90-0.96]) and were more sensitive to early symptoms (AUC, 0.82 [95% CI, 0.76-0.88]) than the Montreal Cognitive Assessment (AUC, 0.68 [95% CI, 0.59-0.78]) (z of comparison, -2.49 [95% CI, -0.19 to -0.02]; P = .01). Reliability and validity findings were highly similar in the discovery and validation cohorts. Preclinical participants who carried pathogenic variants performed significantly worse than noncarrier family controls on 3 app tasks (eg, 2-back β = -0.49 [95% CI, -0.72 to -0.25]; P < .001) but not a composite of traditional neuropsychological measures (β = -0.14 [95% CI, -0.42 to 0.14]; P = .32). Conclusions and Relevance: The findings of this cohort study suggest that smartphones could offer a feasible, reliable, valid, and scalable solution for remote evaluations of FTLD and may improve early detection. Smartphone assessments should be considered as a complementary approach to traditional in-person trial designs. Future research should validate these results in diverse populations and evaluate the utility of these tests for longitudinal monitoring.

Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.

Comment cette classification a été obtenuedéplier

Prédiction distillée sur la base complète

Imitation des enseignants

Ni prévalence calibrée, ni vérité terrain. Validation humaine à venir. Apprise à partir de 10 348 étiquettes directes de Codex et de 10 348 étiquettes directes de Gemma. Le mode candidate est l'union des têtes enseignantes seuillées; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont ni des étiquettes humaines ni des étiquettes directes de modèles de pointe.

score de la tête « metaresearch » (Codex)0,002
score de la tête « metaresearch » (Gemma)0,001
Version: codex-gemma-dda1882f352aStatut de validation: machine_predicted_unvalidated
Catégories candidatesaucune
Catégories consensuellesaucune
DomaineSignal candidat: aucune · Signal consensuel: aucune
Devis d'étudeSignal candidat: Observationnel · Signal consensuel: Observationnel
GenreSignal candidat: Empirique · Signal consensuel: Empirique
Score de désaccord entre enseignants0,166
Score d'incertitude au seuil0,337

Scores Codex et Gemma par catégorie

CatégorieCodexGemma
Métarecherche0,0020,001
Méta-épidémiologie (sens strict)0,0000,000
Méta-épidémiologie (sens large)0,0000,000
Bibliométrie0,0000,000
Études des sciences et des technologies0,0000,000
Communication savante0,0000,000
Science ouverte0,0000,000
Intégrité de la recherche0,0000,000
Charge utile insuffisante (le modèle a refusé de juger)0,0000,000

Scores machine (provisoires)

Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.

Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.

Tête enseignante Opus0,115
Tête enseignante GPT0,367
Écart entre enseignants0,252 · la distance entre les deux têtes enseignantes sur ce seul travail
Statut de validationscore_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découle

Classification

machine, non validée

Prédiction automatique; un appel candidat d’une seule tête enseignante, pas un consensus.

Les modèles n’ont appliqué aucune catégorie : rien dans la taxonomie ne correspondait à ce travail.
Devis d'étudeObservationnel
Domainenon disponible
GenreEmpirique

Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».

En bref

Citations20
Publié2024
Routes d'admission2
Résumé présentoui

Explorer davantage

Même revueJAMA Network OpenMême sujetAmyotrophic Lateral Sclerosis ResearchTravaux en français237 207