MétaCan
Menu
Back to cohort
Record W4293225845 · doi:10.21203/rs.3.rs-1353212/v1

Issues and Recommendations for the Residual Approach to Quantifying Cognitive Resilience and Reserve

2022· preprint· en· W4293225845 on OpenAlexfundno aff
Jeremy A. Elman, Jacob W. Vogel, Diana I. Bocancea, Rik Ossenkoppele, Anna C. van Loenhoud, Xin Tu, William S. Kremen

Bibliographic record

VenueResearch Square · 2022
Typepreprint
Languageen
FieldEnvironmental Science
TopicHealth, Environment, Cognitive Aging
Canadian institutionsnot available
FundersNational Institute of Biomedical Imaging and BioengineeringCanadian Institutes of Health ResearchNational Institutes of HealthGenentechIXICOH. Lundbeck A/SServierEisaiNorthern California Institute for Research and EducationNovartis Pharmaceuticals CorporationBioClinicaU.S. Department of DefenseMeso Scale DiagnosticsAlzheimer's Disease Neuroimaging InitiativeF. Hoffmann-La RocheUniversity of Southern CaliforniaBiogenEli Lilly and CompanyBristol-Myers SquibbNational Institute on AgingAlzheimer's AssociationFoundation for the National Institutes of Health
KeywordsOperationalizationCognitionPsychologyResilience (materials science)Metric (unit)Psychological resilienceContext (archaeology)Cognitive psychologySocial psychologyEconomicsGeographyOperations management

Abstract

fetched live from OpenAlex

Abstract Background: Cognitive reserve and resilience are terms used to explain interindividual variability in maintenance of cognitive health in response to adverse factors, such as brain pathology in the context of aging or neurodegenerative disorders. There is substantial interest in identifying tractable substrates of resilience to potentially leverage this phenomenon into intervention strategies. One way of operationalizing cognitive reserve/resilience that has gained popularity is the residual method: regressing cognition on an adverse factor and using the residual as a measure of resilience. This method is attractive because it provides a statistical approach that is an intuitive match to the reserve/resilience conceptual framework. However, due to statistical properties of the regression equation, the residual approach has qualities that complicate its interpretation as an index of resilience and make it statistically inappropriate in certain circumstances. Methods and Results: Using both simulations and real data, we demonstrate that in most real-life scenarios, the residual measure of cognitive resilience is highly correlated with cognition, the dependent variable from which it is derived, and the degree of this correlation depends on the initial relationship between the adverse factor and cognition. Subsequently, any association between this resilience metric and an external variable may actually be driven by cognition, rather than by an operationalized measure of resilience. This limitation becomes especially troublesome when the resilience metric is incorporated into models testing a cognition-dependent variable, such as cognitive decline or change in cognitive status. Conclusions: We briefly summarize strategies proposed as potential solutions. However, we conclude these solutions may be insufficient, and we instead recommend against "pre-regression" strategies altogether, in favor of using statistical moderation (e.g., interactions) to quantify resilience. Caution should be taken in the use and interpretation of the residual-based method of cognitive resilience, but we encourage continued work toward operationalizing this very important phenomenon.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.131
metaresearch head score (Gemma)0.326
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Theoretical or conceptual · Consensus signal: none
GenreCandidate signal: Methods · Consensus signal: none
Teacher disagreement score0.131
Threshold uncertainty score0.694

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.1310.326
Meta-epidemiology (narrow)0.0040.002
Meta-epidemiology (broad)0.0050.005
Bibliometrics0.0070.007
Science and technology studies0.0030.017
Scholarly communication0.0160.031
Open science0.0190.010
Research integrity0.0190.026
Insufficient payload (model declined to judge)0.0270.009

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.221
GPT teacher head0.471
Teacher spread0.250 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designTheoretical or conceptual
Domainnot available
GenreMethods

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations1
Published2022
Admission routes1
Has abstractyes

Explore more

Same venueResearch SquareSame topicHealth, Environment, Cognitive AgingFrench-language works237,207