MétaCan
Menu
Back to cohort
Record W4293225845 · doi:10.21203/rs.3.rs-1353212/v1

Issues and Recommendations for the Residual Approach to Quantifying Cognitive Resilience and Reserve

2022· preprint· en· W4293225845 on OpenAlexfundno aff
Jeremy A. Elman, Jacob W. Vogel, Diana I. Bocancea, Rik Ossenkoppele, Anna C. van Loenhoud, Xin Tu, William S. Kremen

Bibliographic record

VenueResearch Square · 2022
Typepreprint
Languageen
FieldEnvironmental Science
TopicHealth, Environment, Cognitive Aging
Canadian institutionsnot available
FundersNational Institute of Biomedical Imaging and BioengineeringCanadian Institutes of Health ResearchNational Institutes of HealthGenentechIXICOH. Lundbeck A/SServierEisaiNorthern California Institute for Research and EducationNovartis Pharmaceuticals CorporationBioClinicaU.S. Department of DefenseMeso Scale DiagnosticsAlzheimer's Disease Neuroimaging InitiativeF. Hoffmann-La RocheUniversity of Southern CaliforniaBiogenEli Lilly and CompanyBristol-Myers SquibbNational Institute on AgingAlzheimer's AssociationFoundation for the National Institutes of Health
KeywordsOperationalizationCognitionPsychologyResilience (materials science)Metric (unit)Psychological resilienceContext (archaeology)Cognitive psychologySocial psychologyEconomicsGeographyOperations management

Abstract

fetched live from OpenAlex

Abstract Background: Cognitive reserve and resilience are terms used to explain interindividual variability in maintenance of cognitive health in response to adverse factors, such as brain pathology in the context of aging or neurodegenerative disorders. There is substantial interest in identifying tractable substrates of resilience to potentially leverage this phenomenon into intervention strategies. One way of operationalizing cognitive reserve/resilience that has gained popularity is the residual method: regressing cognition on an adverse factor and using the residual as a measure of resilience. This method is attractive because it provides a statistical approach that is an intuitive match to the reserve/resilience conceptual framework. However, due to statistical properties of the regression equation, the residual approach has qualities that complicate its interpretation as an index of resilience and make it statistically inappropriate in certain circumstances. Methods and Results: Using both simulations and real data, we demonstrate that in most real-life scenarios, the residual measure of cognitive resilience is highly correlated with cognition, the dependent variable from which it is derived, and the degree of this correlation depends on the initial relationship between the adverse factor and cognition. Subsequently, any association between this resilience metric and an external variable may actually be driven by cognition, rather than by an operationalized measure of resilience. This limitation becomes especially troublesome when the resilience metric is incorporated into models testing a cognition-dependent variable, such as cognitive decline or change in cognitive status. Conclusions: We briefly summarize strategies proposed as potential solutions. However, we conclude these solutions may be insufficient, and we instead recommend against "pre-regression" strategies altogether, in favor of using statistical moderation (e.g., interactions) to quantify resilience. Caution should be taken in the use and interpretation of the residual-based method of cognitive resilience, but we encourage continued work toward operationalizing this very important phenomenon.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.009
metaresearch head score (Gemma)0.003
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesScience and technology studies
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.385
Threshold uncertainty score0.999

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0090.003
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0020.001
Scholarly communication0.0000.000
Open science0.0010.007
Research integrity0.0000.002
Insufficient payload (model declined to judge)0.0010.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.221
GPT teacher head0.471
Teacher spread0.250 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations1
Published2022
Admission routes1
Has abstractyes

Explore more

Same venueResearch SquareSame topicHealth, Environment, Cognitive AgingFrench-language works237,207