MétaCan
Menu
Back to cohort
Record W3016470865 · doi:10.1101/2020.04.15.043315

TOWARD A CONNECTIVITY GRADIENT-BASED FRAMEWORK FOR REPRODUCIBLE BIOMARKER DISCOVERY

2020· preprint· en· W3016470865 on OpenAlexafffund
Seok‐Jun Hong, Ting Xu, Aki Nikolaidis, Jonathan Smallwood, Daniel S. Margulies, Boris C. Bernhardt, Joshua T Vogelstein, Michael P. Milham

Bibliographic record

VenuebioRxiv (Cold Spring Harbor Laboratory) · 2020
Typepreprint
Languageen
FieldNeuroscience
TopicFunctional Brain Connectivity Studies
Canadian institutionsMcGill UniversityMontreal Neurological Institute and Hospital
FundersCentre Azrieli de recherche sur l'autisme, Institut et Hôpital Neurologiques de MontréalNational Institute of Mental HealthNatural Sciences and Engineering Research Council of CanadaCanadian Institutes of Health ResearchHospital for Sick ChildrenInstitute for Basic ScienceCanada Research ChairsNational Alliance for Research on Schizophrenia and Depression
KeywordsDimensionality reductionBiomarker discoveryReliability (semiconductor)Human Connectome ProjectComputer sciencePrincipal component analysisArtificial intelligencePattern recognition (psychology)Functional connectivityBiomarkerCurse of dimensionalityData miningBiologyNeuroscienceGenetics

Abstract

fetched live from OpenAlex

A bstract Despite myriad demonstrations of feasibility, the high dimensionality of fMRI data remains a critical barrier to its utility for reproducible biomarker discovery. Recent studies applying dimensionality reduction techniques to resting-state fMRI (R-fMRI) have unveiled neurocognitively meaningful connectivity gradients that are present in both human and primate brains, and appear to differ meaningfully among individuals and clinical populations. Here, we provide a critical assessment of the suitability of connectivity gradients for biomarker discovery. Using the Human Connectome Project (discovery subsample=209; two replication subsamples= 209×2) and the Midnight scan club (n=9), we tested the following key biomarker traits – reliability, reproducibility and predictive validity – of functional gradients. In doing so, we systematically assessed the effects of three analytical settings, including i ) dimensionality reduction algorithms ( i.e ., linear vs . non-linear methods), ii ) input data types ( i.e ., raw time series, [un-]thresholded functional connectivity), and iii ) amount of the data (R-fMRI time-series lengths). We found that the reproducibility of functional gradients across algorithms and subsamples is generally higher for those explaining more variances of whole-brain connectivity data, as well as those having higher reliability. Notably, among different analytical settings, a linear dimensionality reduction (principal component analysis in our study), more conservatively thresholded functional connectivity ( e.g ., 95-97%) and longer time-series data (at least ≥20mins) was found to be preferential conditions to obtain higher reliability. Those gradients with higher reliability were able to predict unseen phenotypic scores with a higher accuracy, highlighting reliability as a critical prerequisite for validity. Importantly, prediction accuracy with connectivity gradients exceeded that observed with more traditional edge-based connectivity measures, suggesting the added value of a low-dimensional gradient approach. Finally, the present work highlights the importance and benefits of systematically exploring the parameter space for new imaging methods before widespread deployment. H ighlights - There is a growing need to identify benchmark parameters in advancing functional connectivity gradients into a reliable biomarker. - Here, we explored multidimensional parameter space in calculating functional gradients to improve their reproducibility, reliability and predictive validity. - We demonstrated that more reproducible and reliable gradient markers tend to have higher predictive power for unseen phenotypic scores across various cognitive domains. - We showed that the low-dimensional connectivity gradient approach could outperform raw edge-based analyses in terms of predicting phenotypic scores. - We highlight the necessity of optimizing parameters for new imaging methods before their widespread deployment.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.023
metaresearch head score (Gemma)0.050
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: Reproducibility · Consensus signal: none
Study designCandidate signal: Theoretical or conceptual · Consensus signal: none
GenreCandidate signal: Methods · Consensus signal: Methods
Teacher disagreement score0.977
Threshold uncertainty score0.124

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0230.050
Meta-epidemiology (narrow)0.0020.001
Meta-epidemiology (broad)0.0030.002
Bibliometrics0.0050.003
Science and technology studies0.0010.004
Scholarly communication0.0050.004
Open science0.0040.005
Research integrity0.0030.005
Insufficient payload (model declined to judge)0.0020.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.076
GPT teacher head0.273
Teacher spread0.197 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designTheoretical or conceptual
DomainReproducibility
GenreMethods

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations16
Published2020
Admission routes2
Has abstractyes

Explore more

Same venuebioRxiv (Cold Spring Harbor Laboratory)Same topicFunctional Brain Connectivity StudiesFrench-language works237,207