MétaCan
Menu
Back to cohort
Record W3020909737 · doi:10.1101/2020.04.23.20077099

Improving reporting standards for polygenic scores in risk prediction studies

2020· preprint· en· W3020909737 on OpenAlex
Hannah Wand, Samuel A. Lambert, Cecelia P. Tamburro, Michael A. Iacocca, Jack W. O’Sullivan, Catherine H. Sillari, Iftikhar J. Kullo, Robb Rowley, Jacqueline S. Dron, Deanna Brockman, Eric Venner, Mark I. McCarthy, Antonis C. Antoniou, Douglas F. Easton, Robert A. Hegele, Amit V. Khera, Nilanjan Chatterjee, Charles Kooperberg, Karen L. Edwards, Katherine Vlessis, Kim Kinnear, John Danesh, Helen Parkinson, Erin M. Ramos, Megan C. Roberts, Kelly E. Ormond, Muin J. Khoury, A. Cecile J.W. Janssens, Katrina A.B. Goddard, Peter Kraft, Jacqueline A. L. MacArthur, Michael Inouye, Genevieve L. Wojcik

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.
fundA Canadian funder is recorded on the work.

Bibliographic record

VenuemedRxiv · 2020
Typepreprint
Languageen
FieldBiochemistry, Genetics and Molecular Biology
TopicGenetic Associations and Epidemiology
Canadian institutionsWestern University
FundersNational Institute of Child Health and Human DevelopmentNational Institute of Diabetes and Digestive and Kidney DiseasesNational Human Genome Research InstituteEunice Kennedy Shriver National Institute of Child Health and Human DevelopmentNIHR Cambridge Biomedical Research CentreEconomic and Social Research CouncilMedical Research CouncilChief Scientist Office, Scottish Government Health and Social Care DirectorateCambridge University HospitalsNational Institutes of HealthUniversity of CambridgeDepartment of Health and Social CareScottish GovernmentBritish Heart FoundationCanadian Institutes of Health ResearchHealth and Social Care Research and Development DivisionNational Institute for Health and Care ResearchPublic Health AgencyEngineering and Physical Sciences Research CouncilEuropean Molecular Biology Laboratory
KeywordsBenchmarkingComputer sciencePopulationBest practiceData scienceMedicineEnvironmental healthBusiness

Abstract

fetched live from OpenAlex

Abstract Polygenic risk scores (PRS), often aggregating the results from genome-wide association studies, can bridge the gap between the initial variant discovery efforts and disease risk estimation for clinical applications. However, there is remarkable heterogeneity in the reporting of these risk scores due to a lack of adherence to reporting standards and no accepted standards suited for the current state of PRS development and application. This lack of adherence and best practices hinders the translation of PRS into clinical care. The ClinGen Complex Disease Working Group, in a collaboration with the Polygenic Score (PGS) Catalog, have developed a novel PRS Reporting Statement (PRS-RS), updating previous standards to the current state of the field and to enable downstream utility. Drawing upon experts in epidemiology, statistics, disease-specific applications, implementation, and policy, this 23-item reporting framework defines the minimal information needed to interpret and evaluate a PRS, especially with respect to any downstream clinical applications. Items span detailed descriptions of the study population (recruitment method, key demographics, inclusion/exclusion criteria, and phenotype definition), statistical methods for both PRS development and validation, and considerations for potential limitations of the published risk score and downstream clinical utility. Additionally, emphasis has been placed on data availability and transparency to facilitate reproducibility and benchmarking against other PRS, such as deposition in the publicly available PGS Catalog ( www.PGScatalog.org ). By providing these criteria in a structured format that builds upon existing standards and ontologies, the use of this framework in publishing PRS will facilitate translation of PRS into clinical care and progress towards defining best practices. Summary In recent years, polygenic risk scores (PRS) have become an increasingly studied tool to capture the genome-wide liability underlying many human traits and diseases, hoping to better inform an individual’s genetic risk. However, a lack of tailored reporting standards has hindered the translation of this important tool into clinical and public health practice with the heterogeneous underreporting of details necessary for benchmarking and reproducibility. To address this gap, the ClinGen Complex Disease Working Group and Polygenic Score (PGS) Catalog have collaborated to develop the 23-item Polygenic Risk Score Reporting Statement (PRS-RS). This framework provides the minimal information expected of authors to promote the validity, transparency, and reproducibility of PRS by requiring authors to detail the study population, statistical methods, and potential clinical utility of a published score. The widespread adoption of this framework will encourage rigorous methodological consideration and facilitate benchmarking to ensure high quality scores are translated into the clinic.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.003
metaresearch head score (Gemma)0.018
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.022
Threshold uncertainty score0.991

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0030.018
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0010.000
Bibliometrics0.0000.000
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.048
GPT teacher head0.348
Teacher spread0.301 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it