MétaCan
Menu
← Back to cohort
Record W4409643242 · doi:10.1101/2025.04.15.649049

Functional relevance of CASP16 nucleic acid predictions as evaluated by structure providers

2025· preprint· en· W4409643242 on OpenAlexafffund
Rachael C. Kretsch, Reinhard Albrecht, Ebbe Sloth Andersen, Hsuan‐Ai Chen, Wah Chiu, Rhiju Das, Jeanine Gezelle, Marcus D. Hartmann, Claudia Höbartner, Yimin Hu, Shekhar Jadhav, Philip E. Johnson, Christopher P. Jones, Deepak Koirala, Emil L. Kristoffersen, Eric Largy, Anna Lewicka, Cameron D. Mackereth, Marco Marcia, Michela Nigro, Manju Ojha, Joseph A. Piccirilli, Phoebe A. Rice, Heewhan Shin, Anna‐Lena Steckelberg, Zhaoming Su, Yoshita Srivastava, Liu Wang, Yuan Wu, Jiahao Xie, Nikolaj H. Zwergius, John Moult, Andriy Kryshtafovych

Bibliographic record

VenuebioRxiv (Cold Spring Harbor Laboratory) · 2025
Typepreprint
Languageen
FieldBiochemistry, Genetics and Molecular Biology
TopicRNA and protein synthesis mechanisms
Canadian institutionsYork University
FundersOffice of Research Infrastructure Programs, National Institutes of HealthNational Key Research and Development Program of ChinaLeibniz-GemeinschaftNatural Sciences and Engineering Research Council of CanadaOffice of ScienceNational Institutes of HealthNovo Nordisk FondenNational Natural Science Foundation of ChinaEuropean Synchrotron Radiation FacilityDeutsche ForschungsgemeinschaftArgonne National LaboratoryAarhus UniversitetU.S. Department of EnergyNational Institute of Allergy and Infectious DiseasesHoward Hughes Medical InstituteVillum FondenNational Institute of General Medical SciencesNovo NordiskCommon FundGottfried Wilhelm Leibniz Universität HannoverEuropean Molecular Biology LaboratoryNational Science Foundation
KeywordsRelevance (law)Nucleic acidNucleic acid structureComputational biologyBusinessComputer scienceChemistryRisk analysis (engineering)BiologyRNABiochemistryPolitical science

Abstract

fetched live from OpenAlex

Accurate biomolecular structure prediction enables the prediction of mutational effects, the speculation of function based on predicted structural homology, the analysis of ligand binding modes, experimental model building and many other applications. Such algorithms to predict essential functional and structural features remain out of reach for biomolecular. Here, we report quantitative and qualitative evaluation of nucleic acid structures for the CASP16 blind prediction challenge by 12 of the experimental groups who provided nucleic acid targets. Blind predictions accurately model secondary structure and some aspects of tertiary structure, including reasonable global folds for some complex RNAs, however, predictions often lack accuracy in the regions of highest functional importance. All models have inaccuracies in non-canonical regions where, e.g., the nucleic-acid backbone bends or a base forms a non-standard hydrogen bond. These bends and non-canonical interactions are integral to form functionally important regions such as RNA enzymatic active sites. Additionally, the modeling of conserved and functional interfaces between nucleic acids and ligands, proteins, or other nucleic acids remains poor. For some targets, the experimental structures may not represent the only structure the biomolecular complex occupies in solution or in its functional life-cycle, posing a future challenge for the community.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.015
metaresearch head score (Gemma)0.049
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Bench or experimental · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.015
Threshold uncertainty score0.080

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0150.049
Meta-epidemiology (narrow)0.0010.000
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0020.001
Science and technology studies0.0010.001
Scholarly communication0.0030.002
Open science0.0010.001
Research integrity0.0010.001
Insufficient payload (model declined to judge)0.0060.003

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.009
GPT teacher head0.219
Teacher spread0.210 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designBench or experimental
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations10
Published2025
Admission routes2
Has abstractyes

Explore more

Same venuebioRxiv (Cold Spring Harbor Laboratory)→Same topicRNA and protein synthesis mechanisms→French-language works237,207→