{"id":"W4391364434","doi":"10.1242/dmm.050717","title":"Valuing peer review at Disease Models & Mechanisms","year":2024,"lang":"en","type":"article","venue":"Disease Models & Mechanisms","topic":"Academic Publishing and Open Access","field":"Decision Sciences","cited_by":1,"is_retracted":false,"has_abstract":true,"ca_institutions":"","funders":"Medical Research Council; School of Medicine, Duke University; National Institutes of Health; Sickkids Research Institute; Hospital for Sick Children; Centre National de la Recherche Scientifique; Sultan Qaboos University; University of Illinois at Urbana-Champaign; Monash University; Rosetrees Trust; University of Leeds; Universiteit Leiden; Newcastle University; Washington University in St. Louis; Oregon State University; Victor Chang Cardiac Research Institute; Emory University; Children's Hospital Los Angeles","keywords":"Preprint; Context (archaeology); Server; Internet privacy; Scope (computer science); Peer review; Computer science; Download; Public relations; World Wide Web; Political science; Law; History","routes":{"ca_aff":false,"ca_fund":true,"ca_venue":false,"about_ca":false,"invisible_to_affiliation_only":true},"retraction":null,"screen":null,"direct_labels":[{"model":"gemma","categories":["metaresearch"],"domain":"evaluation","study_design":"not_applicable","genre":"editorial","about_ca_system":false,"about_ca_topic":false,"confidence":"medium","status":"direct model label, unvalidated"},{"model":"gpt","categories":["metaresearch"],"domain":"evaluation","study_design":"not_applicable","genre":"commentary","about_ca_system":false,"about_ca_topic":false,"confidence":"medium","status":"direct model label, unvalidated"}],"prediction":{"model_version":"codex-gemma-dda1882f352a","candidate_categories":["metaepi_narrow","scholarly_communication","insufficient_payload"],"consensus_categories":["insufficient_payload"],"category_scores_codex":[0.01160175,0.0007691929,0.0009371091,0.00060145,0.0006974881,0.003332427,0.004398634,0.0002615234,0.002518581],"category_scores_gemma":[0.004709261,0.000588986,0.0009327487,0.001823591,0.000104258,0.00692988,0.001950604,0.0008140151,0.002961762],"about_ca_system_candidate":false,"about_ca_system_consensus":false,"about_ca_system_score_codex":0.0003669298,"about_ca_system_score_gemma":0.0007586898,"about_ca_topic_candidate":false,"about_ca_topic_consensus":false,"about_ca_topic_score_codex":0.00004391941,"about_ca_topic_score_gemma":0.0000116653,"domain_scores_codex":[0.9841697,0.0006346653,0.001587329,0.00257496,0.009863482,0.001169842],"domain_scores_gemma":[0.9924701,0.0007517822,0.0003406895,0.002493948,0.001368865,0.002574619],"domain_codex":null,"domain_gemma":null,"domain_candidate":null,"domain_consensus":null,"study_design_codex":"theoretical_or_conceptual","study_design_gemma":"theoretical_or_conceptual","study_design_scores_codex":[0.0001310769,0.0001071291,0.000005503574,0.000488605,0.00007397533,0.0002738261,0.0003981012,0.01873679,0.0002428174,0.7012648,0.26851,0.009767416],"study_design_scores_gemma":[0.0001534411,0.00001059255,0.000008040442,0.001158165,0.0002461363,0.000007265683,0.00004067793,0.3424285,0.00004551502,0.6352479,0.02013614,0.0005175764],"study_design_candidate":"theoretical_or_conceptual","study_design_consensus":"theoretical_or_conceptual","genre_codex":"methods","genre_gemma":"empirical","genre_scores_codex":[0.002332368,0.04463342,0.9158924,0.02629166,0.002256982,0.001176931,0.0009706703,0.0008090178,0.005636595],"genre_scores_gemma":[0.8683077,0.003804731,0.008826277,0.01605857,0.0005670153,0.0006427066,0.0007238258,0.0002738256,0.1007954],"genre_candidate":"methods","genre_consensus":null,"teacher_disagreement_score":0.9070661,"threshold_uncertainty_score":0.9996561,"prediction_status":"machine_predicted_unvalidated"},"machine_scores":{"provisional":true,"baseline":true,"maturity_gate_passed":false,"score_opus":0.1906460550178648,"score_gpt":0.4148430747338178,"score_spread":0.2241970197159529,"validation_status":"score_only:v0-immature-baseline","note":"Baseline scores from an immature model (maturity gate not passed). Scores rank; they never assert a category."}}