{"id":"W4391364434","doi":"10.1242/dmm.050717","title":"Valuing peer review at Disease Models & Mechanisms","year":2024,"lang":"en","type":"article","venue":"Disease Models & Mechanisms","topic":"Academic Publishing and Open Access","field":"Decision Sciences","cited_by":1,"is_retracted":false,"has_abstract":true,"ca_institutions":"","funders":"Medical Research Council; School of Medicine, Duke University; National Institutes of Health; Sickkids Research Institute; Hospital for Sick Children; Centre National de la Recherche Scientifique; Sultan Qaboos University; University of Illinois at Urbana-Champaign; Monash University; Rosetrees Trust; University of Leeds; Universiteit Leiden; Newcastle University; Washington University in St. Louis; Oregon State University; Victor Chang Cardiac Research Institute; Emory University; Children's Hospital Los Angeles","keywords":"Preprint; Context (archaeology); Server; Internet privacy; Scope (computer science); Peer review; Computer science; Download; Public relations; World Wide Web; Political science; Law; History","routes":{"ca_aff":false,"ca_fund":true,"ca_venue":false,"about_ca":false,"invisible_to_affiliation_only":true},"retraction":null,"screen":null,"direct_labels":[{"model":"gemma","categories":["metaresearch"],"domain":"evaluation","study_design":"not_applicable","genre":"editorial","about_ca_system":false,"about_ca_topic":false,"confidence":"medium","status":"direct model label, unvalidated"},{"model":"gpt","categories":["metaresearch"],"domain":"evaluation","study_design":"not_applicable","genre":"commentary","about_ca_system":false,"about_ca_topic":false,"confidence":"medium","status":"direct model label, unvalidated"}],"prediction":{"model_version":"metacan-v3-hybrid-931329e0061c","candidate_categories":["metaresearch"],"consensus_categories":["metaresearch"],"category_scores_codex":[0.2561254,0.001477011,0.004010973,0.005175103,0.009627749,0.03918299,0.006692052,0.01817923,0.03016062],"category_scores_gemma":[0.5865126,0.002275405,0.00238981,0.003918902,0.02603889,0.03645901,0.02097072,0.02181433,0.02307578],"about_ca_system_candidate":false,"about_ca_system_consensus":false,"about_ca_system_score_codex":0.008279882,"about_ca_system_score_gemma":0.03372175,"about_ca_topic_candidate":false,"about_ca_topic_consensus":false,"about_ca_topic_score_codex":0.001713989,"about_ca_topic_score_gemma":0.001803271,"domain_scores_codex":[0.6804367,0.1856738,0.0221807,0.02263484,0.08023589,0.008837969],"domain_scores_gemma":[0.2175633,0.2951924,0.08830371,0.1874874,0.1512229,0.06023021],"domain_codex":null,"domain_gemma":"evaluation","domain_candidate":"evaluation","domain_consensus":null,"study_design_codex":"not_applicable","study_design_gemma":"not_applicable","study_design_scores_codex":[0.0008303173,0.0002291499,0.007226743,0.004563581,0.0007739593,0.001289484,0.009349265,0.0009318244,0.009025531,0.2352972,0.4194172,0.3110658],"study_design_scores_gemma":[0.0001495247,0.0003440775,0.004754919,0.001866884,0.0001862391,0.0009823819,0.0012964,0.001670815,0.002880239,0.1556981,0.8298234,0.0003471368],"study_design_candidate":"not_applicable","study_design_consensus":"not_applicable","genre_codex":"commentary","genre_gemma":"commentary","genre_scores_codex":[0.01514319,0.03176397,0.1129006,0.6683784,0.07599992,0.001371384,0.001319061,0.00489582,0.08822779],"genre_scores_gemma":[0.4225703,0.04373673,0.1525865,0.1727513,0.0937549,0.004127344,0.002221423,0.007177575,0.1010739],"genre_candidate":"commentary","genre_consensus":"commentary","teacher_disagreement_score":0.7438746,"threshold_uncertainty_score":0.9173298,"prediction_status":"machine_predicted_unvalidated"},"machine_scores":{"provisional":true,"baseline":true,"maturity_gate_passed":false,"score_opus":0.1906460550178648,"score_gpt":0.4148430747338178,"score_spread":0.2241970197159529,"validation_status":"score_only:v0-immature-baseline","note":"Baseline scores from an immature model (maturity gate not passed). Scores rank; they never assert a category."}}