{"id":"W4407230264","doi":"10.1177/10556656251316389","title":"Peer Reviewer Recognition 2024","year":2025,"lang":"en","type":"article","venue":"The Cleft Palate-Craniofacial Journal","topic":"Academic Publishing and Open Access","field":"Decision Sciences","cited_by":0,"is_retracted":false,"has_abstract":false,"ca_institutions":"Canadian Steel Producers Association","funders":"","keywords":"Psychology; Computer science","routes":{"ca_aff":true,"ca_fund":false,"ca_venue":false,"about_ca":false,"invisible_to_affiliation_only":false},"retraction":null,"screen":null,"direct_labels":[{"model":"gemma","categories":["metaresearch"],"domain":"incentives","study_design":"not_applicable","genre":"editorial","about_ca_system":false,"about_ca_topic":false,"confidence":"high","status":"direct model label, unvalidated"},{"model":"gpt","categories":[],"domain":null,"study_design":"not_applicable","genre":"editorial","about_ca_system":false,"about_ca_topic":false,"confidence":"high","status":"direct model label, unvalidated"}],"prediction":{"model_version":"codex-gemma-dda1882f352a","candidate_categories":["metaresearch","scholarly_communication","insufficient_payload"],"consensus_categories":["insufficient_payload"],"category_scores_codex":[0.01897419,0.0002179567,0.0004213529,0.0003318153,0.001114982,0.00329671,0.003198482,0.0002322345,0.004696612],"category_scores_gemma":[0.0302999,0.0001196243,0.0003265063,0.001535001,0.0001890701,0.001596611,0.00036557,0.001776715,0.002065238],"about_ca_system_candidate":false,"about_ca_system_consensus":false,"about_ca_system_score_codex":0.00008581696,"about_ca_system_score_gemma":0.0002881969,"about_ca_topic_candidate":false,"about_ca_topic_consensus":false,"about_ca_topic_score_codex":0.00002940355,"about_ca_topic_score_gemma":0.000009775701,"domain_scores_codex":[0.9945776,0.0008119278,0.001246408,0.0003991327,0.002503719,0.0004611518],"domain_scores_gemma":[0.9952071,0.0009919705,0.0005383567,0.0005532649,0.002462072,0.0002471887],"domain_codex":null,"domain_gemma":null,"domain_candidate":null,"domain_consensus":null,"study_design_codex":"not_applicable","study_design_gemma":"not_applicable","study_design_scores_codex":[0.00002751047,0.00002012321,0.02666206,0.00000311691,0.00003272172,0.00001141763,0.0003836066,0.00001684059,0.00003894482,0.0003602489,0.782424,0.1900194],"study_design_scores_gemma":[0.0003959002,0.00001361944,0.1007272,0.0001293543,0.00005674262,0.00009260273,0.0008108586,0.000168092,0.000009765931,0.1814205,0.7159923,0.0001830078],"study_design_candidate":"not_applicable","study_design_consensus":"not_applicable","genre_codex":"other","genre_gemma":"empirical","genre_scores_codex":[0.3593681,0.0005076943,0.01020544,0.1982677,0.04705047,0.0008851037,0.00009298739,0.0001639375,0.3834586],"genre_scores_gemma":[0.7589892,0.001335608,0.0003898146,0.01239091,0.003996574,0.00001408109,0.000008877601,0.00003229347,0.2228426],"genre_candidate":"empirical","genre_consensus":null,"teacher_disagreement_score":0.3996211,"threshold_uncertainty_score":0.9987118,"prediction_status":"machine_predicted_unvalidated"},"machine_scores":{"provisional":true,"baseline":true,"maturity_gate_passed":false,"score_opus":0.08227448384253842,"score_gpt":0.3946618547921092,"score_spread":0.3123873709495708,"validation_status":"score_only:v0-immature-baseline","note":"Baseline scores from an immature model (maturity gate not passed). Scores rank; they never assert a category."}}