{"id":"W4210655901","doi":"10.1145/3516410.3516411","title":"Koli Calling 2021 report","year":2022,"lang":"en","type":"article","venue":"ACM SIGCSE Bulletin","topic":"Online Learning and Analytics","field":"Computer Science","cited_by":0,"is_retracted":false,"has_abstract":true,"ca_institutions":"","funders":"","keywords":"Library science; Range (aeronautics); Computer science; Engineering","routes":{"ca_aff":false,"ca_fund":false,"ca_venue":false,"about_ca":true,"invisible_to_affiliation_only":true},"retraction":null,"screen":null,"direct_labels":[],"prediction":{"model_version":"metacan-v3-hybrid-931329e0061c","candidate_categories":["insufficient_payload"],"consensus_categories":[],"category_scores_codex":[0.004688466,0.001343635,0.000798696,0.003411675,0.003981818,0.01128198,0.002335714,0.005214649,0.4784142],"category_scores_gemma":[0.01099003,0.0007953524,0.0007670625,0.002528255,0.000540045,0.002490157,0.003714664,0.005081761,0.5052317],"about_ca_system_candidate":false,"about_ca_system_consensus":false,"about_ca_system_score_codex":0.00487375,"about_ca_system_score_gemma":0.01626832,"about_ca_topic_candidate":false,"about_ca_topic_consensus":false,"about_ca_topic_score_codex":0.02041928,"about_ca_topic_score_gemma":0.03184126,"domain_scores_codex":[0.994782,0.000394463,0.0001850222,0.0004696028,0.003058658,0.001110286],"domain_scores_gemma":[0.9912936,0.0008864335,0.0003485367,0.0007803963,0.004540444,0.002150553],"domain_codex":null,"domain_gemma":null,"domain_candidate":null,"domain_consensus":null,"study_design_codex":"not_applicable","study_design_gemma":"not_applicable","study_design_scores_codex":[0.00003401726,0.00002308899,0.0001407981,0.00003477799,0.000001232385,0.00002684988,0.00001920885,0.00001719128,0.00008818357,0.001413526,0.990885,0.007316074],"study_design_scores_gemma":[0.000004532044,0.00001319337,0.0006979593,0.00003355126,0.000001122014,0.00001501208,0.00004774403,0.00002010767,0.0001079726,0.0001625149,0.9988896,0.000006719039],"study_design_candidate":"not_applicable","study_design_consensus":"not_applicable","genre_codex":"other","genre_gemma":"other","genre_scores_codex":[0.001290351,0.001746637,0.0007705162,0.01767324,0.01910571,0.0008080833,0.04146779,0.00183311,0.9153045],"genre_scores_gemma":[0.002374685,0.0007719221,0.0003380798,0.004110535,0.001030594,0.0004589517,0.01670979,0.0006180148,0.9735874],"genre_candidate":"other","genre_consensus":"other","teacher_disagreement_score":0.4784142,"threshold_uncertainty_score":0.7439789,"prediction_status":"machine_predicted_unvalidated"},"machine_scores":{"provisional":true,"baseline":true,"maturity_gate_passed":false,"score_opus":0.01285629288574404,"score_gpt":0.251477186572898,"score_spread":0.238620893687154,"validation_status":"score_only:v0-immature-baseline","note":"Baseline scores from an immature model (maturity gate not passed). Scores rank; they never assert a category."}}