{"id":"W4323526458","doi":"10.1145/3545947.3576339","title":"Run, Llama, Run","year":2022,"lang":"en","type":"article","venue":"","topic":"Teaching and Learning Programming","field":"Computer Science","cited_by":1,"is_retracted":false,"has_abstract":true,"ca_institutions":"Ontario Tech University","funders":"Natural Sciences and Engineering Research Council of Canada","keywords":"Computer science; Block (permutation group theory); Computational thinking; Collaborative learning; Short run; Multimedia; Human–computer interaction; Knowledge management; Artificial intelligence","routes":{"ca_aff":true,"ca_fund":true,"ca_venue":false,"about_ca":false,"invisible_to_affiliation_only":false},"retraction":null,"screen":null,"direct_labels":[],"prediction":{"model_version":"codex-gemma-dda1882f352a","candidate_categories":[],"consensus_categories":[],"category_scores_codex":[0.0004228643,0.00004893591,0.00005092166,0.00004836005,0.0004417472,0.0001106356,0.0006379057,0.000009073323,0.0002183825],"category_scores_gemma":[0.00001761346,0.00004616351,0.00003497778,0.0002076033,0.000007944638,0.00009117902,0.0004760107,0.0002514922,0.00007835767],"about_ca_system_candidate":false,"about_ca_system_consensus":false,"about_ca_system_score_codex":0.00002551196,"about_ca_system_score_gemma":0.0000244896,"about_ca_topic_candidate":false,"about_ca_topic_consensus":false,"about_ca_topic_score_codex":0.0001048187,"about_ca_topic_score_gemma":0.000001967464,"domain_scores_codex":[0.9992616,0.00009964256,0.0000716974,0.0001931594,0.0002000013,0.0001739206],"domain_scores_gemma":[0.9995939,0.0000375916,0.00002504834,0.0002957433,0.000007503423,0.00004027127],"domain_codex":null,"domain_gemma":null,"domain_candidate":null,"domain_consensus":null,"study_design_codex":"design_other","study_design_gemma":"not_applicable","study_design_scores_codex":[0.000001088441,0.00004931141,0.001685392,0.000002092542,0.00000608349,0.00001443166,0.002415685,0.001085377,0.00005674616,0.1298469,0.007313874,0.857523],"study_design_scores_gemma":[0.00008782707,0.00006965794,0.001086052,8.055192e-7,8.489367e-7,0.00001871879,0.0001484743,0.008308765,0.00002442132,0.0003005131,0.9898639,0.0000900024],"study_design_candidate":"not_applicable","study_design_consensus":null,"genre_codex":"methods","genre_gemma":"empirical","genre_scores_codex":[0.03032436,0.0001805017,0.9367882,0.00558684,0.0009850229,0.00009207304,3.176651e-7,0.001653575,0.02438912],"genre_scores_gemma":[0.8896471,3.436718e-7,0.09888158,0.0006182832,0.00003497206,0.00001360027,8.934331e-7,0.000004797323,0.01079849],"genre_candidate":"methods","genre_consensus":null,"teacher_disagreement_score":0.98255,"threshold_uncertainty_score":0.3397607,"prediction_status":"machine_predicted_unvalidated"},"machine_scores":{"provisional":true,"baseline":true,"maturity_gate_passed":false,"score_opus":0.01464025549728764,"score_gpt":0.2401380189447569,"score_spread":0.2254977634474693,"validation_status":"score_only:v0-immature-baseline","note":"Baseline scores from an immature model (maturity gate not passed). Scores rank; they never assert a category."}}