{"id":"W4249802452","doi":"10.1145/3159450.3170601","title":"Nifty Assignments","year":2018,"lang":"en","type":"article","venue":"","topic":"Teaching and Learning Programming","field":"Computer Science","cited_by":40,"is_retracted":false,"has_abstract":true,"ca_institutions":"University of Toronto; University of Calgary","funders":"","keywords":"Computer science; Session (web analytics); Suspect; Coding (social sciences); Multimedia; Programming language; World Wide Web; Psychology","routes":{"ca_aff":true,"ca_fund":false,"ca_venue":false,"about_ca":false,"invisible_to_affiliation_only":false},"retraction":null,"screen":null,"direct_labels":[],"prediction":{"model_version":"codex-gemma-dda1882f352a","candidate_categories":[],"consensus_categories":[],"category_scores_codex":[0.0002024369,0.00003671687,0.00003194872,0.00002237233,0.0001184657,0.0001115256,0.0003400862,0.00001611916,0.00004843919],"category_scores_gemma":[0.0000215826,0.00002904713,0.00001503763,0.00008958556,0.00002196797,0.0001346475,0.00009658102,0.00006319339,0.0005733534],"about_ca_system_candidate":false,"about_ca_system_consensus":false,"about_ca_system_score_codex":0.00000819243,"about_ca_system_score_gemma":0.000009555791,"about_ca_topic_candidate":false,"about_ca_topic_consensus":false,"about_ca_topic_score_codex":0.00002773536,"about_ca_topic_score_gemma":0.000001897624,"domain_scores_codex":[0.9995475,0.00003126857,0.00004840842,0.0001391284,0.0001009175,0.0001327469],"domain_scores_gemma":[0.9996918,0.00001562796,0.00001590892,0.0002227146,0.00001474155,0.00003918109],"domain_codex":null,"domain_gemma":null,"domain_candidate":null,"domain_consensus":null,"study_design_codex":"design_other","study_design_gemma":"not_applicable","study_design_scores_codex":[3.819661e-7,0.00001782529,0.002269053,6.568889e-7,0.000003509893,0.000001558977,0.0006913322,0.000001220991,0.00007910137,0.03716229,0.002804402,0.9569687],"study_design_scores_gemma":[0.0001302045,0.0001457231,0.009157578,0.00000583676,0.000001032646,0.0000073689,0.00002400787,0.006647196,0.0008741763,0.0006583167,0.9822287,0.0001198829],"study_design_candidate":"not_applicable","study_design_consensus":null,"genre_codex":"methods","genre_gemma":"empirical","genre_scores_codex":[0.006707258,0.000006039556,0.9676113,0.0004817057,0.0002701539,0.00001889183,1.549169e-8,0.000402055,0.02450261],"genre_scores_gemma":[0.7508969,1.039012e-7,0.2449583,0.0002507447,0.00007144573,0.000001010757,9.048352e-8,0.000001814387,0.003819545],"genre_candidate":"methods","genre_consensus":null,"teacher_disagreement_score":0.9794243,"threshold_uncertainty_score":0.736949,"prediction_status":"machine_predicted_unvalidated"},"machine_scores":{"provisional":true,"baseline":true,"maturity_gate_passed":false,"score_opus":0.01392202802396826,"score_gpt":0.2629484989740231,"score_spread":0.2490264709500548,"validation_status":"score_only:v0-immature-baseline","note":"Baseline scores from an immature model (maturity gate not passed). Scores rank; they never assert a category."}}