{"id":"W4249802452","doi":"10.1145/3159450.3170601","title":"Nifty Assignments","year":2018,"lang":"en","type":"article","venue":"","topic":"Teaching and Learning Programming","field":"Computer Science","cited_by":40,"is_retracted":false,"has_abstract":true,"ca_institutions":"University of Toronto; University of Calgary","funders":"","keywords":"Computer science; Session (web analytics); Suspect; Coding (social sciences); Multimedia; Programming language; World Wide Web; Psychology","routes":{"ca_aff":true,"ca_fund":false,"ca_venue":false,"about_ca":false,"invisible_to_affiliation_only":false},"retraction":null,"screen":null,"direct_labels":[],"prediction":{"model_version":"metacan-v3-hybrid-931329e0061c","candidate_categories":["insufficient_payload"],"consensus_categories":[],"category_scores_codex":[0.002120696,0.0009142034,0.000806033,0.001541006,0.002871303,0.003597819,0.002202372,0.001301358,0.3051488],"category_scores_gemma":[0.01456877,0.0004350315,0.0009417466,0.0007937926,0.0007890144,0.002921659,0.00552346,0.003477765,0.09984923],"about_ca_system_candidate":false,"about_ca_system_consensus":false,"about_ca_system_score_codex":0.002083867,"about_ca_system_score_gemma":0.002275149,"about_ca_topic_candidate":false,"about_ca_topic_consensus":false,"about_ca_topic_score_codex":0.001589634,"about_ca_topic_score_gemma":0.004791621,"domain_scores_codex":[0.9977603,0.000217521,0.0000916003,0.000363523,0.001073651,0.0004934195],"domain_scores_gemma":[0.9865229,0.0009873307,0.0004593599,0.001440796,0.004115044,0.006474643],"domain_codex":null,"domain_gemma":null,"domain_candidate":null,"domain_consensus":null,"study_design_codex":"not_applicable","study_design_gemma":"not_applicable","study_design_scores_codex":[0.0002945436,0.0002561891,0.00108116,0.0001486466,0.000009006605,0.0002104065,0.0004330799,0.0003651211,0.001695592,0.004789868,0.8070919,0.1836246],"study_design_scores_gemma":[0.00004375088,0.0002321544,0.003767169,0.00007125075,0.000005225626,0.0002941804,0.0002596051,0.0004316585,0.001048976,0.004759757,0.989054,0.00003228625],"study_design_candidate":"not_applicable","study_design_consensus":"not_applicable","genre_codex":"other","genre_gemma":"methods","genre_scores_codex":[0.03636618,0.0009996259,0.03075952,0.01782245,0.02356603,0.001542086,0.00734848,0.01808056,0.863515],"genre_scores_gemma":[0.08744625,0.0006285263,0.03499134,0.005095649,0.00431473,0.001234071,0.01057212,0.003030202,0.8526871],"genre_candidate":"methods","genre_consensus":null,"teacher_disagreement_score":0.3051488,"threshold_uncertainty_score":0.9911209,"prediction_status":"machine_predicted_unvalidated"},"machine_scores":{"provisional":true,"baseline":true,"maturity_gate_passed":false,"score_opus":0.01392202802396826,"score_gpt":0.2629484989740231,"score_spread":0.2490264709500548,"validation_status":"score_only:v0-immature-baseline","note":"Baseline scores from an immature model (maturity gate not passed). Scores rank; they never assert a category."}}