{"id":"W1984954093","doi":"10.1145/1953163.1953340","title":"Reviewing CS1 exam question content","year":2011,"lang":"en","type":"article","venue":"","topic":"Teaching and Learning Programming","field":"Computer Science","cited_by":120,"is_retracted":false,"has_abstract":true,"ca_institutions":"University of Toronto","funders":"University of Toronto","keywords":"Computer science; Content (measure theory); Information retrieval; Mathematics","routes":{"ca_aff":true,"ca_fund":true,"ca_venue":false,"about_ca":false,"invisible_to_affiliation_only":false},"retraction":null,"screen":null,"direct_labels":[],"prediction":{"model_version":"codex-gemma-dda1882f352a","candidate_categories":[],"consensus_categories":[],"category_scores_codex":[0.0006848794,0.00005802712,0.00007335361,0.00003284803,0.00008573283,0.00006549622,0.0003071709,0.00002230661,0.00002616453],"category_scores_gemma":[0.00008447853,0.00004551403,0.00003535653,0.00008960869,0.00001065231,0.0002436049,0.00007585956,0.0001224634,0.0001384262],"about_ca_system_candidate":false,"about_ca_system_consensus":false,"about_ca_system_score_codex":0.00001286623,"about_ca_system_score_gemma":0.000009020293,"about_ca_topic_candidate":false,"about_ca_topic_consensus":false,"about_ca_topic_score_codex":0.0003320536,"about_ca_topic_score_gemma":0.000003651538,"domain_scores_codex":[0.99936,0.0001140352,0.0001137218,0.0001762734,0.00009189003,0.0001441388],"domain_scores_gemma":[0.9996019,0.00002176321,0.00004076458,0.0002599982,0.00002724914,0.00004831942],"domain_codex":null,"domain_gemma":null,"domain_candidate":null,"domain_consensus":null,"study_design_codex":"design_other","study_design_gemma":"not_applicable","study_design_scores_codex":[5.300863e-7,0.00002092289,0.002187571,0.000007129146,0.000003328181,0.000004038118,0.00157716,0.000001067176,0.00004418035,0.1200216,0.0001703052,0.8759622],"study_design_scores_gemma":[0.000493779,0.0004208333,0.07707476,0.0004501769,0.00002084901,0.00009611575,0.0003279491,0.007110697,0.001638001,0.001376949,0.9102826,0.0007073453],"study_design_candidate":"not_applicable","study_design_consensus":null,"genre_codex":"methods","genre_gemma":"empirical","genre_scores_codex":[0.003712558,0.000390232,0.9848752,0.0002029354,0.0002585664,0.00005889789,1.420067e-8,0.0005565225,0.00994507],"genre_scores_gemma":[0.5678578,0.00001192783,0.4304628,0.0002326637,0.00002700256,0.000005167314,2.494224e-7,0.000003528766,0.001398826],"genre_candidate":"methods","genre_consensus":null,"teacher_disagreement_score":0.9101123,"threshold_uncertainty_score":0.1856008,"prediction_status":"machine_predicted_unvalidated"},"machine_scores":{"provisional":true,"baseline":true,"maturity_gate_passed":false,"score_opus":0.2104265753039662,"score_gpt":0.2766355494209976,"score_spread":0.0662089741170313,"validation_status":"score_only:v0-immature-baseline","note":"Baseline scores from an immature model (maturity gate not passed). Scores rank; they never assert a category."}}