{"id":"W3037129427","doi":"10.1609/aaai.v34i09.7072","title":"Model AI Assignments 2020","year":2020,"lang":"en","type":"article","venue":"","topic":"Explainable Artificial Intelligence (XAI)","field":"Computer Science","cited_by":2,"is_retracted":false,"has_abstract":true,"ca_institutions":"University of Toronto","funders":"","keywords":"Session (web analytics); Variety (cybernetics); Dissemination; Computer science; Artificial intelligence; Core (optical fiber); Multimedia; World Wide Web; Telecommunications","routes":{"ca_aff":true,"ca_fund":false,"ca_venue":false,"about_ca":false,"invisible_to_affiliation_only":false},"retraction":null,"screen":null,"direct_labels":[],"prediction":{"model_version":"metacan-v3-hybrid-931329e0061c","candidate_categories":["insufficient_payload"],"consensus_categories":[],"category_scores_codex":[0.003502119,0.0009448666,0.0004820403,0.001369187,0.002078505,0.00494508,0.001740057,0.001405081,0.3523982],"category_scores_gemma":[0.006930173,0.0005419696,0.0006407028,0.0009317465,0.0004077315,0.002544621,0.003937698,0.002179901,0.2049844],"about_ca_system_candidate":false,"about_ca_system_consensus":false,"about_ca_system_score_codex":0.002020341,"about_ca_system_score_gemma":0.003285641,"about_ca_topic_candidate":false,"about_ca_topic_consensus":false,"about_ca_topic_score_codex":0.00247097,"about_ca_topic_score_gemma":0.009325198,"domain_scores_codex":[0.998503,0.0003261396,0.00005218055,0.0001626322,0.0006879742,0.0002681902],"domain_scores_gemma":[0.9957685,0.0004365246,0.000140572,0.0003902921,0.001387121,0.001877056],"domain_codex":null,"domain_gemma":null,"domain_candidate":null,"domain_consensus":null,"study_design_codex":"not_applicable","study_design_gemma":"not_applicable","study_design_scores_codex":[0.0001841607,0.0002354526,0.0003486806,0.00008351352,0.000004749573,0.00004703262,0.0002713694,0.0005725397,0.001353257,0.008503732,0.9201641,0.06823139],"study_design_scores_gemma":[0.00001582732,0.00007807684,0.0006537549,0.00002383347,0.000001516728,0.00003705678,0.0001045657,0.00073759,0.000565891,0.003590985,0.9941796,0.00001136437],"study_design_candidate":"not_applicable","study_design_consensus":"not_applicable","genre_codex":"other","genre_gemma":"other","genre_scores_codex":[0.01059883,0.0003862427,0.02788538,0.004999882,0.004570841,0.0008305834,0.0102724,0.01186875,0.9285871],"genre_scores_gemma":[0.03169581,0.000434979,0.01519177,0.001769296,0.0007699833,0.000973286,0.0183854,0.003204701,0.9275748],"genre_candidate":"other","genre_consensus":"other","teacher_disagreement_score":0.3523982,"threshold_uncertainty_score":0.9237254,"prediction_status":"machine_predicted_unvalidated"},"machine_scores":{"provisional":true,"baseline":true,"maturity_gate_passed":false,"score_opus":0.06656900982648457,"score_gpt":0.2883622453603586,"score_spread":0.2217932355338741,"validation_status":"score_only:v0-immature-baseline","note":"Baseline scores from an immature model (maturity gate not passed). Scores rank; they never assert a category."}}