{"id":"W3033527224","doi":"10.1145/3385188","title":"Asterisk","year":2020,"lang":"en","type":"article","venue":"ACM/IMS Transactions on Data Science","topic":"Machine Learning and Algorithms","field":"Computer Science","cited_by":10,"is_retracted":false,"has_abstract":true,"ca_institutions":"IBM (Canada); University of Alberta","funders":"","keywords":"Computer science; Heuristics; Quality (philosophy); Machine learning; Preprocessor; Process (computing); Artificial intelligence; Annotation; IBM; Data mining","routes":{"ca_aff":true,"ca_fund":false,"ca_venue":false,"about_ca":false,"invisible_to_affiliation_only":false},"retraction":null,"screen":null,"direct_labels":[],"prediction":{"model_version":"metacan-v3-hybrid-931329e0061c","candidate_categories":["insufficient_payload"],"consensus_categories":[],"category_scores_codex":[0.003266583,0.001540613,0.001286509,0.003518873,0.002729474,0.008265748,0.004449442,0.003780623,0.5137476],"category_scores_gemma":[0.0220295,0.0009966356,0.001101912,0.005846728,0.001477094,0.007292263,0.005289281,0.003207157,0.4963526],"about_ca_system_candidate":false,"about_ca_system_consensus":false,"about_ca_system_score_codex":0.001730884,"about_ca_system_score_gemma":0.003572186,"about_ca_topic_candidate":false,"about_ca_topic_consensus":false,"about_ca_topic_score_codex":0.002330881,"about_ca_topic_score_gemma":0.002388651,"domain_scores_codex":[0.995936,0.0007677196,0.0006290458,0.001027901,0.001299719,0.0003396411],"domain_scores_gemma":[0.9803602,0.004138392,0.001700383,0.007390639,0.005592095,0.0008182204],"domain_codex":null,"domain_gemma":null,"domain_candidate":null,"domain_consensus":null,"study_design_codex":"not_applicable","study_design_gemma":"not_applicable","study_design_scores_codex":[0.0002189175,0.00004645393,0.0005737723,0.0004344975,0.00001536399,0.00026431,0.0001568375,0.0003963447,0.001530788,0.01795686,0.8848882,0.09351762],"study_design_scores_gemma":[0.00002289421,0.00001371846,0.000269844,0.0001169791,0.000005146172,0.0002122727,0.00009658119,0.0006573405,0.001319498,0.006429647,0.9908386,0.00001740269],"study_design_candidate":"not_applicable","study_design_consensus":"not_applicable","genre_codex":"other","genre_gemma":"other","genre_scores_codex":[0.004295618,0.001884278,0.1743935,0.01702916,0.0230438,0.001299957,0.1106743,0.06868587,0.5986935],"genre_scores_gemma":[0.03417986,0.003172728,0.1986716,0.007877329,0.003436621,0.001105472,0.1910866,0.02308882,0.537381],"genre_candidate":"other","genre_consensus":"other","teacher_disagreement_score":0.4862524,"threshold_uncertainty_score":0,"prediction_status":"machine_predicted_unvalidated"},"machine_scores":{"provisional":true,"baseline":true,"maturity_gate_passed":false,"score_opus":0.076600776069982,"score_gpt":0.3117897892712219,"score_spread":0.2351890132012399,"validation_status":"score_only:v0-immature-baseline","note":"Baseline scores from an immature model (maturity gate not passed). Scores rank; they never assert a category."}}