{"id":"W2917961622","doi":"10.1145/3308774.3308785","title":"Report on CLEF 2018","year":2019,"lang":"en","type":"article","venue":"ACM SIGIR Forum","topic":"Misinformation and Its Impacts","field":"Social Sciences","cited_by":1,"is_retracted":false,"has_abstract":true,"ca_institutions":"Université de Montréal; Computer Research Institute of Montréal","funders":"","keywords":"Clef; Contextualization; Computer science; Ninth; Social media; Presentation (obstetrics); World Wide Web; Library science","routes":{"ca_aff":true,"ca_fund":false,"ca_venue":false,"about_ca":false,"invisible_to_affiliation_only":false},"retraction":null,"screen":null,"direct_labels":[],"prediction":{"model_version":"metacan-v3-hybrid-931329e0061c","candidate_categories":["insufficient_payload"],"consensus_categories":[],"category_scores_codex":[0.01810001,0.002866383,0.003259681,0.009147308,0.003708859,0.01114977,0.004294063,0.00370369,0.5897246],"category_scores_gemma":[0.03485022,0.0007934179,0.001635565,0.005466254,0.00107445,0.007543799,0.006780497,0.004053177,0.578042],"about_ca_system_candidate":false,"about_ca_system_consensus":false,"about_ca_system_score_codex":0.005712945,"about_ca_system_score_gemma":0.006066877,"about_ca_topic_candidate":false,"about_ca_topic_consensus":false,"about_ca_topic_score_codex":0.01273349,"about_ca_topic_score_gemma":0.01812971,"domain_scores_codex":[0.9786725,0.004242115,0.0008828474,0.002401904,0.01208625,0.001714459],"domain_scores_gemma":[0.9614558,0.004727229,0.0009059616,0.005451268,0.02059733,0.006862399],"domain_codex":null,"domain_gemma":null,"domain_candidate":null,"domain_consensus":null,"study_design_codex":"not_applicable","study_design_gemma":"not_applicable","study_design_scores_codex":[0.00003734578,0.00002316792,0.00004405153,0.00003549636,0.000003647383,0.00001261554,0.000005226085,0.00002772816,0.00006447789,0.0001977269,0.9915814,0.007967093],"study_design_scores_gemma":[0.00007715695,0.00003516617,0.0005509126,0.00005828712,0.000004757608,0.00004916541,0.00003159137,0.0002287581,0.000284263,0.0005805177,0.9980797,0.0000197507],"study_design_candidate":"not_applicable","study_design_consensus":"not_applicable","genre_codex":"other","genre_gemma":"empirical","genre_scores_codex":[0.004288882,0.01480277,0.009434897,0.06482126,0.08704013,0.002553088,0.3494835,0.03018651,0.437389],"genre_scores_gemma":[0.008524049,0.002867765,0.008512753,0.007566036,0.01249013,0.001536204,0.4562647,0.01032961,0.4919088],"genre_candidate":"empirical","genre_consensus":null,"teacher_disagreement_score":0.5897246,"threshold_uncertainty_score":0.5852081,"prediction_status":"machine_predicted_unvalidated"},"machine_scores":{"provisional":true,"baseline":true,"maturity_gate_passed":false,"score_opus":0.02534437264239013,"score_gpt":0.3248668344821655,"score_spread":0.2995224618397754,"validation_status":"score_only:v0-immature-baseline","note":"Baseline scores from an immature model (maturity gate not passed). Scores rank; they never assert a category."}}