{"id":"W2956642424","doi":"","title":"Live studies at REFSQ 2019","year":2019,"lang":"en","type":"article","venue":"University of Twente Research Information","topic":"Medical Imaging Techniques and Applications","field":"Medicine","cited_by":0,"is_retracted":false,"has_abstract":false,"ca_institutions":"Western University; University of Waterloo","funders":"","keywords":"Computer science","routes":{"ca_aff":true,"ca_fund":false,"ca_venue":false,"about_ca":false,"invisible_to_affiliation_only":false},"retraction":null,"screen":null,"direct_labels":[],"prediction":{"model_version":"metacan-v3-hybrid-931329e0061c","candidate_categories":["insufficient_payload"],"consensus_categories":[],"category_scores_codex":[0.004095312,0.0004252416,0.0004485601,0.002426576,0.002220583,0.002599757,0.0009792611,0.002804752,0.3153976],"category_scores_gemma":[0.01214906,0.0002809975,0.0005829444,0.0014488,0.0006954929,0.001666179,0.00435547,0.001988088,0.09922446],"about_ca_system_candidate":false,"about_ca_system_consensus":false,"about_ca_system_score_codex":0.002520437,"about_ca_system_score_gemma":0.003974059,"about_ca_topic_candidate":false,"about_ca_topic_consensus":false,"about_ca_topic_score_codex":0.01415365,"about_ca_topic_score_gemma":0.04043417,"domain_scores_codex":[0.9982678,0.0003121617,0.00006600291,0.0002174805,0.0007434916,0.0003930376],"domain_scores_gemma":[0.9921924,0.0007766035,0.0002293955,0.0008530631,0.003348654,0.002599841],"domain_codex":null,"domain_gemma":null,"domain_candidate":null,"domain_consensus":null,"study_design_codex":"not_applicable","study_design_gemma":"not_applicable","study_design_scores_codex":[0.0005417602,0.00009312983,0.004128055,0.000162527,0.00001875226,0.001028781,0.0004883631,0.00008060454,0.001724665,0.006035484,0.9328648,0.05283291],"study_design_scores_gemma":[0.00004865757,0.00008622801,0.01048741,0.0001276889,0.000005444681,0.0002398299,0.0002778708,0.00004198359,0.000409715,0.002213655,0.9860452,0.00001621563],"study_design_candidate":"not_applicable","study_design_consensus":"not_applicable","genre_codex":"other","genre_gemma":"other","genre_scores_codex":[0.04317006,0.003368294,0.006515302,0.06208142,0.02972024,0.001436048,0.1459892,0.003159903,0.7045596],"genre_scores_gemma":[0.0492528,0.001184098,0.004108429,0.00683884,0.003589788,0.0005078393,0.04165088,0.001680862,0.8911865],"genre_candidate":"other","genre_consensus":"other","teacher_disagreement_score":0.3153976,"threshold_uncertainty_score":0.9765022,"prediction_status":"machine_predicted_unvalidated"},"machine_scores":{"provisional":true,"baseline":true,"maturity_gate_passed":false,"score_opus":0.07855685358484406,"score_gpt":0.3890420224114062,"score_spread":0.3104851688265621,"validation_status":"score_only:v0-immature-baseline","note":"Baseline scores from an immature model (maturity gate not passed). Scores rank; they never assert a category."}}