{"id":"W3008513288","doi":"10.1109/ms.2020.2975159","title":"An Exploratory Study of Machine Learning Model Stores","year":2020,"lang":"en","type":"article","venue":"IEEE Software","topic":"Big Data and Business Intelligence","field":"Business, Management and Accounting","cited_by":13,"is_retracted":false,"has_abstract":true,"ca_institutions":"Queen's University; York University","funders":"Natural Sciences and Engineering Research Council of Canada; Institut de Valorisation des Données","keywords":"Computer science; Machine learning; Artificial intelligence; Knowledge management; Software engineering; World Wide Web","routes":{"ca_aff":true,"ca_fund":true,"ca_venue":false,"about_ca":false,"invisible_to_affiliation_only":false},"retraction":null,"screen":null,"direct_labels":[],"prediction":{"model_version":"codex-gemma-dda1882f352a","candidate_categories":[],"consensus_categories":[],"category_scores_codex":[0.0001288092,0.0001594927,0.0002101288,0.00009383581,0.0002046098,0.00007660943,0.0004256867,0.00004675832,0.0001336761],"category_scores_gemma":[0.0001539334,0.0001450741,0.00003659451,0.000392467,0.00003578475,0.001357519,0.0001714137,0.0001843733,0.00008854675],"about_ca_system_candidate":false,"about_ca_system_consensus":false,"about_ca_system_score_codex":0.000006822535,"about_ca_system_score_gemma":0.00001779864,"about_ca_topic_candidate":false,"about_ca_topic_consensus":false,"about_ca_topic_score_codex":0.0001801445,"about_ca_topic_score_gemma":0.0001800585,"domain_scores_codex":[0.9989903,0.00001353136,0.000233528,0.000308503,0.0002839719,0.0001701674],"domain_scores_gemma":[0.9993628,0.00001880236,0.0001624301,0.0002521237,0.0001828633,0.00002099882],"domain_codex":null,"domain_gemma":null,"domain_candidate":null,"domain_consensus":null,"study_design_codex":"observational","study_design_gemma":"simulation_or_modeling","study_design_scores_codex":[0.0004616597,0.002196543,0.6012044,0.001225053,0.0001374819,0.00007155191,0.01368821,0.3187473,0.00643913,0.00056678,0.008542542,0.04671937],"study_design_scores_gemma":[0.001634041,0.0003757435,0.005198755,0.0001181567,0.0002300108,0.000001199663,0.008336658,0.9591437,0.001427027,0.0009024175,0.02146871,0.001163569],"study_design_candidate":"simulation_or_modeling","study_design_consensus":null,"genre_codex":"empirical","genre_gemma":"empirical","genre_scores_codex":[0.9608305,0.00009811432,0.03816092,0.00010087,0.0001941182,0.000187728,0.00001192052,0.0003183978,0.00009745621],"genre_scores_gemma":[0.9983745,0.00000555178,0.0003477318,0.0006819051,0.0004775071,0.00001215867,0.00004260184,0.00003260016,0.00002544108],"genre_candidate":"empirical","genre_consensus":"empirical","teacher_disagreement_score":0.6403964,"threshold_uncertainty_score":0.5915951,"prediction_status":"machine_predicted_unvalidated"},"machine_scores":{"provisional":true,"baseline":true,"maturity_gate_passed":false,"score_opus":0.101877395413137,"score_gpt":0.2916997906936815,"score_spread":0.1898223952805445,"validation_status":"score_only:v0-immature-baseline","note":"Baseline scores from an immature model (maturity gate not passed). Scores rank; they never assert a category."}}