{"id":"W2597906635","doi":"10.1027/1614-2241/a000159","title":"Validity","year":2018,"lang":"en","type":"article","venue":"Methodology","topic":"Psychometric Methodologies and Testing","field":"Decision Sciences","cited_by":8,"is_retracted":false,"has_abstract":false,"ca_institutions":"University of British Columbia","funders":"","keywords":"Citation; Library science; Psychology; Delphi method; Computer science; Artificial intelligence","routes":{"ca_aff":true,"ca_fund":false,"ca_venue":false,"about_ca":false,"invisible_to_affiliation_only":false},"retraction":null,"screen":null,"direct_labels":[],"prediction":{"model_version":"metacan-v3-hybrid-931329e0061c","candidate_categories":[],"consensus_categories":[],"category_scores_codex":[0.09392503,0.001453793,0.001496493,0.01210628,0.004065305,0.008853206,0.002255309,0.001717721,0.03359105],"category_scores_gemma":[0.3657034,0.001090178,0.003531703,0.007084229,0.006405062,0.007128796,0.007322307,0.002949009,0.009352108],"about_ca_system_candidate":false,"about_ca_system_consensus":false,"about_ca_system_score_codex":0.005576817,"about_ca_system_score_gemma":0.01914637,"about_ca_topic_candidate":false,"about_ca_topic_consensus":false,"about_ca_topic_score_codex":0.005063939,"about_ca_topic_score_gemma":0.004941416,"domain_scores_codex":[0.8679464,0.05772228,0.01361936,0.01257406,0.04517452,0.002963253],"domain_scores_gemma":[0.643007,0.1764017,0.01448258,0.05991726,0.1036078,0.002583699],"domain_codex":null,"domain_gemma":null,"domain_candidate":null,"domain_consensus":null,"study_design_codex":"design_other","study_design_gemma":"theoretical_or_conceptual","study_design_scores_codex":[0.0003398731,0.0007218923,0.1226233,0.002528731,0.000723402,0.0001583436,0.01140195,0.001617429,0.001758337,0.3138836,0.02527745,0.5189656],"study_design_scores_gemma":[0.0004147131,0.0008108205,0.2022036,0.008180894,0.001571138,0.001587173,0.01531887,0.0130602,0.01285874,0.4581309,0.2855604,0.0003025899],"study_design_candidate":"theoretical_or_conceptual","study_design_consensus":null,"genre_codex":"other","genre_gemma":"methods","genre_scores_codex":[0.09583727,0.002356462,0.3140443,0.008053278,0.001186692,0.01280633,0.005691133,0.0007491865,0.5592754],"genre_scores_gemma":[0.7306536,0.001478305,0.2030092,0.003359133,0.0008711063,0.01906069,0.005908335,0.00066528,0.03499431],"genre_candidate":"methods","genre_consensus":null,"teacher_disagreement_score":0.09392503,"threshold_uncertainty_score":0,"prediction_status":"machine_predicted_unvalidated"},"machine_scores":{"provisional":true,"baseline":true,"maturity_gate_passed":false,"score_opus":0.941291787059819,"score_gpt":0.6278904871636637,"score_spread":0.3134012998961553,"validation_status":"score_only:v0-immature-baseline","note":"Baseline scores from an immature model (maturity gate not passed). Scores rank; they never assert a category."}}