{"id":"W2597906635","doi":"10.1027/1614-2241/a000159","title":"Validity","year":2018,"lang":"en","type":"article","venue":"Methodology","topic":"Psychometric Methodologies and Testing","field":"Decision Sciences","cited_by":8,"is_retracted":false,"has_abstract":false,"ca_institutions":"University of British Columbia","funders":"","keywords":"Citation; Library science; Psychology; Delphi method; Computer science; Artificial intelligence","routes":{"ca_aff":true,"ca_fund":false,"ca_venue":false,"about_ca":false,"invisible_to_affiliation_only":false},"retraction":null,"screen":null,"direct_labels":[],"prediction":{"model_version":"codex-gemma-dda1882f352a","candidate_categories":["metaresearch","insufficient_payload"],"consensus_categories":["metaresearch","insufficient_payload"],"category_scores_codex":[0.04755716,0.0001181584,0.0004278084,0.0004846188,0.0002035311,0.00007132936,0.001047632,0.0001380676,0.003784645],"category_scores_gemma":[0.4936381,0.00007947515,0.0001159629,0.002118074,0.0004049923,0.00009915588,0.0002873243,0.0001672712,0.001489931],"about_ca_system_candidate":false,"about_ca_system_consensus":false,"about_ca_system_score_codex":0.00001553558,"about_ca_system_score_gemma":0.00003466592,"about_ca_topic_candidate":false,"about_ca_topic_consensus":false,"about_ca_topic_score_codex":0.00003721664,"about_ca_topic_score_gemma":0.00001183183,"domain_scores_codex":[0.9902833,0.007542993,0.0005822259,0.0006052071,0.000585832,0.0004004407],"domain_scores_gemma":[0.8135408,0.1841775,0.000351239,0.001204391,0.0005760671,0.0001500151],"domain_codex":null,"domain_gemma":null,"domain_candidate":null,"domain_consensus":null,"study_design_codex":"design_other","study_design_gemma":"theoretical_or_conceptual","study_design_scores_codex":[0.00007346075,0.00003418076,0.1507413,0.000001721036,0.0000135475,0.00001288172,0.0004608099,0.000002943489,0.004947691,0.01556367,0.05446554,0.7736822],"study_design_scores_gemma":[0.0001833545,0.0002898594,0.1603021,0.000001469697,0.000006593572,0.00005797685,0.0002361149,0.0002298137,0.004700651,0.6241308,0.2097283,0.0001329133],"study_design_candidate":"design_other","study_design_consensus":null,"genre_codex":"methods","genre_gemma":"methods","genre_scores_codex":[0.2472934,0.00005522275,0.6842728,0.0008383212,0.003315046,0.00005947176,0.000002087389,0.00009184612,0.06407186],"genre_scores_gemma":[0.248033,0.000004494736,0.7476125,0.0009526432,0.0007933952,0.000004453466,3.654056e-7,0.000007812525,0.002591416],"genre_candidate":"methods","genre_consensus":"methods","teacher_disagreement_score":0.7735493,"threshold_uncertainty_score":0.9992875,"prediction_status":"machine_predicted_unvalidated"},"machine_scores":{"provisional":true,"baseline":true,"maturity_gate_passed":false,"score_opus":0.941291787059819,"score_gpt":0.6278904871636637,"score_spread":0.3134012998961553,"validation_status":"score_only:v0-immature-baseline","note":"Baseline scores from an immature model (maturity gate not passed). Scores rank; they never assert a category."}}