{"id":"W2025194027","doi":"10.1177/0193841x12458103","title":"Measuring Stakeholder Participation in Evaluation","year":2012,"lang":"en","type":"article","venue":"Evaluation Review","topic":"Evaluation and Performance Assessment","field":"Decision Sciences","cited_by":30,"is_retracted":false,"has_abstract":true,"ca_institutions":"Université du Québec à Trois-Rivières; Université Laval","funders":"","keywords":"Intraclass correlation; Reliability (semiconductor); Stakeholder; Sample (material); Convergent validity; Psychology; Generalizability theory; Sample size determination; Scale (ratio); Statistics; Applied psychology; Psychometrics; Clinical psychology; Mathematics; Economics; Developmental psychology; Geography","routes":{"ca_aff":true,"ca_fund":false,"ca_venue":false,"about_ca":false,"invisible_to_affiliation_only":false},"retraction":null,"screen":null,"direct_labels":[],"prediction":{"model_version":"codex-gemma-dda1882f352a","candidate_categories":["metaresearch","insufficient_payload"],"consensus_categories":["metaresearch","insufficient_payload"],"category_scores_codex":[0.1042227,0.0001572819,0.0003388576,0.0003105557,0.0001096437,0.00009458444,0.0002778601,0.0000572667,0.02495021],"category_scores_gemma":[0.01195731,0.0001211532,0.00009204786,0.001459309,0.00002389697,0.001565213,0.00004417504,0.0001396639,0.002704043],"about_ca_system_candidate":false,"about_ca_system_consensus":false,"about_ca_system_score_codex":0.000415951,"about_ca_system_score_gemma":0.0004585415,"about_ca_topic_candidate":false,"about_ca_topic_consensus":false,"about_ca_topic_score_codex":0.000008936398,"about_ca_topic_score_gemma":0.00006749839,"domain_scores_codex":[0.9864475,0.003579991,0.001510536,0.0003878839,0.007679221,0.0003949034],"domain_scores_gemma":[0.9963818,0.0004863139,0.000517922,0.0006554922,0.001820913,0.0001375609],"domain_codex":null,"domain_gemma":null,"domain_candidate":null,"domain_consensus":null,"study_design_codex":"design_other","study_design_gemma":"observational","study_design_scores_codex":[0.000005376884,0.0001720019,0.08618295,0.00008377084,0.000008492564,7.532351e-8,0.0007156972,0.002130831,0.00006354203,0.0008978101,0.005772951,0.9039665],"study_design_scores_gemma":[0.001191527,0.00003484978,0.8213325,0.0009253917,0.0002246177,0.000002684009,0.000230445,0.1206068,0.0001753445,0.004824496,0.05014956,0.0003017812],"study_design_candidate":"observational","study_design_consensus":null,"genre_codex":"empirical","genre_gemma":"empirical","genre_scores_codex":[0.6679611,0.187464,0.002532478,0.009724199,0.002581865,0.008335941,0.000006760418,0.00008862073,0.121305],"genre_scores_gemma":[0.9943848,0.002374301,0.0003353478,0.001576749,0.0001498385,0.0008956148,0.00004401637,0.00001048849,0.0002288839],"genre_candidate":"empirical","genre_consensus":"empirical","teacher_disagreement_score":0.9036647,"threshold_uncertainty_score":0.9980724,"prediction_status":"machine_predicted_unvalidated"},"machine_scores":{"provisional":true,"baseline":true,"maturity_gate_passed":false,"score_opus":0.8475988642781547,"score_gpt":0.6249450003263772,"score_spread":0.2226538639517774,"validation_status":"score_only:v0-immature-baseline","note":"Baseline scores from an immature model (maturity gate not passed). Scores rank; they never assert a category."}}