{"id":"W4396722757","doi":"10.1145/3589334.3645481","title":"Metacognitive Retrieval-Augmented Large Language Models","year":2024,"lang":"en","type":"article","venue":"","topic":"Topic Modeling","field":"Computer Science","cited_by":31,"is_retracted":false,"has_abstract":true,"ca_institutions":"Université de Montréal","funders":"Universitas Brawijaya","keywords":"Computer science; Metacognition; Natural language processing; Artificial intelligence; Language model; Information retrieval; Cognition; Psychology","routes":{"ca_aff":true,"ca_fund":false,"ca_venue":false,"about_ca":false,"invisible_to_affiliation_only":false},"retraction":null,"screen":null,"direct_labels":[],"prediction":{"model_version":"metacan-v3-hybrid-931329e0061c","candidate_categories":[],"consensus_categories":[],"category_scores_codex":[0.001838511,0.0007951304,0.0006576947,0.0006618854,0.0003117432,0.001923447,0.00181972,0.000899395,0.00261292],"category_scores_gemma":[0.007475322,0.0003899905,0.001048868,0.0004796807,0.0006259839,0.002331682,0.001080853,0.001601333,0.0006495967],"about_ca_system_candidate":false,"about_ca_system_consensus":false,"about_ca_system_score_codex":0.0008909081,"about_ca_system_score_gemma":0.001204305,"about_ca_topic_candidate":false,"about_ca_topic_consensus":false,"about_ca_topic_score_codex":0.005123515,"about_ca_topic_score_gemma":0.008319078,"domain_scores_codex":[0.999303,0.0003443338,0.00003613644,0.0001461593,0.0001085306,0.00006187522],"domain_scores_gemma":[0.9953887,0.003404248,0.0003066609,0.0004601848,0.0003178325,0.0001222536],"domain_codex":null,"domain_gemma":null,"domain_candidate":null,"domain_consensus":null,"study_design_codex":"simulation_or_modeling","study_design_gemma":"simulation_or_modeling","study_design_scores_codex":[0.0002538247,0.0001739468,0.00180198,0.0001229423,0.0001076644,0.0001209532,0.0003365686,0.8761643,0.001960286,0.0386178,0.001685696,0.07865407],"study_design_scores_gemma":[0.00001036438,0.00001228269,0.00006601056,0.000003017548,0.000008607145,0.000007477276,0.000006037442,0.9912044,0.0002567802,0.008115798,0.0003051767,0.000003916585],"study_design_candidate":"simulation_or_modeling","study_design_consensus":"simulation_or_modeling","genre_codex":"methods","genre_gemma":"methods","genre_scores_codex":[0.07285092,0.0005924333,0.9178986,0.0005928311,0.00004666537,0.0001395519,0.0004160667,0.00304278,0.004420201],"genre_scores_gemma":[0.8031701,0.0004017866,0.1904595,0.0001420834,0.00006984745,0.0003566498,0.0006754448,0.0002004603,0.004524193],"genre_candidate":"methods","genre_consensus":"methods","teacher_disagreement_score":0.005123515,"threshold_uncertainty_score":0.01018739,"prediction_status":"machine_predicted_unvalidated"},"machine_scores":{"provisional":true,"baseline":true,"maturity_gate_passed":false,"score_opus":0.02582532322801569,"score_gpt":0.2830062823510828,"score_spread":0.2571809591230672,"validation_status":"score_only:v0-immature-baseline","note":"Baseline scores from an immature model (maturity gate not passed). Scores rank; they never assert a category."}}