MétaCan
Menu
Back to cohort
Record W4225372871 · doi:10.1002/ueg2.12231

AGREE‐S: AGREE II extension for surgical interventions – United European Gastroenterology and European Association for Endoscopic Surgery methodological guide

2022· article· en· W4225372871 on OpenAlexaff
Patrícia Logullo, Iván D. Flórez, George Α. Antoniou, Sheraz Markar, Manuel López‐Cano, Gianfranço Silecchia, Sofia Tsokani, Dimitris Mavridis, Melissa Brouwers, Stavros A. Antoniou

Bibliographic record

VenueUnited European Gastroenterology Journal · 2022
Typearticle
Languageen
FieldMedicine
TopicClinical practice guidelines implementation
Canadian institutionsMcMaster UniversityImpact
FundersUnited European GastroenterologyEuropean Association for Endoscopic Surgery and other Interventional TechniquesCancer Research UK
KeywordsMedicinePsychological interventionGuidelineGrading (engineering)Delphi methodCredentialingMedical educationFamily medicineNursingPathology

Abstract

fetched live from OpenAlex

BACKGROUND: The Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument has been developed to inform the methodology, reporting and appraisal of clinical practice guidelines. Evidence suggests that the quality of surgical guidelines can be improved, and the structure and content of AGREE II can be modified to help enhance the quality of guidelines of surgical interventions. OBJECTIVE: To develop an extension of AGREE II specifically designed for guidelines of surgical interventions. METHODS: In the tripartite Guideline Assessment Project (GAP) funded by United European Gastroenterology and the European Association for Endoscopic Surgery, (i) we assessed the quality of surgical guidelines and we identified factors associated with higher quality (GAP I); (ii) we applied correlation analysis, factor analysis and the item response theory to inform an adaption of AGREE II for the purposes of surgical guidelines (GAP II); and (iii) we developed an AGREE II extension for surgical interventions, informed by the results of GAP I, GAP II, and a Delphi process of stakeholders, including representation from interventional and surgical disciplines; the Guideline International Network (GIN); the Grading of Recommendations Assessment, Development and Evaluation (GRADE) Working Group; the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) initiative; and representation of surgical journal editors and patient/public. RESULTS: We developed AGREE-S, an AGREE II extension for surgical interventions, which comprises 24 items organized in 6 domains; Scope and purpose, Stakeholders, Evidence synthesis, Development of recommendations, Editorial independence, and Implementation and update. The panel of stakeholders proposed 3 additional items: development of a guideline protocol, consideration of practice variability and surgical/interventional expertise in different settings, and specification of infrastructures required to implement the recommendations. Three of the existing items were amended, 7 items were rearranged among the domains, and one item was removed. The domain Rigour of Development was divided into domains on Evidence Synthesis and Development of Recommendations. The new domain Development of Recommendations incorporates items from the original AGREE II domain Clarity of Presentation. CONCLUSION: AGREE-S is an evidence-based and stakeholder-informed extension of the AGREE II instrument, that can be used as a guide for the development and adaption of guidelines on surgical interventions.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.354
metaresearch head score (Gemma)0.635
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: Methods · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Methods · Consensus signal: none
Teacher disagreement score0.646
Threshold uncertainty score0.797

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.3540.635
Meta-epidemiology (narrow)0.0030.005
Meta-epidemiology (broad)0.0060.020
Bibliometrics0.0190.018
Science and technology studies0.0040.006
Scholarly communication0.0140.008
Open science0.0090.017
Research integrity0.0090.015
Insufficient payload (model declined to judge)0.0430.018

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.328
GPT teacher head0.451
Teacher spread0.123 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designNot applicable
DomainMethods
GenreMethods

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations15
Published2022
Admission routes1
Has abstractyes

Explore more

Same venueUnited European Gastroenterology JournalSame topicClinical practice guidelines implementationFrench-language works237,207