MétaCan
Menu
Back to cohort
Record W4313427688 · doi:10.1101/2022.12.28.22283572

Development of a reporting guideline for umbrella reviews on epidemiological associations using cross-sectional, case-control, and cohort studies: the Preferred Reporting Items for Umbrella Reviews of Cross-sectional, Case-control, and Cohort studies (PRIUR-CCC)

2022· preprint· en· W4313427688 on OpenAlexaff
Marco Solmi, Kelly D. Cobey, David Moher, Sanam Ebrahimzadeh, Elena Dragioti, Jae Il Shin, Joaquim Raduà, Samuele Cortese, Beverley Shea, Nicola Veronese, Lisa Hartling, Michelle Pollock, Matthias Egger, Stefania Papatheodorou, John P. A. Ioannidis, André F. Carvalho

Bibliographic record

VenuemedRxiv · 2022
Typepreprint
Languageen
FieldSocial Sciences
TopicDelphi Technique in Research
Canadian institutionsUniversity of AlbertaOttawa HospitalInstitute of Health EconomicsUniversity of Ottawa
Fundersnot available
KeywordsObservational studySystematic reviewCross-sectional studyMedicineStrengthening the reporting of observational studies in epidemiologyGuidelineCohortEpidemiologyPsychological interventionCohort studyBiostatisticsEnvironmental healthFamily medicineMEDLINENursingPolitical sciencePathology

Abstract

fetched live from OpenAlex

Abstract Introduction Observational studies are fraught with several biases including reverse causation and residual confounding, which may limit the credibility of reported associations. Overview of reviews of observational studies (i.e., umbrella reviews) synthesize systematic reviews with or without meta-analyses of cross-sectional, case-control, and cohort studies, and may also aid in the grading of the credibility of reported associations. The number of published umbrella reviews has been increasing at a rapid pace. Recently, a reporting guideline for overviews of reviews of healthcare interventions (PRIOR, Preferred Reporting Items for Overviews of Reviews) was published, but the field lacks reporting guidelines for umbrella reviews of observational studies. Thus, our aim is to develop a reporting guideline for umbrella reviews on cross-sectional, case-control, and cohort studies assessing epidemiological associations. Methods and Analyses We will adhere to established guidance on how to develop reporting guidelines in health research and follow four steps to prepare a PRIOR extension for systematic reviews of cross-sectional, case-control, and cohort studies testing epidemiological associations between an exposure and an outcome, namely Preferred Reporting Items for Umbrella Reviews of Cross-sectional, Case-control, and Cohort studies (PRIUR-CCC). Step 1 will be the project launch to identify stakeholders. Step 2 will be a literature review of available guidance to conduct umbrella reviews. Step 3 will be a Delphi study sampling authors and editors of umbrella reviews, Delphi surveys and checklists of epidemiological studies, as well as funders, practitioners, and policy makers, which will be conducted in three rounds. Step 4 will encompass the finalization of PRIUR-CCC statement, including a checklist, a flow diagram, explanation, and elaboration document. Deliverables of each step will be as follows. First, identifying stakeholders to involve according to relevant expertise and end-user groups, with an equity, diversity, and inclusion lens. Second, completing a narrative review of methodological guidance on how to conduct umbrella reviews, a narrative review of methodology and reporting in published umbrella reviews, and preparing an initial PRIUR-CCC checklist for Delphi study Round 1. Third, preparing a PRIUR-CCC checklist with guidance after Delphi study. Fourth, publishing and disseminating PRIUR-CCC statement. Ethics and Dissemination PRIUR-CCC will guide reporting of umbrella reviews on epidemiological associations, with the aim to improve quantitative, credible, and transparent reporting, in a field of evidence synthesis where there is important methodological heterogeneity of reviews, and where sources of bias in original observational studies can lead to misleading conclusions. Strengths This is the first protocol for reporting guidance of umbrella reviews of epidemiological associations This protocol follows the guidance for reporting checklist, which are standard in the field. This protocol is urgently needed given the large number of umbrella reviews on epidemiological associations emerging across different branches of science

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.549
metaresearch head score (Gemma)0.725
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: Reporting · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Methods · Consensus signal: none
Teacher disagreement score0.451
Threshold uncertainty score0.557

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.5490.725
Meta-epidemiology (narrow)0.0060.009
Meta-epidemiology (broad)0.0190.027
Bibliometrics0.0270.029
Science and technology studies0.0040.007
Scholarly communication0.0210.012
Open science0.0140.013
Research integrity0.0140.016
Insufficient payload (model declined to judge)0.0180.017

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.623
GPT teacher head0.586
Teacher spread0.036 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designNot applicable
DomainReporting
GenreMethods

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations1
Published2022
Admission routes1
Has abstractyes

Explore more

Same venuemedRxivSame topicDelphi Technique in ResearchFrench-language works237,207