MétaCan
Menu
← Back to cohort
Record W3012418221 · doi:10.2196/17795

Reported Outcomes in Published Systematic Reviews of Interdisciplinary Pain Treatment: Protocol for a Systematic Overview

2020· article· en· W3012418221 on OpenAlexvenueno aff
Elena Dragioti, Huan‐Ji Dong, Britt Larsson, Björn Gerdle

Bibliographic record

VenueJMIR Research Protocols · 2020
Typearticle
Languageen
FieldDecision Sciences
TopicMeta-analysis and systematic reviews
Canadian institutionsnot available
Fundersnot available
KeywordsSystematic reviewProtocol (science)MedicineAlternative medicineMEDLINEPsychology

Abstract

fetched live from OpenAlex

BACKGROUND: Interdisciplinary pain treatment (IPT) is a complex intervention; its outcomes are very diverse, as are the methodologies for handling those outcomes. This diversity may hamper evidence-based decision making. Presently, there is no gold standard recommendation of how to select reported outcomes in published systematic reviews and meta-analyses to explicitly demonstrate the effectiveness of IPT. OBJECTIVE: In this systematic overview, we aim to evaluate the reported outcome domains and measurements across published systematic reviews and meta-analyses and to identify any methods, considerations, and discussion regarding the handling of the chosen outcome domains and measurements. METHODS: This article describes the protocol for a systematic overview of the outcomes reported in published systematic reviews and meta-analyses of randomized control trials for the effectiveness of IPT versus any control. To this end, we searched the PubMed, Cochrane Library, and Epistemonikos databases from inception to December 2019. Two independent investigators screened the titles, the abstracts of the identified records, and the full texts of the potentially eligible systematic reviews and meta-analyses, performed data extraction according to predefined forms, and rated the quality of the included systematic reviews and meta-analyses. The quality of the included systematic reviews and meta-analyses will be rated with AMSTAR (A MeaSurement Tool to Assess systematic Reviews) 2. Data will be analyzed descriptively and stratified by AMSTAR 2. RESULTS: We introduced the rationale and design of a systematic overview to summarize and map the chosen IPT outcome domains and the methods of handling these outcomes reported in published systematic reviews and meta-analyses. As of December 2019, we collected 5229 systematic reviews, of which 147 (2.81%) were examined in-depth for eligibility. Topline results are anticipated by September 2020. CONCLUSIONS: The results of this study will be published as soon as they are available. Our results will fill a gap in the related literature and will be used to inform the development of a set of recommendations that can be applied in systematic reviews and hopefully serve as a gold standard. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): PRR1-10.2196/17795.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.182
metaresearch head score (Gemma)0.247
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: Reporting · Consensus signal: none
Study designCandidate signal: Systematic review · Consensus signal: Systematic review
GenreCandidate signal: Protocol · Consensus signal: Protocol
Teacher disagreement score0.818
Threshold uncertainty score0.962

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.1820.247
Meta-epidemiology (narrow)0.0080.007
Meta-epidemiology (broad)0.0170.026
Bibliometrics0.0180.021
Science and technology studies0.0050.007
Scholarly communication0.0080.010
Open science0.0060.009
Research integrity0.0110.011
Insufficient payload (model declined to judge)0.0500.011

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.948
GPT teacher head0.738
Teacher spread0.210 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designSystematic review
DomainReporting
GenreProtocol

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations4
Published2020
Admission routes1
Has abstractyes

Explore more

Same venueJMIR Research Protocols→Same topicMeta-analysis and systematic reviews→French-language works237,207→