MétaCan
Menu
Back to cohort
Record W2148681326 · doi:10.1186/1748-5908-8-99

Protocol for CONSORT-SPI: an extension for social and psychological interventions

2013· article· en· W2148681326 on OpenAlexafffund
Paul Montgomery, Sean Grant, Sally Hopewell, Geraldine Macdonald, David Moher, Susan Michie, Evan Mayo‐Wilson

Bibliographic record

VenueImplementation Science · 2013
Typearticle
Languageen
FieldHealth Professions
TopicHealth Policy Implementation Science
Canadian institutionsOttawa Hospital
FundersInstitute of Education, University of LondonEconomic and Social Research CouncilClarendon FundLondon School of Hygiene and Tropical MedicineCardiff UniversityMedical Research CouncilVanderbilt UniversityHebrew University of JerusalemUniversity of OxfordUniversity College LondonUniversity of CambridgeYork University
KeywordsMedicineProtocol (science)Health services researchHealth administrationHealth informaticsPublic healthPsychological interventionExtension (predicate logic)Social policyNursingAlternative medicinePathology

Abstract

fetched live from OpenAlex

BACKGROUND: Determining the effectiveness of social and psychological interventions is important for improving individual and population health. Such interventions are complex and, where possible, are best evaluated by randomised controlled trials (RCTs). The use of research findings in policy and practice decision making is hindered by poor reporting of RCTs. Poor reporting limits the ability to replicate interventions, synthesise evidence in systematic reviews, and utilise findings for evidence-based policy and practice. The lack of guidance for reporting the specific methodological features of complex intervention RCTs contributes to poor reporting. We aim to develop an extension of the Consolidated Standards of Reporting Trials Statement for Social and Psychological Interventions (CONSORT-SPI). METHODS/DESIGN: This research project will be conducted in five phases. The first phase was the project launch, which consisted of the establishment of a Project Executive and International Advisory Group, and recruitment of journal editors and the CONSORT Group. The second phase involves a Delphi process that will generate a list of possible items to include in the CONSORT Extension. Next, there will be a formal consensus meeting to select the reporting items to add to, or modify for, the CONSORT-SPI Extension. Fourth, guideline documents will be written, including an explanation and elaboration (E&E) document that will provide detailed advice for each item and examples of good reporting. The final phase will comprise guideline dissemination, with simultaneous publication and endorsement of the guideline in multiple journals, endorsement by funding agencies, presentations at conferences and other meetings, and a dedicated website that will facilitate feedback about the guideline. CONCLUSION: As demonstrated by previous CONSORT guidelines, the development of an evidence-based reporting guideline for social and psychological intervention RCTs should improve the accuracy, comprehensiveness, and transparency of study reports. This, in turn, promises to improve the critical appraisal of research and its use in policy and practice decision making. We invite readers to participate in the project by visiting our website (http://tinyurl.com/CONSORT-study).

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Direct model labels (unvalidated)

Per-model category and study-design labels from the labeling rounds. They are machine output, unvalidated, and the disagreement between models ships as data. No study design here is MEDLINE-validated yet.

Model armCategoriesStudy designConfidence
gptMetaresearch
Domain: Reporting · Genre: Protocol
About the Canadian research system: no · About a Canadian topic: no
Not applicablehigh
grokMetaresearch
Domain: Reporting · Genre: Protocol
About the Canadian research system: no · About a Canadian topic: no
Other designhigh
opusMetaresearch
Domain: Reporting · Genre: Protocol
About the Canadian research system: no · About a Canadian topic: no
Other designhigh
models splitAgreement compares identical category sets and study designs across arms.

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.249
metaresearch head score (Gemma)0.426
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: Reporting · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Protocol · Consensus signal: Protocol
Teacher disagreement score0.751
Threshold uncertainty score0.000

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.2490.426
Meta-epidemiology (narrow)0.0060.007
Meta-epidemiology (broad)0.0100.015
Bibliometrics0.0120.014
Science and technology studies0.0050.007
Scholarly communication0.0090.008
Open science0.0050.007
Research integrity0.0100.019
Insufficient payload (model declined to judge)0.1670.041

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.958
GPT teacher head0.843
Teacher spread0.115 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Labeled directly by 3 models reading the full record.

Metaresearch

The models disagree on parts of this classification; every voice is preserved in the section at the end of the page.

Study designNot applicable · Other design
DomainReporting
GenreProtocol

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations114
Published2013
Admission routes2
Has abstractyes

Explore more

Same venueImplementation ScienceSame topicHealth Policy Implementation ScienceCategoryMetaresearchFrench-language works237,207