MétaCan
Menu
Back to cohort
Record W1463084062 · doi:10.5287/ora-daykvyxed

Development of a CONSORT extension for social and psychological interventions

2014· dissertation· en· W1463084062 on OpenAlexfundno aff
Sean Grant

Bibliographic record

VenueOxford University Research Archive (ORA) (University of Oxford) · 2014
Typedissertation
Languageen
FieldSocial Sciences
TopicDelphi Technique in Research
Canadian institutionsnot available
FundersClarendon FundEconomic and Social Research CouncilHebrew University of JerusalemCardiff UniversityInstitute of Education, University of LondonUniversity of OxfordUniversity College LondonLondon School of Hygiene and Tropical MedicineUniversity of CambridgeYork UniversityVanderbilt University
KeywordsConsolidated Standards of Reporting TrialsPsychological interventionCritical appraisalPsychologyDelphi methodSystematic reviewApplied psychologyMedical educationMedicineAlternative medicineMEDLINEPolitical scienceComputer sciencePsychiatry

Abstract

fetched live from OpenAlex

<b>Background:</b> Defined by their mechanisms, social and psychological interventions are those interventions that work through mental processes and social phenomena. They are often complex and challenging to evaluate, so understanding randomised controlled trials (RCTs) of these interventions requires detailed reports of the interventions tested and the methods used to assess them. However, reports of these RCTs often omit important information. Poor reporting hinders critical appraisal and synthesis of RCTs in systematic reviews, thereby impeding the effective transfer of research evidence to policy and practice. The Consolidated Standards for Reporting Trials (CONSORT) Statement is a reporting guideline that has contributed to improvements in the quality of RCT manuscripts in journals publishing medical research. However, studies have shown persistent deficiencies in the reporting quality of social and psychological intervention trials. A new CONSORT extension for these interventions may be needed given their distinct and complex features. This DPhil thesis reports on a project to develop and disseminate an official CONSORT Extension for Social and Psychological Interventions: CONSORT-SPI. <b>Structure:</b> Following a preface, this DPhil thesis includes eight chapters. Chapter 1 provides an overview of the conceptual rationale that prompted the CONSORT-SPI project. Chapter 2 details the project protocol, which consists of a five-phase methodology that follows current best practices for reporting guideline development and dissemination. Chapter 3 discusses systematic literature reviews to assess reporting guidelines for and the reporting quality of publications of social and psychological intervention RCTs. Chapter 4 discusses an online, international Delphi process to generate a prioritised list of possible items to include in the CONSORT-SPI extension. Chapter 5 discusses a formal consensus meeting to select reporting items to add to or modify for the CONSORT-SPI Extension checklist. Chapter 6 involves drafts of the CONSORT-SPI checklist as well as a template for the Explanation and Elaboration (E&amp;E) document providing detailed advice and examples of good reporting for each checklist item. These drafts have not yet been circulated to co-authors or other members of the project team; their purpose in this thesis is to give an indication of how previous project phases have led into initial prototypes of the checklist and E&amp;E;, which will undergo further development and revision by the project team before publication. Chapter 7 proposes a coordinated dissemination and implementation strategy informed by theoretical frameworks and tools used to guide the implementation of clinical guidelines and empirically-supported interventions. The final chapter summarises the information gained from the CONSORT-SPI project to date, assesses strengths and limitations of the project methodology, and discusses implications for future research. <b>Conclusion:</b> A CONSORT-SPI Extension could improve the reporting quality of social and psychological intervention RCTs. This extension could also facilitate better critical appraisal of this body of research and its use in evidence-based decision-making. With successful dissemination and implementation, the guideline will hopefully contribute to the improvement of intervention evaluations—as well as the methodology underpinning these studies—within the social and behavioural sciences.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.003
metaresearch head score (Gemma)0.001
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMeta-epidemiology (narrow), Science and technology studies
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.671
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0030.001
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0010.000
Bibliometrics0.0010.001
Science and technology studies0.0030.002
Scholarly communication0.0000.000
Open science0.0010.001
Research integrity0.0010.001
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.218
GPT teacher head0.442
Teacher spread0.224 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

Study designNot applicable
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations3
Published2014
Admission routes1
Has abstractyes

Explore more

Same venueOxford University Research Archive (ORA) (University of Oxford)Same topicDelphi Technique in ResearchFrench-language works237,207