MétaCan
Menu
Back to cohort
Record W2414174840 · doi:10.1111/trf.13539

CONSORT and clinical trial reporting: room for improvement

2016· editorial· en· W2414174840 on OpenAlexaffabout
Nancy M. Heddle, Paul M. Ness

Bibliographic record

VenueTransfusion · 2016
Typeeditorial
Languageen
FieldDecision Sciences
TopicMeta-analysis and systematic reviews
Canadian institutionsMcMaster University
Fundersnot available
KeywordsConsolidated Standards of Reporting TrialsChecklistRandomized controlled trialMedicineGuidelineFamily medicineMedical educationPsychologySurgeryPathology

Abstract

fetched live from OpenAlex

CONSORT (CONsolidated Standards of Reporting Trials) is a guideline that has been created and revised over several decades to improve reporting of randomized controlled trials (RCTs). This work has been accomplished by an international group of methodologists, guideline developers, knowledge translation specialists, and journal editors. The CONSORT statement was first published in 1996 followed by revisions in 2001 and 2010.1-3 The work done by this group consists of a CONSORT statement, a checklist, the checklist explanation and elaboration document, and a CONSORT flow diagram to summarize how the study population was recruited and handled throughout the study (available at http://www.consort-statement.org/). In January 2007 an editorial was published in TRANSFUSION introducing CONSORT to journal readers and reviewers.4 Our readership was encouraged to become familiar with CONSORT's 22-item checklist and the flow diagram as these tools provided a roadmap for complete and transparent reporting of RCTs. In 2009, a second editorial was published indicating that the journal TRANSFUSION endorsed the use of CONSORT and made it a requirement for authors to follow CONSORT guidelines when submitting a RCT manuscript to the journal.5 At this time the instructions for authors were changed to reflect the new requirement for CONSORT compliance along with a link to the CONSORT website.6 Publishing RCTs in TRANSFUSION has been one of our goals, and although the numbers have remained relatively stable over the years, the opportunity for more RCT publications has expanded with our increasing emphasis on evidence-based transfusion practices and patient blood management. However, publishing clinical trials comes with the responsibility of accepting publications only when they are of high methodologic quality and reported in compliance with CONSORT. Since 2009 there have been a number of changes to CONSORT including a revision (2010) to the checklist increasing the number of items to 25.3 One of the additions in the 2010 revision was the requirement to include information on trial registration. Registration is required to ensure a transparent and nonbiased reporting of clinical trials. Trial registration should always occur before the first patient is enrolled in a study.7 A complete list of changes and additions to the 2010 CONSORT checklist has been published for those readers who are interested in specific details about the evolution of this document. The original CONSORT statement was designed to provide guidance when reporting a parallel-arm RCT. Over the years a number of extensions of the CONSORT statement had been developed to provide more specific guidance for other types of trial designs including: cluster trials, noninferiority and equivalency trials, pragmatic trials, and N-of-1 studies. Extensions have also been developed for other types of interventions including herbal medicinal interventions, nonpharmacologic treatment interventions, and acupuncture. Finally CONSORT extensions have been developed for other types of data: CONSORT–PRO (patient-reported outcomes), harms, and abstracts). The checklists and flow diagrams (if applicable) for each of these extensions contain items specific to the type of study design, intervention, or data and can be accessed at the website http://www.consort-statement.org/extensions. The CONSORT group continues to work on other extensions to make this list more comprehensive. Many scientific journals have adopted the requirement to comply with CONSORT when submitting a clinical study manuscript. This requirement has led to a number of publications examining compliance to the CONSORT statement for RCTs published in the scientific literature. In the clinical research focus section of this issue of TRANSFUSION, Jaffer and colleagues8 have evaluated compliance with CONSORT in our Journal. RCTs that were published in TRANSFUSION between January 2007 and December 2014 were identified through a literature search. They reviewed the information in 62 articles meeting the inclusion criteria (56 primary study reports; six pilot RCTs), to determine how well the information in these publications complied with the requirements specified in CONSORT. The authors found that many of the studies published in TRANSFUSION were not compliant for one or more of the CONSORT items. The items with compliance in less than 50% of the articles fell into the categories of trial registration (registration number and name of the trial registry) and information about study implementation (who generated the random allocation sequence, who enrolled study participants, and who assigned participants to a study intervention). Study participant flow and follow-up information had the highest frequency of compliance, which was greater than 90%. TRANSFUSION is not alone in the need to improve compliance with CONSORT. There are numerous studies over the years that have examined various aspects of CONSORT compliance in different medical specialties including surgery,9-12 traumatic brain injury,13 dentistry,14, 15 and solid organ transplants.16 All of these reports consistently showed a lack of CONSORT compliance often in areas of randomization, concealment, implementation, blinding, trial registration, and protocol availability. Endorsement of the CONSORT guidelines by journals does not guarantee compliance.17 Consistent with all areas of medicine, change is likely to require a multipronged approach including tools to assist with the change, education, and consistent patience and commitment to help authors with this transition. The American Journal of Orthodontics and Dentofacial Orthopedics (AJO-DO) hopes to improve CONSORT compliance with the use of educational videos, links to the CONSORT website, and a more active role by reviewers and editors to guide authors through the process.17 Others have suggested that authors be required to complete and upload the CONSORT checklist with their submission.18 To quote Adie and coworkers,19 "the bar can be raised only through the cooperation of all stakeholders."11 The ultimate responsibility for submitting an article that is written in compliance with CONSORT rests with the submitting authors; however, it is also important that reviewers and editors identify the deficiencies related to CONSORT and only accept studies for publication if the CONSORT requirements have been met. To improve CONSORT compliance for TRANSFUSION, we have made changes within Manuscript Central for authors and reviewers requiring confirmation that the CONSORT guidelines have been followed and that trial registration information is included in the manuscript. These questions will serve as a reminder to authors that TRANSFUSION has endorsed CONSORT and compliance is required, and will remind reviewers to confirm compliance with CONSORT as part of their review process. Also, we encourage researchers to use the CONSORT tools when designing their research projects not just when reporting the results. It will not be possible to comply with all CONSORT requirements if the requirements were not considered when the study was designed! The authors have disclosed no conflicts of interest. Nancy M. Heddle, MSc, FCSMLS(D)1 e-mail: heddlen@mcmaster.ca Paul M. Ness2 1Department of Medicine McMaster University Hamilton, ON, Canada 2Department of Pathology, Medicine and Oncology Johns Hopkins University School of Medicine Baltimore, MD

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.712
metaresearch head score (Gemma)0.884
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: Reporting · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Editorial · Consensus signal: none
Teacher disagreement score0.288
Threshold uncertainty score0.355

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.7120.884
Meta-epidemiology (narrow)0.0080.010
Meta-epidemiology (broad)0.0250.016
Bibliometrics0.0350.055
Science and technology studies0.0060.025
Scholarly communication0.0330.024
Open science0.0170.014
Research integrity0.0270.045
Insufficient payload (model declined to judge)0.0440.029

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.686
GPT teacher head0.588
Teacher spread0.097 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designNot applicable
DomainReporting
GenreEditorial

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations2
Published2016
Admission routes2
Has abstractyes

Explore more

Same venueTransfusionSame topicMeta-analysis and systematic reviewsFrench-language works237,207