MétaCan
Menu
Back to cohort
Record W2767548617 · doi:10.1016/j.conctc.2017.11.004

Quality of abstracts of pilot trials in heart failure: A protocol for a systematic survey

2017· article· en· W2767548617 on OpenAlex
Godsent Isiguzo, Moleen Zunza, Maxwell Chirehwa, Bongani M. Mayosi, Lehana Thabane

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.

Bibliographic record

VenueContemporary Clinical Trials Communications · 2017
Typearticle
Languageen
FieldDecision Sciences
TopicMeta-analysis and systematic reviews
Canadian institutionsSt. Joseph’s Healthcare HamiltonMcMaster University
Fundersnot available
KeywordsConsolidated Standards of Reporting TrialsMedicineProtocol (science)MEDLINEClinical trialAlternative medicineResearch designMedical physicsRandomized controlled trialFamily medicinePathologyStatistics

Abstract

fetched live from OpenAlex

INTRODUCTION: Pilot trials are initial small-scale studies done to inform the design of larger trials. Their findings like other studies are usually disseminated as peer-reviewed journal articles. Abstracts are used to introduce the contents to readers, and give a general idea about the full reports and sometimes are the only source of information available to readers. Despite their importance, the contents of abstracts of trial reports are usually not informative enough and lack the essential details. METHODS AND ANALYSIS: This is a protocol for a planned systematic survey with a primary aim of analyzing the reporting quality measured as the completeness of the reporting of pilot trial abstracts in heart failure. The secondary aim will be to explore factors associated with better reporting quality.Abstracts of heart failure pilot trials in humans (journal and conference abstracts) published in the English language from 1 January 1990 to 30 November 2016 will be assessed to determine the reporting quality, based on the CONSORT 2010 statement extension to randomized pilot and feasibility trials. All non-pilot/feasibility trials and non-human pilot trials will be excluded. We will search Medline (PUBMED), Cochrane controlled trials register, Scopus and African wide information databases for pilot trials in heart failure. Title and abstracts of identified studies will be screened for inclusion and data extracted independently by two reviewers in duplicate without using the full text. Reported and unreported items on the abstracts will be presented as frequencies and percentages, a descriptive analysis will be used to interpret the reporting quality and regression analysis used for characteristics associated with greater statistical reporting at 95% confidence interval. REVIEW REGISTRATION NUMBER: PROSPERO CRD42016049911.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.929
metaresearch head score (Gemma)0.964
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Meta-epidemiology (broad), Open science
Consensus categoriesMetaresearch
DomainCandidate signal: Methods · Consensus signal: Methods
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Protocol · Consensus signal: none
Teacher disagreement score0.850
Threshold uncertainty score0.996

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.9290.964
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0270.007
Bibliometrics0.0000.001
Science and technology studies0.0000.001
Scholarly communication0.0010.000
Open science0.0100.001
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.992
GPT teacher head0.774
Teacher spread0.218 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it