MétaCan
Menu
Back to cohort
Record W7083335449 · doi:10.5283/epub.76189

Development of consensus-driven SPIRIT and CONSORT extensions for early phase dose-finding trials: the DEFINE study

2023· article· en· W7083335449 on OpenAlexfundno aff

Bibliographic record

VenueUniversity of Regensburg Publication Server (University of Regensburg) · 2023
Typearticle
Languageen
FieldSocial Sciences
TopicComputational and Text Analysis Methods
Canadian institutionsnot available
FundersGenentechNational Institutes of HealthSierra OncologyEisaiDepartment of Health and Social CareNational Institute for Health and Care ResearchNational Center for Advancing Translational SciencesSeagenAstellas PharmaNuCanaSanofiHalozymePTC TherapeuticsMedical Research CouncilCelgenePlexxikonBeiGeneGlaxoSmithKlinePfizerUK Research and InnovationEli Lilly and CompanyBristol-Myers Squibb
KeywordsDelphi methodDelphiInclusion (mineral)Thematic analysisProtocol (science)Intervention (counseling)Consolidated Standards of Reporting TrialsClinical trial

Abstract

fetched live from OpenAlex

Background Early phase dose-finding (EPDF) trials are crucial for the development of a new intervention and influence whether it should be investigated in further trials. Guidance exists for clinical trial protocols and completed trial reports in the SPIRIT and CONSORT guidelines, respectively. However, both guidelines and their extensions do not adequately address the characteristics of EPDF trials. Building on the SPIRIT and CONSORT checklists, the DEFINE study aims to develop international consensus-driven guidelines for EPDF trial protocols (SPIRIT-DEFINE) and reports (CONSORT-DEFINE). Methods The initial generation of candidate items was informed by reviewing published EPDF trial reports. The early draft items were refined further through a review of the published and grey literature, analysis of real-world examples, citation and reference searches, and expert recommendations, followed by a two-round modified Delphi process. Patient and public involvement and engagement (PPIE) was pursued concurrently with the quantitative and thematic analysis of Delphi participants' feedback. Results The Delphi survey included 79 new or modified SPIRIT-DEFINE (n = 36) and CONSORT-DEFINE (n = 43) extension candidate items. In Round One, 206 interdisciplinary stakeholders from 24 countries voted and 151 stakeholders voted in Round Two. Following Round One feedback, one item for CONSORT-DEFINE was added in Round Two. Of the 80 items, 60 met the threshold for inclusion (= 70% of respondents voted critical: 26 SPIRIT-DEFINE, 34 CONSORTDEFINE), with the remaining 20 items to be further discussed at the consensus meeting. The parallel PPIE work resulted in the development of an EPDF lay summary toolkit consisting of a template with guidance notes and an exemplar. Conclusions By detailing the development journey of the DEFINE study and the decisions undertaken, we envision that this will enhance understanding and help researchers in the development of future guidelines. The SPIRIT-DEFINE and CONSORT-DEFINE guidelines will allow investigators to effectively address essential items that should be present in EPDF trial protocols and reports, thereby promoting transparency, comprehensiveness, and reproducibility.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.726
metaresearch head score (Gemma)0.793
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: Reporting · Consensus signal: none
Study designCandidate signal: Qualitative · Consensus signal: none
GenreCandidate signal: Methods · Consensus signal: none
Teacher disagreement score0.274
Threshold uncertainty score0.338

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.7260.793
Meta-epidemiology (narrow)0.0040.007
Meta-epidemiology (broad)0.0080.016
Bibliometrics0.0140.012
Science and technology studies0.0050.007
Scholarly communication0.0140.012
Open science0.0100.017
Research integrity0.0080.016
Insufficient payload (model declined to judge)0.0150.008

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.203
GPT teacher head0.387
Teacher spread0.184 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designQualitative
DomainReporting
GenreMethods

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2023
Admission routes1
Has abstractyes

Explore more

Same venueUniversity of Regensburg Publication Server (University of Regensburg)Same topicComputational and Text Analysis MethodsFrench-language works237,207