MétaCan
Menu
Back to cohort
Record W4404352649 · doi:10.1016/j.conctc.2024.101391

Defining methods to improve eSource site start-up practices

2024· article· en· W4404352649 on OpenAlex
Amy E. Cramer, Linda King, Michael Buckley, Peter Casteleyn, Cory Ennis, Muayad Hamidi, Gonçalo M. C. Rodrigues, Denise C. Snyder, Aruna Vattikola, Eric L. Eisenstein

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.

Bibliographic record

VenueContemporary Clinical Trials Communications · 2024
Typearticle
Languageen
FieldHealth Professions
TopicElectronic Health Records Systems
Canadian institutionsUniversity of Victoria
FundersNational Center for Advancing Translational SciencesNational Cancer Institute
KeywordsComputer scienceData science

Abstract

fetched live from OpenAlex

eSource software that transfers patient electronic health record data into a clinical trial electronic case report form holds promise for increasing data quality while reducing data collection, monitoring and source document verification costs. Integrating eSource into multicenter clinical trial start-up procedures could facilitate the use of eSource technologies in clinical trials. We conducted a qualitative integrative analysis to identify eSource site start-up key steps, challenges that might occur in executing those steps, and potential solutions to those challenges. We then conducted a value analysis to determine the challenges and solutions with the greatest impacts for eSource implementation teams. There were 16 workshop participants: 10 pharmaceutical sponsor, 3 academic site, and 1 eSource vendor representative. Participants identified 36 Site Start-Up Key Steps, 11 Site Start-Up Challenges, and 14 Site Start-Up Solutions for eSource-enabled studies. Participants also identified 77 potential impacts of the Challenges upon the Site Start-Up Key Steps and 70 ways in which the Solutions might impact Site Start-Up Challenges. The most important Challenges were: [1] not being able to identify a site eSource champion and [2] not agreeing on an eSource approach. The most important Solutions were: [1] eSource vendors accepting electronic data in the Health Level 7 Fast Healthcare Interoperability Resources (HL7® FHIR®) standard, [2] creating standard content for eSource-related legal documents, and [3] creating a common eSource site readiness checklist. Site start-up for eSource-enabled multi-center clinical trials is a complex socio-technical problem. This study's Start-Up Solutions provide initial steps for scalable eSource implementation. • ESource software that transfers patient electronic health record data into a clinical trial electronic case report form hold promise for improved data collection effectiveness. However, integrating eSource into multicenter clinical trial start-up procedures can be problematic. • We conducted a study to qualitative integrative analysis to identify eSource site start-up key steps, challenges that might occur in executing those steps, and potential solutions to those challenges. We then conducted a value analysis to determine the challenges and solutions with the greatest impacts for eSource implementation teams. • Participants identified 36 Site Start-Up Key Steps, 11 Site Start-Up Challenges, and 14 Site Start-Up Solutions for eSource-enabled studies. Participants also identified 77 potential impacts of the Challenges upon the Site Start-Up Key Steps and 70 ways in which the Solutions might impact Site Start-Up Challenges. • The most important Challenges were [1]: not being able to identify a site eSource champion and [2] not agreeing on an eSource approach. The most important Solutions were [1]: eSource vendors accepting electronic data in the Health Level 7 Fast Healthcare Interoperability Resources (HL7® FHIR®) standard [2], creating standard content for eSource-related legal documents, and [3] creating a common eSource site readiness checklist.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.141
metaresearch head score (Gemma)0.152
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Meta-epidemiology (narrow), Science and technology studies, Research integrity, Insufficient payload (model declined to judge)
Consensus categoriesMetaresearch
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.732
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.1410.152
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0020.001
Bibliometrics0.0000.001
Science and technology studies0.0020.000
Scholarly communication0.0000.001
Open science0.0020.001
Research integrity0.0010.005
Insufficient payload (model declined to judge)0.0000.005

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.736
GPT teacher head0.711
Teacher spread0.025 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it