Quality assurance metrics in clinical trial conduct.
Bibliographic record
Abstract
274 Background: Quality assurance (QA) in clinical trials is a safeguard against non-compliance, which impacts patient safety and data integrity. On an institutional level, compiling quality findings provides insight to gaps within existing processes, protocol compliance, and educational content. A QA metrics methodology has been implemented, which is streamlined with the ICH-GCP, and institutional Standard Operating Procedures (SOPs) and policies. Methods: Individual findings are assigned an alphanumerical code, based on severity and category, and a reference for each Quality Assurance Review (QAR). Annual data is tracked for all QAR findings. Different data sets are created to allow for analysis of quality gaps and quality changes over time. Results are used in the creation or revision of educational content, SOPs, and to drive process improvement. Results: To date, a total of 1608 QAR observations between 2014 and mid-2015 have been coded and tracked across 22 studies. Areas of quality gaps, such as most-cited categories (e.g. 27% in Source Documentation and 13% in Regulatory) and references (e.g. 30% on SOPs and 14% on guidelines), are communicated to the Quality and Education team regularly and incorporated into training content. This has also prompted the development of new SOPs, processes, and research tools, after which QA metrics continues to be used to monitor program wide quality improvement. For example, following the implementation of Electronic Source Documentation, the proportion of findings on delays in Adverse Event sign off has seen a decline. For individual QARs, a personalized trends summary is provided to the study team with an overview of the quality of the study conduct. The report displays the distribution of findings across different categories and severity levels. Lastly, quality metrics has increased the efficiency of tracking and reporting program wide QA activity. Conclusions: The regular analysis of quality metrics has proven to be a pivotal step in the Quality Management Cycle. It presents a quick snap shot of the quality of individual research studies under review. When implemented on an institutional scale, it offers valuable feedback on the current SOPs, processes, and training content.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.569 | 0.747 |
| Meta-epidemiology (narrow) | 0.003 | 0.002 |
| Meta-epidemiology (broad) | 0.004 | 0.005 |
| Bibliometrics | 0.017 | 0.021 |
| Science and technology studies | 0.002 | 0.005 |
| Scholarly communication | 0.014 | 0.009 |
| Open science | 0.004 | 0.009 |
| Research integrity | 0.003 | 0.006 |
| Insufficient payload (model declined to judge) | 0.011 | 0.003 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".