Measuring the observer (Hawthorne) effect on adenoma detection rates
Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
Abstract Background and study aims An independent observer can improve procedural quality. We evaluated the impact of the observer (Hawthorne effect) on important quality metrics during colonoscopies. Patients and Methods In a single-center comparative study, consecutive patients undergoing routine screening or diagnostic colonoscopy were prospectively enrolled. In the index group, all procedural steps and quality metrics were observed and documented, and the procedure was video recorded by an independent research assistant. In the reference group, colonoscopies were performed without independent observation. Colonoscopy quality metrics such as polyp, adenoma, serrated lesions, and advanced adenoma detection rates (PDR, ADR, SLDR, AADR) were compared. The probabilities of increased quality metrics were evaluated through regression analyses weighted by the inversed probability of observation during the procedure. Results We included 327 index individuals and 360 referents in the final analyses. The index group had significantly higher PDRs (62.4% vs. 53.1%, P=0.02) and ADRs (39.4% vs. 28.3%, P=0.002) compared with the reference group. The SLDR and AADR were not significantly increased. After adjusting for potential confounders, the ADR and SLDR were 50% (relative risk [RR] 1.51; 95%, CI 1.05–2.17) and more than twofold (RR 2.17; 95%, CI 1.05–4.47) more likely to be higher in the index group than in the reference group. Conclusions The presence of an independent observer documenting colonoscopy quality metrics and video recording the colonoscopy resulted in a significant increase in ADR and other quality metrics. The Hawthorne effect should be considered an alternative strategy to advanced devices to improve colonoscopy quality in practice.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it