Assessing the Comparability of Paper and Electronic Versions of the EORTC QOL Module for Head and Neck Cancer: A Qualitative Study
Bibliographic record
Abstract
BACKGROUND: Patient-reported outcome (PRO) instruments are important tools for monitoring disease activity and response to treatment in clinical trials and clinical practice. In recent years, there have been movements away from traditional pen-and-paper PROs towards electronic administration. When using electronic PROs (ePROs), evidence that respondents complete ePROs in a similar way to their paper counterparts provides assurance that the two modes of administration are comparable or equivalent. The European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life Questionnaire-Core 30 item (EORTC QLQ-C30) and associated disease-specific modules are among the most widely used PROs in oncology. Although studies have evaluated the comparability and equivalence of electronic and original paper versions of the EORTC QLQ-C30, no such studies have been conducted to date for the head and neck cancer specific module (EORTC QLQ-H&N35). OBJECTIVE: This study aimed to qualitatively assess the comparability of paper and electronic versions of the EORTC QLQ-H&N35. METHODS: Ten head and neck cancer patients in the United States underwent structured cognitive debriefing and usability interviews. An open randomized crossover design was used in which participants completed the two modes of administration allocated in a randomized order. Using a "think-aloud" process, participants were asked to speak their thoughts aloud while completing the EORTC QLQ-H&N35. They were thoroughly debriefed on their responses to determine consistency in interpretation and cognitive process when completing the instrument in both paper and electronic format. RESULTS: Participants reported that the EORTC QLQ-H&N35 demonstrated excellent qualitative comparability between modes of administration. The proportion of noncomparable responses (ie, where the thought process used by participants for selecting responses appeared to be different) observed in the study was low (11/350 response pairs [35 items x 10 participants]; 3.1%). Evidence of noncomparability was observed for 9 of the 35 items of the EORTC QLQ-H&N35 and in no more than 2 participants per item. In addition, there were no apparent differences in level of comparability between individual participants or between modes of administration. CONCLUSIONS: Mode of administration does not affect participants' response to, or interpretation of, items in the EORTC QLQ-H&N35. The findings from this study add to the existing evidence supporting the use of electronic versions of the EORTC instruments when migrated to electronic platforms according to best practice guidelines.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.056 | 0.083 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.002 | 0.002 |
| Science and technology studies | 0.005 | 0.006 |
| Scholarly communication | 0.003 | 0.003 |
| Open science | 0.002 | 0.004 |
| Research integrity | 0.001 | 0.002 |
| Insufficient payload (model declined to judge) | 0.002 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".