MétaCan
Menu
Back to cohort
Record W3159456314 · doi:10.1007/s11136-021-02846-w

Response shift in patient-reported outcomes: definition, theory, and a revised model

2021· article· en· W3159456314 on OpenAlexaff
Antoine Vanier, Frans J. Oort, Leah McClimans, Nikki Ow, Bernice G. Gulek, Jan R. Böhnke, Mirjam A. G. Sprangers, Véronique Sebille, Nancy E. Mayo

Bibliographic record

VenueQuality of Life Research · 2021
Typearticle
Languageen
FieldPsychology
TopicMental Health Research Topics
Canadian institutionsMcGill University Health CentreMcGill University
Fundersnot available
KeywordsConstruct (python library)Extant taxonPromParadigm shiftCognitive psychologyPsychologyEmpirical researchMeasure (data warehouse)Item response theoryEconometricsSocial psychologyEpistemologyPositive economicsComputer sciencePsychometricsDevelopmental psychologyMathematicsMedicineData miningEconomics

Abstract

fetched live from OpenAlex

PURPOSE: The extant response shift definitions and theoretical response shift models, while helpful, also introduce predicaments and theoretical debates continue. To address these predicaments and stimulate empirical research, we propose a more specific formal definition of response shift and a revised theoretical model. METHODS: This work is an international collaborative effort and involved a critical assessment of the literature. RESULTS: Three main predicaments were identified. First, the formal definitions of response shift need further specification and clarification. Second, previous models were focused on explaining change in the construct intended to be measured rather than explaining the construct at multiple time points and neglected the importance of using at least two time points to investigate response shift. Third, extant models do not explicitly distinguish the measure from the construct. Here we define response shift as an effect occurring whenever observed change (e.g., change in patient-reported outcome measures (PROM) scores) is not fully explained by target change (i.e., change in the construct intended to be measured). The revised model distinguishes the measure (e.g., PROM) from the underlying target construct (e.g., quality of life) at two time points. The major plausible paths are delineated, and the underlying assumptions of this model are explicated. CONCLUSION: It is our hope that this refined definition and model are useful in the further development of response shift theory. The model with its explicit list of assumptions and hypothesized relationships lends itself for critical, empirical examination. Future studies are needed to empirically test the assumptions and hypothesized relationships.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.089
metaresearch head score (Gemma)0.129
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Theoretical or conceptual · Consensus signal: Theoretical or conceptual
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.089
Threshold uncertainty score0.471

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0890.129
Meta-epidemiology (narrow)0.0020.001
Meta-epidemiology (broad)0.0020.004
Bibliometrics0.0050.004
Science and technology studies0.0010.011
Scholarly communication0.0050.009
Open science0.0070.005
Research integrity0.0040.008
Insufficient payload (model declined to judge)0.0040.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.543
GPT teacher head0.581
Teacher spread0.038 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designTheoretical or conceptual
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations145
Published2021
Admission routes1
Has abstractyes

Explore more

Same venueQuality of Life ResearchSame topicMental Health Research TopicsFrench-language works237,207