MétaCan
Menu
Back to cohort
Record W2920315139 · doi:10.3899/jrheum.171405

Feasibility and Construct Validation of the Patient Reported Outcomes Measurement Information System in Systemic Vasculitis

2019· article· en· W2920315139 on OpenAlexafffundvenue
Gunnar Tómasson, John T. Farrar, David Cuthbertson, Carol A. McAlear, Susan P. Ashdown, Peter F. Cronholm, Jill Dawson, Don Gebhart, Georgia Lanier, Raashid Luqmani, Nataliya Milman, Jacqueline Peck, Joanna Robson, Judy A. Shea, Simon Carette, Nader Khalidi, Curry L. Koening, Carol A. Langford, Paul A. Monach, Larry W. Moreland, Christian Pagnoux, Ulrich Specks, Antoine G. Sreih, Steven R. Ytterberg, Peter A. Merkel

Bibliographic record

VenueThe Journal of Rheumatology · 2019
Typearticle
Languageen
FieldMedicine
TopicVasculitis and related conditions
Canadian institutionsMcMaster UniversitySt. Joseph’s Healthcare HamiltonMount Sinai HospitalUniversity of Ottawa
FundersNational Institute of Arthritis and Musculoskeletal and Skin DiseasesMedical Research CouncilNational Center for Advancing Translational SciencesVasculitis Clinical Research ConsortiumUniversity of the West of EnglandUniversity of BristolUniversity of OxfordRare Diseases Clinical Research NetworkUniversity of OttawaMcMaster UniversityHáskóli ÍslandsUniversity of PittsburghNational Center for Research ResourcesUniversity of PennsylvaniaCleveland ClinicPatient-Centered Outcomes Research InstituteSchool of Medicine, Boston UniversityOhio State UniversityUniversity of South Florida
KeywordsPatient-Reported Outcomes Measurement Information SystemComputerized adaptive testingConstruct validityMedicinePhysical therapyCohortPsychometricsPatient-reported outcomeQuality of life (healthcare)Internal medicineClinical psychology

Abstract

fetched live from OpenAlex

OBJECTIVE: The Patient Reported Outcome Measurement Information System (PROMIS) is a collection of item banks of self-reported health. This study assessed the feasibility and construct validity of using PROMIS instruments in vasculitis. METHODS: Data from a multicenter longitudinal cohort of subjects with systemic vasculitis were used. Instruments from 10 PROMIS item banks were selected with direct involvement of patients. Subjects completed PROMIS instruments using computer adaptive testing (CAT). The Medical Outcomes Study Short Form-36 (SF-36) was also administered. Cross-sectional construct validity was assessed by calculating correlations of PROMIS scores with SF-36 measures and physician and patient global scores for disease activity. Longitudinal construct validity was assessed by correlations of between-visit differences in PROMIS scores with differences in other measures. RESULTS: During the study period, 973 subjects came for 2306 study visits and the PROMIS collection was completed at 2276 (99%) of visits. The median time needed to complete each PROMIS instrument ranged from 40 to 55 s. PROMIS instruments correlated cross-sectionally with individual scales of the SF-36, most strongly with subscales of the SF-36 addressing the same domain as the PROMIS instrument. For example, PROMIS fatigue correlated with both the physical component score (PCS; r = -0.65) and with the mental component score (MCS; r = -0.54). PROMIS physical function correlated strongly with PCS (r = 0.81) but weakly with MCS (r = 0.29). Weaker correlations were observed longitudinally between change in PROMIS scores with change in PCS and MCS. CONCLUSION: Collection of data using CAT PROMIS instruments is feasible among patients with vasculitis and has some cross-sectional and longitudinal construct validity.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.080
metaresearch head score (Gemma)0.125
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.080
Threshold uncertainty score0.426

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0800.125
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.001
Bibliometrics0.0010.002
Science and technology studies0.0000.001
Scholarly communication0.0020.001
Open science0.0010.002
Research integrity0.0010.001
Insufficient payload (model declined to judge)0.0010.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.019
GPT teacher head0.235
Teacher spread0.215 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations7
Published2019
Admission routes3
Has abstractyes

Explore more

Same venueThe Journal of RheumatologySame topicVasculitis and related conditionsFrench-language works237,207