MétaCan
Menu
Back to cohort
Record W3012475239 · doi:10.1186/s13075-020-02151-w

A Canadian evaluation framework for quality improvement in childhood arthritis: key performance indicators of the process of care

2020· review· en· W3012475239 on OpenAlexafffundabout
Claire Barber, Marinka Twilt, Tram Pham, Gillian Currie, Susanne M. Benseler, Rae S. M. Yeung, Michelle Batthish, Nicholas Blanchette, Jaime Guzmán, Bianca Lang, Claire LeBlanc, Deborah M. Levy, Christine O’Brien, Heinrike Schmeling, Gordon S. Soon, Lynn Spiegel, Kristi Whitney, Deborah A. Marshall

Bibliographic record

VenueArthritis Research & Therapy · 2020
Typereview
Languageen
FieldMedicine
TopicAutoimmune and Inflammatory Disorders Research
Canadian institutionsTrillium Health CentreUniversity of British ColumbiaHospital for Sick ChildrenDalhousie UniversityUniversity of TorontoAlberta Children's HospitalMcMaster UniversityMcMaster Children's HospitalMcGill UniversityUniversity of Calgary
FundersAlberta Children's Hospital Research InstituteOntario Ministry of Economic Development, Job Creation and TradeGenome AlbertaHospital for Sick ChildrenArthritis SocietyMinistero dello Sviluppo EconomicoOntario GenomicsGenome Canada
KeywordsPerformance indicatorMedicineLikert scaleDelphi methodQuality (philosophy)Physical therapyInclusion (mineral)Family medicinePsychologyComputer science

Abstract

fetched live from OpenAlex

BACKGROUND: The evaluation of quality of care in juvenile idiopathic arthritis (JIA) is critical for advancing patient outcomes but is not currently part of routine care across all centers in Canada. The study objective is to review the current landscape of JIA quality measures and use expert panel consensus to define key performance indicators (KPIs) that are important and feasible to collect for routine monitoring in JIA care in Canada. METHODS: Thirty-seven candidate KPIs identified from a systematic review were reviewed for inclusion by a working group including 3 pediatric rheumatologists. A shortlist of 14 KPIs was then assessed using a 3-round modified Delphi panel based on the RAND/UCLA Appropriateness Method. Ten panelists across Canada participated based on their expertise in JIA, quality measurement, or lived experience as a parent of a child with JIA. During rounds 1 and 3, panelists rated each KPI on a 1-9 Likert scale on themes of importance, feasibility, and priority. In round 2, panelists participated in a moderated in-person discussion that resulted in minor modifications to some KPIs. KPIs with median scores of ≥ 7 on all 3 questions without disagreement were included in the framework. RESULTS: Ten KPIs met the criteria for inclusion after round 3. Five KPIs addressed patient assessments: pain, joint count, functional status, global assessment of disease activity, and the clinical Juvenile Arthritis Disease Activity Score (cJADAS). Three KPIs examined access to care: wait times for consultation, access to pediatric rheumatologists within 1 year of diagnosis, and frequency of clinical follow-up. Safety was addressed through KPIs on tuberculous screening and laboratory monitoring. KPIs examining functional status using the Childhood Health Assessment Questionnaire (CHAQ), quality of life, uveitis, and patient satisfaction were excluded due to concerns about feasibility of measurement. CONCLUSIONS: The proposed KPIs build upon existing KPIs and address important processes of care that should be measured to improve the quality of JIA care. The feasibility of capturing these measures will be tested in various data sources including the Understanding Childhood Arthritis Network (UCAN) studies. Subsequent work should focus on development of meaningful outcome KPIs to drive JIA quality improvement in Canada and beyond.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.289
metaresearch head score (Gemma)0.277
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Theoretical or conceptual · Consensus signal: none
GenreCandidate signal: Review · Consensus signal: none
Teacher disagreement score0.803
Threshold uncertainty score0.932

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.2890.277
Meta-epidemiology (narrow)0.0040.002
Meta-epidemiology (broad)0.0050.009
Bibliometrics0.0260.028
Science and technology studies0.0100.010
Scholarly communication0.0160.006
Open science0.0100.012
Research integrity0.0040.008
Insufficient payload (model declined to judge)0.0020.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.061
GPT teacher head0.429
Teacher spread0.368 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designTheoretical or conceptual
Domainnot available
GenreReview

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations21
Published2020
Admission routes3
Has abstractyes

Explore more

Same venueArthritis Research & TherapySame topicAutoimmune and Inflammatory Disorders ResearchFrench-language works237,207