MétaCan
Menu
Back to cohort

Development and Validation of the Morphea Activity Measure in Patients With Pediatric Morphea

2023· article· en· W4319460715 on OpenAlex
María Teresa García‐Romero, Megha M. Tollefson, Elena Pope, Heather A. Brandling‐Bennett, Amy S. Paller, E. Keimig, Lisa M. Arkin, Karolyn A. Wanat, Stephen R. Humphrey, Victoria P. Werth, Vikash S. Oza, Heidi Jacobe, Nicole Fett, Kelly M. Cordoro, Isabel Vera, Yvonne E. Chiu

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.

Bibliographic record

VenueJAMA Dermatology · 2023
Typearticle
Languageen
FieldMedicine
TopicSystemic Sclerosis and Related Diseases
Canadian institutionsHospital for Sick ChildrenUniversity of Toronto
Fundersnot available
KeywordsMedicineMorpheaIntraclass correlationInter-rater reliabilityLocalized SclerodermaPhysical therapySeverity of illnessIntra-rater reliabilityPsychometricsDermatologyRating scaleInternal medicineClinical psychologyConfidence intervalStatistics

Abstract

fetched live from OpenAlex

Importance: Morphea is an insidious inflammatory disorder of the skin and deeper tissues. Determining disease activity is challenging yet important to medical decision-making and patient outcomes. Objective: To develop and validate a scoring tool, the Morphea Activity Measure (MAM), to evaluate morphea disease activity of any type or severity that is easy to use in clinical and research settings. Design, Setting, and Participants: This pilot diagnostic study was conducted from September 9, 2019, to March 6, 2020, in 2 phases: development and validation. During the development phase, 14 morphea experts (dermatologists and pediatric dermatologists) used a Delphi consensus method to determine items that would be included in the MAM. The validation phase included 8 investigators who evaluated the tool in collaboration with 14 patients with pediatric morphea (recruited from a referral center [Medical College of Wisconsin]) during a 1-day in-person meeting on March 6, 2020. Main Outcomes and Measures: During the development phase, online survey items were evaluated by experts in morphea using a Likert scale (score range, 0-10, with 0 indicating not important and 10 indicating very important); agreement was defined as a median score of 7.0 or higher, disagreement as a median score of 3.9 or lower, and no consensus as a median score of 4.0 to 6.9. During the validation phase, reliability (interrater and intrarater agreement using intraclass correlation coefficients), validity (using the content validity index and κ statistics as well as correlations with the modified Localized Scleroderma Severity Index and the Physician Global Assessment of Activity using Spearman ρ coefficients), and viability (using qualitative interviews of investigators who used the MAM tool) were evaluated. Descriptive statistics were used for quantitative variables. Data on race and ethnicity categories were collected but not analyzed because skin color was more relevant for the purposes of this study. Results: Among 14 survey respondents during the development phase, 9 (64.3%) were pediatric dermatologists and 5 (35.7%) were dermatologists. After 2 rounds, a final tool was developed comprising 10 items that experts agreed were indicative of morphea activity (new lesion in the past 3 months, enlarging lesion in the past 3 months, linear lesion developing progressive atrophy in the past 3 months, erythema, violaceous rim or color, warmth to the touch, induration, white-yellow or waxy appearance, shiny white wrinkling, and body surface area). The validation phase was conducted with 14 patients (median age, 14.5 years [range, 8.0-18.0 years]; 8 [57.1%] female), 2 dermatologists, and 6 pediatric dermatologists. Interrater and intrarater agreement for MAM total scores was good, with intraclass correlation coefficients of 0.844 (95% CI, 0.681-0.942) for interrater agreement and 0.856 (95% CI, 0.791-0.901) for intrarater agreement. Correlations between the MAM and the modified Localized Scleroderma Severity Index (Spearman ρ = 0.747; P < .001) and the MAM and the Physician Global Assessment of Activity (Spearman ρ = 0.729; P < .001) were moderately strong. In qualitative interviews, evaluators agreed that the tool was easy to use, measured morphea disease activity at a single time point, and should be responsive to changes in morphea disease activity over multiple time points. Conclusions and Relevance: In this study, the MAM was found to be a reliable, valid, and viable tool to measure pediatric morphea activity. Further testing to assess validity in adults and responsiveness to change is needed.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.000
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.005
Threshold uncertainty score0.176

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0000.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.015
GPT teacher head0.222
Teacher spread0.207 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it