MétaCan
Menu
Back to cohort
Record W4391610246 · doi:10.1093/bjd/ljad498.043

542 - Validation of the skin pain numerical rating scale of the Pruritus and Symptoms Assessment for Atopic Dermatitis for adults and adolescents with moderate-to-severe atopic dermatitis

2024· article· en· W4391610246 on OpenAlexaff
Jonathan I. Silverberg, Sonja Ständer, Brian Kim, Anthony Bewley, L. Misery, Christian Vestergaard, Melinda Gooderham, Andrew G. Bushmakin, Joseph C. Cappelleri, Erman Güler, Justine Alderfer, Melissa Watkins, Andrew Selfridge, Daniela E. Myers

Bibliographic record

VenueBritish Journal of Dermatology · 2024
Typearticle
Languageen
FieldMedicine
TopicDermatology and Skin Diseases
Canadian institutionsProbity Medical ResearchSKiN HealthQueen's University
Fundersnot available
KeywordsAtopic dermatitisMedicineDermatologyRating scalePsychology

Abstract

fetched live from OpenAlex

Abstract Background Skin pain is a common and burdensome symptom of atopic dermatitis (AD), and its severity increases with disease progression. The Pruritus and Symptoms Assessment for Atopic Dermatitis (PSAAD) is a validated 11-item patient-reported instrument developed in accordance with regulatory agency guidance for assessment of the daily symptoms of patients with AD, including skin pain. Objective To establish content validity and evaluate the psychometric properties of the skin pain numerical rating scale (NRS) item of the PSAAD. Methods The skin pain NRS is a single-item measure from the PSAAD and is used to assess skin pain severity over the past 24 hours with the question “How painful was your skin over the past 24 hours?” on a 10-point scale from 0 (not painful) to 10 (extremely painful). A qualitative validation analysis consisting of concept elicitation (CE) interviews; electronic completion of the PSAAD measure, including the skin pain NRS; and cognitive debriefing (CD) interviews was conducted for adults and adolescents with mild-to-severe AD. Evaluation of psychometric properties of the skin pain NRS—including test-retest reliability, estimation of meaningful within-patient change (MWPC), known-group validity, ability to detect change, construct validity, quality of completion, and ceiling and floor effects—was conducted based on a post hoc qualitative and quantitative analysis of pooled data, with skin pain NRS as part of the PSAAD in the abrocitinib monotherapy phase 3 trials JADE MONO-1 (NCT03349060) and JADE MONO-2 (NCT03575871). Data from patients (≥12 years of age) with moderate-to-severe AD were pooled across all treatment arms. Results Among 30 CE interviews (adolescents [12-17 years], n=15; adults [≥18 years], n=15) conducted over 2 rounds of testing, 20 of 30 (67%) patients reported skin pain. During CD interviews (n=30), 100% of patients interpreted the skin pain NRS item as intended, and 73% reported it as relevant. The psychometric validation analysis included 736 patients (JADE MONO-1, N=347; JADE MONO-2, N=389). The test-retest reliability of the skin pain NRS was evidenced by large intraclass correlation coefficients (ICC; 0.76 and 0.72 in JADE MONO-1 and MONO-2, respectively) for a single daily skin pain score, which increased to 0.93 and 0.91 for a measurement averaging at least 4 scores per week. Convergent validity was demonstrated by correlations between skin pain and other clinician- and patient-­reported AD measures (median correlation >0.4 starting at week 4). The skin pain NRS distinguished between “clear” and “severe” disease severity groups, assessed using the Patient Global Assessment (PtGA) and Investigator’s Global Assessment (IGA) as continuous and categorical anchors (P<0.0001); differences were also significant among other disease severity groups using the PtGA and IGA as continuous anchors (P<0.0001). Based on the PtGA and IGA anchor analysis, the estimated MWPC was 1.9 and ranged from 2.7 to 3.9 points using the empirical cumulative distribution function analysis. Ability to detect change was demonstrated by linear relationships between disease severity measures and skin pain scores (correlation of ≥0.5 between the skin pain NRS and the PtGA). More than 90% of patients provided at least 4 daily skin pain scores each week. No floor or ceiling effects were observed. Conclusions The qualitative and quantitative data from initial PSAAD development and psychometric evaluation of the skin pain NRS from the PSAAD support its content validity, reliability, construct validity, and ability to detect change. These findings corroborate the 4-point improvement in skin pain as the adequate and meaningful cut-off to define a skin pain responder in JADE MONO-1 and MONO-2.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.017
metaresearch head score (Gemma)0.020
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.017
Threshold uncertainty score0.092

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0170.020
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.001
Bibliometrics0.0010.000
Science and technology studies0.0000.000
Scholarly communication0.0010.000
Open science0.0000.001
Research integrity0.0000.001
Insufficient payload (model declined to judge)0.0020.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.005
GPT teacher head0.250
Teacher spread0.244 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations1
Published2024
Admission routes1
Has abstractyes

Explore more

Same venueBritish Journal of DermatologySame topicDermatology and Skin DiseasesFrench-language works237,207