MétaCan
Menu
Back to cohort

Standardization of Lesion Classification and Assessment by Investigators in Clinical Trials for Hidradenitis Suppurativa

2025· article· en· W4416704562 on OpenAlexafffund
Amit Garg, Andrew Strunk, Bria Midgette, Kelly Frasier, Erica Simone Dayan, Pim Aarts, Afsáneh Alavi, Raed Alhusayen, Bitte Falk G. Bechara, Vincenzo Bettoli, Alain Brassard, Debra Brown, Nisha Suyien Chandran, Siew Eng Choon, Steven R. Cohen, Steven Daveluy, V. del Mármol, Robert P. Dellavalle, Lennart Emtestam, Farida Benhadou, Pablo Fernández‐Peñas, Richard Flowers, John W. Frew, Kurt Gebauer, Evangelos J. Giamarellos‐Bourboulis, Noah Goldfarb, Barbara Horváth, Jennifer L. Hsiao, Gregor B. E. Jemec, Michelle A. Lowes, Angelo Valerio Marzano, Łukasz Matusiak, Robert G. Micheletti, Hazel H. Oon, Lauren A.V. Orenstein, Alex G. Ortega‐Loayza, So Yeon Paek, J.C. Pascual, Vincent Piguet, Barry I. Resnik, David Rosmarin, Gretchen M. Roth, Christopher J. Sayed, Dimitri Luz Felipe da Silva, Linnea Thorlacius, Thrasyvoulos Tzellos, Hessel H. van der Zee, Kelsey van Straalen, John R. Ingram

Bibliographic record

VenueJAMA Dermatology · 2025
Typearticle
Languageen
FieldMedicine
TopicHidradenitis Suppurativa and Treatments
Canadian institutionsUniversity of TorontoSunnybrook Health Science Centre
FundersSchool of Medicine, University of North Carolina at Chapel HillLee Kong Chian School of Medicine, Nanyang Technological UniversitySchool of Medicine, Indiana UniversitySchool of Medicine, Emory UniversityFondazione IRCCS Ca' Granda Ospedale Maggiore PoliclinicoEmory UniversityNational University of SingaporeUniversity of TorontoUniversity of North Carolina at Chapel HillCardiff UniversitySjællands UniversitetshospitalParker Institute for Cancer ImmunotherapyUniversità degli Studi di MilanoUniversity of Pennsylvania
KeywordsHidradenitis suppurativaClinical trialStandardizationReliability (semiconductor)LesionMEDLINE

Abstract

fetched live from OpenAlex

Importance: Accurate classification and reliability in assessment for lesions of hidradenitis suppurativa (HS) by investigators is critical to the determination of responder status and to overall data quality in clinical trials. Objective: To establish consensus-based morphological definitions of HS lesions and guidance statements that standardize investigator lesion assessments for implementation in clinical trials. Evidence Review: Health professionals (primarily dermatologists) with expertise in the measurement of HS disease activity as well as novice raters completed a preliminary questionnaire in which participants were asked to assess images of HS lesions and provide qualitative feedback on their decision making. Based on this feedback, detailed morphologic definitions for lesions and guidance statements that standardize lesion assessments were formulated and presented for consensus voting in 2 electronic Delphi surveys. A virtual group discussion after round 1 supported participants in round 2 voting. Findings: Response rates were 84.7% (50 of 59), 86.0% (43 of 50), and 90.9% (40 of 44) in the preliminary, electronic Delphi round 1, and electronic Delphi round 2 surveys, respectively. Morphological definitions for 11 lesion types achieved the prespecified 70% consensus threshold, with 9 definitions reaching at least 90% agreement. After 2 electronic Delphi rounds, 16 of 18 guidance statements achieved the prespecified consensus threshold, with 13 statements receiving endorsement from more than 80% of participants. Two guidance statements related to assessment of tunneled plaques with multiple openings and assessment of scalp lesions failed to reach consensus. Conclusions and Relevance: Common morphologic definitions and guidance that standardize assessment of HS lesions can be implemented in clinical trial protocols and investigator trainings with the goals of improving accuracy and reliability of investigator ratings.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.831
metaresearch head score (Gemma)0.863
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Methods · Consensus signal: Methods
Teacher disagreement score0.831
Threshold uncertainty score0.208

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.8310.863
Meta-epidemiology (narrow)0.0020.002
Meta-epidemiology (broad)0.0060.006
Bibliometrics0.0070.008
Science and technology studies0.0030.008
Scholarly communication0.0100.011
Open science0.0060.007
Research integrity0.0070.006
Insufficient payload (model declined to judge)0.0020.002

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.168
GPT teacher head0.494
Teacher spread0.325 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designNot applicable
Domainnot available
GenreMethods

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations4
Published2025
Admission routes2
Has abstractyes

Explore more

Same venueJAMA DermatologySame topicHidradenitis Suppurativa and TreatmentsFrench-language works237,207