MétaCan
Menu
Back to cohort

A Prospective Multicenter Study: Development and Validation of a Pediatric Ulcerative Colitis Activity Index

2006· article· en· W2060525897 on OpenAlexaff
Dan Turner, A Otley, Joep de Bruijne, David R. Mack, Krista Uusoue, Thomas D. Walters, Mary Zachos, Petar Mamula, J S Hyams, AM Griffiths

Bibliographic record

VenueJournal of Pediatric Gastroenterology and Nutrition · 2006
Typearticle
Languageen
FieldSocial Sciences
TopicDelphi Technique in Research
Canadian institutionsSickKids FoundationHospital for Sick Children
Fundersnot available
KeywordsMedicineProspective cohort studyLogistic regressionDelphi methodRank correlationRanking (information retrieval)CohortWeightingPhysical therapyInternal medicineStatisticsMachine learning

Abstract

fetched live from OpenAlex

Background/aim: Existing measures of ulcerative colitis (UC) activity are generally not a product of rigorous development and were not developed for pediatric use. Our aim: to develop and validate a non-invasive, multi-item measure of UC activity for use in pediatric clinical trials. Methods: A judgmental approach was used for item generation using a Delphi group of 48 experts in pediatric IBD and a thorough literature review. Further item reduction and item weighting was performed by regression analysis using a prospective cohort of pediatric UC patients from 5 IBD centers. Physician global assessment of the disease activity (PGA) was used as the dependent variable and the PUCAI items as the predictors. The β estimates of the model served to guide the weighting, governed by maximizing R2 and aided by a correlation matrix. Reliability was assessed by Intra-Class Correlation coefficient (ICC) using two way random ANOVA. Validation of the weighted PUCAI was performed on a separate prospective cohort of UC children undergoing colonoscopy. Colonoscopic appearance and PGA served as the constructs. PUCAI was also simultaneously compared with a common invasive adult index (UCDAI; mayo clinic score). Sample size calculation was based on 10 patients/df of the weighting model (n=160) and further 30 for the correlation validity. Results: A list of 41 potential items was generated by the expert panel. Rank order was considered in item reduction, following 4 rounds of feedback to the group. Gradations for the 11 highest ranking items were selected by consensus following much iteration. The draft PUCAI was completed independently by two physicians assessing 157 children with UC (age 12.7 ± 3.8 yr, 52% males; 77% extensive; 34% moderate to severe; 19% mild and 47% quiescent). ROC curves confirmed the validity of the gradations. Reliability was excellent (ICC>0.9 for all included items). Eight items were most important in the regression analysis: stool number, consistency and blood, abdominal pain, activity level, nocturnal diarrhea, albumin and CRP. In the validation set, the weighted index was highly correlated with both PGA (r=0.86, p<0.001) and colonoscopic appearance (r=0.77, p<0.001), higher than two commonly used, non-invasive adult indices, calculated simultaneously (Lichtiger (r=0.65) and Seo index (r=0.66)). The PUCAI also showed excellent correlation (r=0.92, p<0.001) with the reference invasive index (mayo-score). The laboratory items, improved the PUCAI performance, but not significantly. Conclusions: The rigorously developed PUCAI has excellent reliability and validity. It provides a non-invasive measure of disease activity for use in pediatric clinical trials.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.023
metaresearch head score (Gemma)0.028
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.023
Threshold uncertainty score0.123

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0230.028
Meta-epidemiology (narrow)0.0010.000
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0010.001
Science and technology studies0.0010.000
Scholarly communication0.0010.001
Open science0.0010.001
Research integrity0.0010.001
Insufficient payload (model declined to judge)0.0010.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.031
GPT teacher head0.346
Teacher spread0.316 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations27
Published2006
Admission routes1
Has abstractyes

Explore more

Same venueJournal of Pediatric Gastroenterology and NutritionSame topicDelphi Technique in ResearchFrench-language works237,207