Interobserver variability of croup scoring in clinical practice
Bibliographic record
Abstract
BACKGROUND: Viral laryngotracheobronchitis croup is the most common cause of acute upper airway obstruction in young children. Clinical assessment of children with croup is often performed using 'croup scores'; however, these scores have not been validated outside of the research setting. OBJECTIVE: To determine the reliability of clinical observation items in croup scores in a paediatric emergency department (ED) setting. DESIGN: Literature review identified 12 observation items (level of consciousness or mental status, inspiratory breath sounds, air entry, stridor, cough, cyanosis or colour, anxiety or air hunger, retractions and/or flaring, respiratory rate and heart rate, oxygen saturation and respiratory distress); overlapping items were combined, yielding 10 variables. In a prospective cohort study over 13 months, patients presenting with croup were observed independently, and croup scores were assigned by the triage nurse, ED nurse and the ED physician before treatment. Agreement among observers for clinical observations was analysed using Cohen's quadratic weighted kappa. SETTING: University-affiliated, paediatric hospital ED providing primary care to an urban area (population 330,000). PATIENTS: Children aged three months to five years presenting with viral croup (preceding history of at least one day of upper respiratory tract symptoms associated with barking cough and/or hoarseness and/or stridor). RESULTS: One hundred fifty-eight children meeting inclusion criteria for croup were assessed by three observers within 1 h of each other's assesments and before treatment. Interobserver agreement among the three observers using weighted kappa was greater than chance for all clinical observation items and ranged from fair to moderate (0.2 to 0.4 and 0.4 to 0.6, respectively). CONCLUSIONS: In the busy practice setting of a paediatric ED, substantial interobserver variability exists among health care providers in the measurement of respiratory signs associated with croup in young children. Based on the present study in a practice setting and two research studies, the most reliable items of all of the published items included in croup scoring systems were stridor and retractions.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.003 | 0.006 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".