Face and content validation of the amyotrophic lateral sclerosis—Bulbar dysfunction index (ALS-BDI)
Bibliographic record
Abstract
Purpose Early detection and tracking of bulbar dysfunction in amyotrophic lateral sclerosis (ALS) are critical for directing management of the disease. Existing physiological assessments of bulbar dysfunction are often inaccessible and cost-prohibitive for clinical application. Existing clinical assessments are limited. The overall goal of our research is to develop a brief and reliable, clinician-administered assessment tool, the ALS Bulbar Dysfunction Index (ALS-BDI) to evaluate bulbar dysfunction. The aim of this study was to establish content and face validity of the ALS-BDI through item generation and reduction, including item scoring. Methods The design of the ALS-BDI followed guidelines outlined by the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN). The design stage of the ALS-BDI involved two steps: (Step 1) the generation of candidate items from a literature review of commonly used clinical tools, and selection of items following a review of item reliability and item relevance and expert consensus; (Step 2) the assessment of their content and face validity via online survey feedback from experts ( n = 35). The initial design was followed by a semi-structured cognitive interview with Speech-Language Pathologists ( n = 5) to finalize a testable draft of the instrument. Results Two drafts of the ALS-BDI were developed. The first draft contained 48 items, after a review of existing clinical tools for their relevance to bulbar dysfunction in ALS. Of the 48 items, 35 items were retained after surveying experts and clinician users for their relevance, feasibility, interpretability, and appropriateness. The second draft of the ALS-BDI contained 37 items, due to one item splitting, based on users cognitive interviews. Conclusions The ALS-BDI described in this study aims to provide a brief and reliable, clinician-administered assessment tool to evaluate bulbar dysfunction in patients with ALS. Future research will evaluate the psychometric properties of this tool including its reliability, validity, and responsiveness to change over time.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.000 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".