MétaCan
Menu
Back to cohort

A systematic review of immune-related adverse event (irAE) reporting in clinical trials of immune checkpoint inhibitors (ICIs).

2014· review· en· W2615663954 on OpenAlexaff
Tom Wei‐Wu Chen, Albiruni R. Abdul Razak, Philippe L. Bédard, Lillian L. Siu, Aaron R. Hansen

Bibliographic record

VenueJournal of Clinical Oncology · 2014
Typereview
Languageen
FieldMedicine
TopicCancer Immunotherapy and Biomarkers
Canadian institutionsUniversity of TorontoPrincess Margaret Cancer CentreUniversity Health Network
Fundersnot available
KeywordsMedicineClinical trialAdverse effectConsolidated Standards of Reporting TrialsInternal medicineMEDLINEConfidence intervalSystematic review

Abstract

fetched live from OpenAlex

3057 Background: ICIs are active in various solid tumors. irAEs are associated with ICI therapy that can affect multiple organ systems. Limited data exist regarding the quality of irAE reporting in ICI clinical trial publications. Methods: A systematic search of citations from MEDLINE, EMBASE and Cochrane databases identified prospective clinical trials involving ICIs in advanced solid tumors from 2003-2013. A 21-point (pt) (title, abstract, introduction 3 pts; methods 6 pts; results 9 pts and discussion 3 pts) quality score (QS) was adapted from the CONSORT harms extension statement. Items included in the 21-pt QS addressed: methods of irAE assessment; duration of irAE evaluation; time of onset, management, and resolution of irAEs; and consistency of safety reporting with authors’ conclusion. Two reviewers independently scored all trials and differences were resolved by consensus. Linear regression was used to identify factors associated with quality reporting. Results: After review of 2628 articles, 50 trial reports were included (50% phase I, 38% phase II, 6% phase III, and 6% not specified) with ICIs as monotherapy (52%) or combination treatments (48%). The median QS was 11.25 pts (range 3.5-17.5 pts). The median grade 3/4 toxicity rate reported was 20.5% (range 0-66%) and 29/50 (58%) of trials concluded that irAEs were tolerable. Of these 29 studies, 5 had grade 3/4 toxicity rates that exceeded 33%. Thirteen (26%) studies did not report any details on the outcome of irAEs and 22% did not provide information on how irAEs were managed. Six trials concluded that the ICI tested had reversible or manageable irAEs without presenting any data on irAE treatment or resolution. Multivariate regression analysis revealed that year of publication (within last 5 years) and journal impact factor >15 were significantly associated with a higher QS (p=0.002 for both). Conclusions: The reporting of irAEs due to ICIs is often incomplete. A standardized reporting method of irAEs that accounts for tolerability, management and reversibility is needed to ensure completeness and transparency of published trial data. This would enable a more precise evaluation of the therapeutic risk benefit ratio of ICIs.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Direct model labels (unvalidated)

Per-model category and study-design labels from the labeling rounds. They are machine output, unvalidated, and the disagreement between models ships as data. No study design here is MEDLINE-validated yet.

Model armCategoriesStudy designConfidence
gemmaMetaresearchMeta-epidemiology (broad)
Domain: Reporting · Genre: Review
About the Canadian research system: no · About a Canadian topic: no
Systematic reviewlow
gptMetaresearch
Domain: Reporting · Genre: Review
About the Canadian research system: no · About a Canadian topic: no
Systematic reviewhigh
models splitAgreement compares identical category sets and study designs across arms.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.377
metaresearch head score (Gemma)0.360
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Meta-epidemiology (narrow), Meta-epidemiology (broad), Research integrity
Consensus categoriesMetaresearch, Meta-epidemiology (broad), Research integrity
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Systematic review · Consensus signal: Systematic review
GenreCandidate signal: Review · Consensus signal: Review
Teacher disagreement score0.354
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.3770.360
Meta-epidemiology (narrow)0.0010.000
Meta-epidemiology (broad)0.0510.034
Bibliometrics0.0010.001
Science and technology studies0.0000.001
Scholarly communication0.0000.000
Open science0.0010.000
Research integrity0.0020.004
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.270
GPT teacher head0.570
Teacher spread0.300 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Labeled directly by 2 models reading the full record.

MetaresearchMeta-epidemiology (broad)

The models disagree on parts of this classification; every voice is preserved in the section at the end of the page.

Study designSystematic review
DomainReporting
GenreReview

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations4
Published2014
Admission routes1
Has abstractyes

Explore more

Same venueJournal of Clinical OncologySame topicCancer Immunotherapy and BiomarkersCategoryMetaresearchFrench-language works237,207