MétaCan
Menu
← Back to cohort
Record W4385879000 · doi:10.1101/2023.08.11.23294007

Performance of RAPID noncontrast CT stroke platform in large vessel occlusion and intracranial hemorrhage detection

2023· preprint· en· W4385879000 on OpenAlexaff
Vivek Yedavalli, Jeremy J. Heit, Seena Dehkharghani, Hafez Haerian, John McMenamy, Justin M. Honce, Vincent M. Timpone, Christopher Harnain, Andrew Kesselman, Anthony Filly, Adam P. Beardsley, Brian Sakamoto, Christopher I. Song, James L Montuori, Benjamin Navot, Francisco Mena, Dan‐Victor Giurgiutiu, Felipe Kitamura, Fabrício Oliveira Lima, Henrique Coelho Silva, Francisco Mont’Alverne, Gregory W. Albers

Bibliographic record

VenuemedRxiv · 2023
Typepreprint
Languageen
FieldMedicine
TopicAcute Ischemic Stroke Management
Canadian institutionsCapital District Health Authority
Fundersnot available
KeywordsMedicineReceiver operating characteristicRadiologyIntracerebral hemorrhageStroke (engine)Acute strokeRetrospective cohort studyOcclusionSurgeryInternal medicineSubarachnoid hemorrhage

Abstract

fetched live from OpenAlex

Abstract Background Noncontrast CT (NCCT) is used to evaluate for intracerebral hemorrhage (ICH) and ischemia in acute ischemic stroke (AIS). Large vessel occlusions (LVOs) are a major cause of AIS, but challenging to detect on NCCT. Aims The purpose of this study is to evaluate an AI software called RAPID NCCT Stroke (RAPID, iSchemaView, Menlo Park, CA) for ICH and LVO detection compared to expert readers. Methods In this IRB approved retrospective, multicenter study, stand-alone performance of the software was assessed based on the consensus of 3 neuroradiologists and sensitivity and specificity were determined. The platform’s performance was then compared to interpretation by readers comprised of eight general radiologists (GR) and three neuroradiologists (NR) in detecting ICH and hyperdense vessel sign (HVS) indicating LVO. Receiver operating characteristics (ROC) curve was used to evaluate the performance of each reader. P < 0.05 was considered significant. Results A total of 244 cases were included. Of the 244, 115 were LVOs and 26 were ICHs. One hundred three cases did not have LVO nor ICH. Stand-alone performance of the software demonstrated sensitivities and specificities of 96.2% and 99.5% for ICH and 63.5% and 95.1% for LVO detection. Compared to all 11 readers and eight GR readers only respectively, the software demonstrated superiority, achieving significantly higher sensitivities (63.5% versus 43.6%, p < 0.0001 and 63.5% versus 40.9%, p =0.001). Conclusion The RAPID NCCT Stroke platform demonstrates superior performance to radiologists for detecting LVO from a NCCT. Use of this software platform could lead to earlier LVO detection and expedited transfer of these patients to a thrombectomy capable center.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.006
metaresearch head score (Gemma)0.013
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.006
Threshold uncertainty score0.033

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0060.013
Meta-epidemiology (narrow)0.0010.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0020.000
Science and technology studies0.0000.000
Scholarly communication0.0010.001
Open science0.0000.001
Research integrity0.0010.000
Insufficient payload (model declined to judge)0.0010.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.015
GPT teacher head0.251
Teacher spread0.235 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations3
Published2023
Admission routes1
Has abstractyes

Explore more

Same venuemedRxiv→Same topicAcute Ischemic Stroke Management→French-language works237,207→