MétaCan
Menu
← Back to cohort
Record W4391090641 · doi:10.1101/2024.01.21.24301546

Development of a Seizure Matching System for Clinical Decision Making in Epilepsy Surgery

2024· preprint· en· W4391090641 on OpenAlexafffund
John Thomas, Chifaou Abdallah, Kassem Jaber, Olivier Aron, Irena Doležalová, Vadym Gnatkovsky, Daniel Mansilla, Päivi Nevalainen, Raluca Pana, Stephan Schuele, Jaysingh Singh, Ana Suller Martí, Alexandra Urban, Jeffery A. Hall, François Dubeau, Jean Gotman, Birgit Frauscher

Bibliographic record

VenuemedRxiv · 2024
Typepreprint
Languageen
FieldMedicine
TopicEpilepsy research and treatment
Canadian institutionsWestern UniversityMcGill UniversityMontreal Neurological Institute and Hospital
FundersCanadian Institutes of Health ResearchMontreal Neurological Institute and Hospital
KeywordsStereoelectroencephalographySimilarity (geometry)EpilepsyElectroencephalographyMatching (statistics)Epilepsy surgeryArtificial intelligenceComputer scienceCorrelationPsychologyPattern recognition (psychology)MedicineNeuroscienceMathematicsPathologyImage (mathematics)

Abstract

fetched live from OpenAlex

Abstract Background and Objectives The proportion of patients becoming seizure-free after epilepsy surgery has stagnated. Large multi-center stereo-electroencephalography datasets can potentially allow comparing a new patient to past similar cases and make clinical decisions with the knowledge of how similar cases were treated in the past. However, the complexity of these evaluations makes the manual search for similar patients in a large database impractical. We aim to develop an automated system that electrographically and anatomically matches seizures from a patient to those in a database. In addition, since we do not know what features define seizure similarity, particularly considering the various stereo-electroencephalography implantation schemes, we evaluate the agreement and features among experts in classifying seizure similarity. Methods We utilized SEEG seizures from consecutive patients who underwent stereo-electroencephalography for epilepsy surgery. Eight international experts evaluated seizure-pair similarity using a four-level similarity score through a graphical user interface. As our primary outcome, we developed and validated an automated seizure matching system by employing a leave-one-expert-out approach. Secondary outcomes included the inter-rater agreement and features for classifying seizure similarity. Results 320 SEEG seizures from 95 patients were utilized. The seizure matching system achieved an area-under-the-curve of 0.82 (95% CI, 0.819-0.822), indicating its feasibility. Six distinct seizure similarity features were identified and proved effective: onset region, onset pattern, propagation region, duration, extent of spread, and propagation speed. Among these features, the onset region showed the strongest correlation with expert scores (Spearman’s rho=0.75, p <0.001). Additionally, the moderate inter-rater agreement confirmed the practicality of our approach: for the four-level classification, median agreement was 73.9% (interquartile range, 7%), and beyond-chance Gwet’s kappa was 0.45 (0.16); for the binary classification of similar vs. not related, agreement stood at 71.9% (4.7%) with a kappa of 0.46 (0.13). Discussion We demonstrate the feasibility and validity of a stereo-electroencephalography seizure matching system across patients, effectively mirroring the expertise of epileptologists. This novel system can identify patients with seizures similar to that of a patient being evaluated, thus optimizing the treatment plan by considering the treatment and the results of treating similar patients in the past, potentially resulting in an improved surgery outcome.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.008
metaresearch head score (Gemma)0.023
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Simulation or modeling · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.008
Threshold uncertainty score0.044

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0080.023
Meta-epidemiology (narrow)0.0010.000
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0030.001
Science and technology studies0.0010.000
Scholarly communication0.0020.002
Open science0.0010.001
Research integrity0.0010.001
Insufficient payload (model declined to judge)0.0040.002

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.109
GPT teacher head0.425
Teacher spread0.316 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designSimulation or modeling
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2024
Admission routes2
Has abstractyes

Explore more

Same venuemedRxiv→Same topicEpilepsy research and treatment→French-language works237,207→