MétaCan
Menu
Back to cohort
Record W3188232697 · doi:10.1097/mao.0000000000003319

RESPONSE TO LETTER TO THE EDITOR: “ARTIFICIAL INTELLIGENCE AND DECISION-MAKING FOR VESTIBULAR SCHWANNOMA SURGERY”

2021· letter· en· W3188232697 on OpenAlexaff
Jason A. Beyea, Daniel Newsted, Chaim M. Bell, Paul L. Nguyen, Ryan Alkins

Bibliographic record

VenueOtology & Neurotology · 2021
Typeletter
Languageen
FieldMedicine
TopicMeningioma and schwannoma management
Canadian institutionsKingston Health Sciences CentreInstitute for Clinical Evaluative SciencesQueen's University
Fundersnot available
KeywordsOverfittingMedicineLogistic regressionAcoustic neuromaSchwannomaArtificial intelligenceArtificial neural networkPopulationMachine learningVestibular systemSurgeryComputer scienceAudiologyInternal medicine

Abstract

fetched live from OpenAlex

In Reply: We would like to thank the authors for their interest in our article “Predictors of Postoperative Complications in Vestibular Schwannoma Surgery – A Population Based Study” (1). The group noted our analysis of population data in identifying predictors of postoperative outcomes and suggested that an artificial neural network (ANN) could be used to overcome the limitations of our study. This group has recently published an excellent proof-of-concept study comparing a multivariable logistic regression (LR) model to an ANN for predicting recurrence of vestibular schwannomas (VS). Their ANN was impressively able to predict recurrence with higher sensitivity and specificity compared with a standard regression model (2). We appreciate the group's insight into alternative analyses that could be performed on the population datasets used in our study. Recently, several groups have demonstrated the ability of ANNs to predict postoperative outcomes following various surgical interventions (3–6). These studies show that ANNs can offer advantages over LRs in predicting specific outcomes depending on the dataset on which they are trained (4,6). Indeed, these flexible non-linear systems perform well on noisy input patterns, can detect complex implicit interactions between predictor variables, have a high fault tolerance, and easily generalize from input data (5). Despite the advantages of ANN, there are drawbacks that limit the feasibility of ANN in certain circumstances. The use of ANNs is more computationally burdensome compared with LR and they are more prone to overfitting (7). Moreover, due to the “black box” nature of ANNs, it can be difficult to identify important predictors, whereas with LR this task is much more expedient (7). For these reasons, logistic regression models continue to be employed for identifying predictors of VS surgery postoperative outcomes (8,9). We recognize the potential value in deploying an ANN to predict postoperative outcomes in patients who have undergone VS microsurgery using the datasets from our study. We agree with the authors that the complexity of patient risk-factors and the multifactorial causes of postoperative outcomes supports further analyses by machine learning techniques. We applaud the author's recent success in developing an ANN, and are eagerly awaiting the group's future work. We invite the authors to reach out to our group in the future for potential collaborations, including sharing of datasets and analytic expertise.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.004
metaresearch head score (Gemma)0.046
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Editorial · Consensus signal: none
Teacher disagreement score0.024
Threshold uncertainty score0.034

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0040.046
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0020.002
Bibliometrics0.0010.001
Science and technology studies0.0020.002
Scholarly communication0.0040.005
Open science0.0030.001
Research integrity0.0240.031
Insufficient payload (model declined to judge)0.0100.007

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.048
GPT teacher head0.314
Teacher spread0.267 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designNot applicable
Domainnot available
GenreEditorial

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations2
Published2021
Admission routes1
Has abstractyes

Explore more

Same venueOtology & NeurotologySame topicMeningioma and schwannoma managementFrench-language works237,207