MétaCan
Menu
Back to cohort
Record W4248192047 · doi:10.1213/ane.0000000000002035

In Response

2017· letter· en· W4248192047 on OpenAlexaffabout
Alana M. Flexman, Taren Roughead, Jolene H. Fisher, Darreul Sewell, Christopher J. Ryerson

Bibliographic record

VenueAnesthesia & Analgesia · 2017
Typeletter
Languageen
FieldComputer Science
TopicText Readability and Simplification
Canadian institutionsSt. Paul's HospitalUniversity of TorontoUniversity of British Columbia
Fundersnot available
KeywordsMedicineThe InternetService (business)Internet privacyPublic relationsMedical educationWorld Wide WebMarketingPolitical scienceComputer science

Abstract

fetched live from OpenAlex

We thank Van Zundert et al1 for their letter elaborating on our recent publication that identified the inaccurate and out-of-date recommendations on preoperative fasting provided in many Internet sources.2 Van Zundert et al1 acknowledge that the Internet includes abundant health-related websites that present incomplete or incorrect data using overly complex language, thus making it difficult for patients to obtain appropriate information. The authors appropriately state that a comprehensive, patient-targeted, open-access, up-to-date Internet resource is needed, and advocate for a “Wiki-Anesthesia” of vetted information. We agree that there is a pressing need to create and promote reliable online sources of medical information; however, previous attempts at “wiki-style” collaboratively edited medical websites have met with mixed success, and many are no longer functional.3 For example, WikiSurgery (www.wikisurgery.com), an initiative supported by the International Journal of Surgery, was launched in 2006, but is no longer functional. AskDrWiki (www.askdrwiki.com) was also launched in 2006, but has experienced poor traffic and has had minimal updates in the past 2 years. Medpedia was a higher-profile website that ceased operations in 2013 after 6 years of existence, despite millions of dollars in funding and support from many top-ranking universities, the American College of Physicians, and the United Kingdom National Health Service.3 Reasons proposed for the lack of success of Medpedia include a paucity of topical breadth, insufficient depth of available topics, and, perhaps most important, poor visibility. Other websites have had modest success, but they are primarily aimed at health care professionals and frequently focus on a single medical specialty (eg, Radiopaedia, WikiDoc, WikEM). A successful patient-directed, health-related website needs to be accurate, understandable, freely accessible, and highly visible. A wiki-type approach has the potential to satisfy all of these features; however, we suggest that Wikipedia itself has the greatest potential for success as the future platform for crowd-sourced information in anesthesiology and other health care areas. Wikipedia is highly visible and already the leading source of health care information for both patients and physicians. Websites on medical topics are generally of moderate to good quality.4 We have searched Wikipedia additionally for information on several topics of interest to patients undergoing anesthesia (Table), finding that these pages are accurate and current; however, they use language that corresponds to a college reading level.Table.: Wikipedia Websites for Selected Anesthesia-Related TopicsThe Wikipedia platform is already reasonably accurate and frequently visited by both patients and physicians, although with room for improvement in readability and gaps in some specific areas of interest to patients (eg, postoperative pain is addressed only briefly within larger and more general text on pain). These relative deficiencies are easily fixed, in part by encouraging greater contribution from experts to identify and address gaps in the current content, with additional editing to ensure appropriate readability for a patient resource. Rather than to add to the vast array of medical websites, we believe we should instead strive to improve upon existing websites such as Wikipedia, which has already established itself as a comprehensive, accurate, and easily accessible Internet resource for many health-related topics. Alana M. Flexman, MDTaren Roughead, BScDepartment of Anesthesiology, Pharmacology,and TherapeuticsUniversity of British ColumbiaBritish Columbia, Canada Jolene H. Fisher, MDDivision of Respirology, Department of MedicineUniversity of TorontoOntario, Canada Darreul Sewell, MBChBDepartment of NeuroanaesthesiaNational Hospital of Neurology and NeurosurgeryUniversity College London HospitalsQueens Square, London, United Kingdom Christopher J. Ryerson, MD, MASDivision of Respirology, Department of Medicine, Centre forHeart Lung Innovation, University of British ColumbiaBritish Columbia, Canada

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.003
metaresearch head score (Gemma)0.038
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesInsufficient payload (model declined to judge)
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Commentary · Consensus signal: Commentary
Teacher disagreement score0.307
Threshold uncertainty score0.988

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0030.038
Meta-epidemiology (narrow)0.0010.000
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0010.001
Science and technology studies0.0030.001
Scholarly communication0.0050.004
Open science0.0030.004
Research integrity0.0130.015
Insufficient payload (model declined to judge)0.3070.178

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.022
GPT teacher head0.266
Teacher spread0.244 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designNot applicable
Domainnot available
GenreCommentary

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2017
Admission routes2
Has abstractyes

Explore more

Same venueAnesthesia & AnalgesiaSame topicText Readability and SimplificationFrench-language works237,207