MétaCan
Menu
Back to cohort
Record W4383999044 · doi:10.1136/jnnp-2022-330463

Anomalies in the review process and interpretation of the evidence in the NICE guideline for chronic fatigue syndrome and myalgic encephalomyelitis

2023· review· en· W4383999044 on OpenAlexaff
Peter D. White, Susan Abbey, Brian Angus, Harriet A. Ball, Dedra Buchwald, Christine Burness, Alan Carson, Trudie Chalder, Daniel J. Clauw, Jan Coebergh, Anthony S. David, Barbara A. Dworetzky, Mark J. Edwards, Alberto J. Espay, John Etherington, Per Fink, Signe Flottorp, Béatrice Garcin, Paul Garner, Paul Glasziou, William Hamilton, Peter Henningsen, Ingrid Hoeritzauer, Mujtaba Husain, Anne‐Catherine M. L. Huys, Hans Knoop, Kurt Kroenke, Alexander Lehn, James L. Levenson, Paul Little, Andrew R. Lloyd, Ira Madan, J.W.M. van der Meer, Alastair Miller, Maurice Murphy, Irwin Nazareth, David L. Perez, Wendy Phillips, Markus Reuber, Winfried Rief, Alastair Santhouse, Tereza Serranová, Michael Sharpe, Biba Stanton, Donna E. Stewart, Jon Stone, Michèle Tinazzi, Derick T Wade, Simon Wessely, Vegard Bruun Wyller, Adam Zeman

Bibliographic record

VenueJournal of Neurology Neurosurgery & Psychiatry · 2023
Typereview
Languageen
FieldMedicine
TopicFibromyalgia and Chronic Fatigue Syndrome Research
Canadian institutionsUniversity Health NetworkToronto General HospitalUniversity of Toronto
FundersNational Institute for Health and Care Research
KeywordsChronic fatigue syndromeGuidelineEncephalomyelitisNiceInterpretation (philosophy)MedicinePsychologyPhysical therapyPsychiatryPathologyPhilosophyComputer scienceLinguisticsMultiple sclerosis

Abstract

fetched live from OpenAlex

Chronic fatigue syndrome/myalgic encephalomyelitis (CFS/ME) is a disabling long-term condition of unknown cause. The National Institute for Health and Care Excellence (NICE) published a guideline in 2021 that highlighted the seriousness of the condition, but also recommended that graded exercise therapy (GET) should not be used and cognitive-behavioural therapy should only be used to manage symptoms and reduce distress, not to aid recovery. This U-turn in recommendations from the previous 2007 guideline is controversial.We suggest that the controversy stems from anomalies in both processing and interpretation of the evidence by the NICE committee. The committee: (1) created a new definition of CFS/ME, which 'downgraded' the certainty of trial evidence; (2) omitted data from standard trial end points used to assess efficacy; (3) discounted trial data when assessing treatment harm in favour of lower quality surveys and qualitative studies; (4) minimised the importance of fatigue as an outcome; (5) did not use accepted practices to synthesise trial evidence adequately using GRADE (Grading of Recommendations, Assessment, Development and Evaluations trial evidence); (6) interpreted GET as mandating fixed increments of change when trials defined it as collaborative, negotiated and symptom dependent; (7) deviated from NICE recommendations of rehabilitation for related conditions, such as chronic primary pain and (8) recommended an energy management approach in the absence of supportive research evidence.We conclude that the dissonance between this and the previous guideline was the result of deviating from usual scientific standards of the NICE process. The consequences of this are that patients may be denied helpful treatments and therefore risk persistent ill health and disability.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.644
metaresearch head score (Gemma)0.867
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: Evaluation · Consensus signal: none
Study designCandidate signal: Qualitative · Consensus signal: none
GenreCandidate signal: Review · Consensus signal: none
Teacher disagreement score0.356
Threshold uncertainty score0.439

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.6440.867
Meta-epidemiology (narrow)0.0030.006
Meta-epidemiology (broad)0.0180.017
Bibliometrics0.0230.029
Science and technology studies0.0050.023
Scholarly communication0.0320.023
Open science0.0180.014
Research integrity0.0330.023
Insufficient payload (model declined to judge)0.0040.004

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.086
GPT teacher head0.406
Teacher spread0.321 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designQualitative
DomainEvaluation
GenreReview

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations31
Published2023
Admission routes1
Has abstractyes

Explore more

Same venueJournal of Neurology Neurosurgery & PsychiatrySame topicFibromyalgia and Chronic Fatigue Syndrome ResearchFrench-language works237,207