MétaCan
Menu
Back to cohort
Record W2972030690 · doi:10.1111/add.14801

Reducing the risks of distortion in cannabis research

2019· article· en· W2972030690 on OpenAlexaboutno aff
Keith Humphreys, Wayne Hall

Bibliographic record

VenueAddiction · 2019
Typearticle
Languageen
FieldMedicine
TopicCannabis and Cannabinoid Research
Canadian institutionsnot available
Fundersnot available
KeywordsCannabisDistortion (music)Marijuana smokingPsychologyMedicineEnvironmental healthPsychiatryComputer scienceSubstance use

Abstract

fetched live from OpenAlex

Corporate and ideological vested interests may distort the findings of cannabis research. Scientists working in this area need to be aware of and actively manage these risks. We focus on one specific claim—that medical cannabis programs have reduced opioid overdose deaths in the United States—but similar lessons can be drawn from the way that weak evidence has been used to support claims that cannabis (whether putatively medical and/or explicitly recreational) can treat diabetes, psychiatric disorders, problem drinking, cancers and obesity, improve fetal health and prevent Alzheimer's disease, car accidents and suicide 1. Five years ago, a study in JAMA Internal Medicine reported that US states with medical cannabis programs had a slower than expected rate of increase in opioid overdose deaths between 1997 and 2010 relative to states without these programs 2. The cannabis industry claimed that the study proved that medical cannabis use had reduced opioid overdose deaths. The medical and recreational marijuana promoting company Weedmaps used billboards to advertise the claim 3, and many journalists chimed in with stories declaring that ‘Medical pot is our best hope to fight the opioid epidemic’ 4. Addiction's editors (including the two authors of this editorial) pointed out that correlations between state-level overdose death data and whether or not states had a medical cannabis program should be not interpreted as evidence that individuals could reduce their opioid overdose risk by using cannabis 5. We also highlighted other peer-reviewed studies that provided stronger evidence that was inconsistent with this claim (see 6-9). A recent study 10 vindicated the Addiction editorial. It extended the original study of marijuana law and opioid overdoses 2, using the same methods but adding seven more years of data (2011–17). The study found that the association between medical cannabis programs and opioid overdose mortality reversed over time, such that greater cannabis access was associated with higher opioid overdose death rates 10. Neither the cannabis industry nor its ideological allies have withdrawn their claims in light of these findings. For example, in an opinion piece apparently aimed at legislators 11, a representative of the US National Organization for the Reform of Marijuana Laws (NORML) criticized the methods of the recent study 10 while citing a limited selection of studies and praising the positive findings of studies that used similar designs. The pushback against the study's findings suggests some lessons for cannabis researchers to consider. In a number of countries, cannabis use has traditionally been associated with left-wing grassroots activism, making it easy to assume that the cannabis industry is run by altruistic hippies disinterestedly proselytizing the virtues of cannabis and unconcerned about worldly wealth 12. In the United States and Canada the industry is, in fact, run by business executives with law degrees and MBAs who are adopting the business practices of the tobacco and alcohol industries that are now major investors in large cannabis companies 12. Researchers should therefore not be surprised that the profit-maximizing cannabis industry highlights any ‘good news’ on cannabis and seeks to discredit any evidence of harm. Researchers who take funds from the cannabis industry should therefore be aware that accepting cannabis industry funding may come with strings, and could also soon have the same adverse reputational effects among one's colleagues as taking tobacco and alcohol industry funding. We believe that journals in our field should follow Addiction's practice in requiring researchers to disclose cannabis industry support in the same way as they disclose any support from the alcohol, tobacco, gambling and pharmaceutical industries. Journals should also call out misbehavior by the emerging cannabis industry as they do that of other industries producing and selling addictive products. Advocates for more lax, pro-corporate cannabis policies may use evidential double standards to portray the risks and benefits of cannabis use. Studies showing apparent harmful effects of cannabis use may be discounted for methodological reasons (e.g. confounding, lack of randomization), while studies with the same or worse methodological problems may be promoted because they provide more congenial results. The two studies of medical cannabis and opioid overdose illustrate this well, given that the second used the same methods as the first and had more data, yet was portrayed as a less reliable source of evidence. Journals place constraints on authors to prevent them overstating the implications of their findings, but the media is extremely interested in scientists who make controversial statements or who overstate the definitiveness of their findings. Researchers who succumb to these temptations are often rewarded by more media attention, speaking invitations and a more prominent profile that is often welcomed as a marker of public impact by their employers. Media training—including a component on ethics—could be a useful way to ensure more accurate press releases about the research of their employees 13. Critics may perhaps accuse us of setting unrealistically high scientific standards in reporting research on a largely ‘harmless’ drug that is claimed to have extraordinary medical benefits; but the lives of vulnerable people may be put at risk when science is distorted for corporate or ideological ends. As noted, several US states responded to the much-hyped original study of cannabis and opioid overdoses by authorizing the use of medical cannabis to treat heroin-addicted individuals. Advice that opioid users should use medical cannabis to replace opioid agonist therapies (e.g. methadone, buprenorphine) poses a significant risk because abrupt cessation of these medications dramatically increases the risks of an overdose death if users return to opioid use 14. Moreover, US states with high rates of opioid overdose deaths may be happier to allow patients to use medical cannabis to treat their opioid dependence (at their own expense) than to publicly fund treatment programs that have been shown to substantially reduce opioid overdose deaths; namely, opioid agonist therapies 15. Avoiding the distortion of science is not an academic nicety, but a solemn ethical responsibility that protects vulnerable human beings. We urge our colleagues to tread warily in this contested and volatile arena. K.H. was supported by grants from the Veterans Health Administration and the Wu Tsai Neurosciences Institute. This editorial expresses the authors’ perspectives and does not necessarily represent the views of their employers.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.001
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.663
Threshold uncertainty score0.940

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0010.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.001
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.071
GPT teacher head0.397
Teacher spread0.326 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations7
Published2019
Admission routes1
Has abstractyes

Explore more

Same venueAddictionSame topicCannabis and Cannabinoid ResearchFrench-language works237,207