MétaCan
Menu
Back to cohort
Record W4318755584 · doi:10.1093/aje/kwad023

Rudolph et al. Respond to “Mathematization of Epidemiology”

2023· letter· en· W4318755584 on OpenAlexfundno aff
Kara E. Rudolph, Nicholas Williams, Iván Díaz, Sean X. Luo, John Rotrosen, Edward V. Nunes

Bibliographic record

VenueAmerican Journal of Epidemiology · 2023
Typeletter
Languageen
FieldMedicine
TopicOpioid Use Disorder Treatment
Canadian institutionsnot available
FundersMailman School of Public Health, Columbia UniversityNYU Grossman School of MedicineYork University
KeywordsSophisticationContext (archaeology)Relevance (law)Public healthBuprenorphineMedicinePublic relationsPolitical sciencePsychiatrySociologyOpioidLawNursing

Abstract

fetched live from OpenAlex

This article is linked to "Optimally Choosing Medication Type for Patients With Opioid Use Disorder" and "Invited Commentary: On the Mathematization of Epidemiology as a Socially Engaged Quantitative Science" (https://doi.org/10.1093/aje/kwac217 and https://doi.org/10.1093/aje/kwad010). We appreciate the opportunity to respond to Cartus and Marshall’s (1) commentary on our paper (2). First, we would like to thank them for their kind feedback and their excellent discussion of numerous structural factors that impact the opioid epidemic and, in particular, the suboptimal and inequitable treatment of opioid use disorder (OUD). We wholeheartedly agree that upstream changes at the national, state, local, and clinical levels (like the recent repeal of the X-waiver requirement for buprenorphine prescribing) are sorely needed to improve access to and quality of medication for opioid use disorder (MOUD) treatments to all who could benefit. Cartus and Marshall raise an interesting set of issues regarding the potential trade-offs between investing in technical sophistication and public health considerations. We are sympathetic to the concern that the broader social context, policy environment, and general public health relevance may sometimes be considered secondary to the technical goals of a particular analysis. However, we do not see technical sophistication and public health relevance as a zero-sum game. In fact, we believe that technical sophistication can, in certain cases, even help clarify public health relevance. We can elaborate on the above with an example from our paper (2) where the authors argue that the “tension between methodological sophistication and practical considerations emerges clearly” (1, p. XXX): our decision to discard the subset of buprenorphine patients who received buprenorphine on a methadone schedule (i.e., attending clinic daily to receive medication instead of receiving a supply of medication every 1–6 weeks). First, we want to point out that community-based comparative effectiveness trials, such as those conducted by the National Institute on Drug Abuse Clinical Trials Network and included in our paper, do not compare medications in a vacuum but instead compare treatment regimens—of which medication is a key component but not the only component. In the set of trials we considered, there were 2 general types of buprenorphine regimens: buprenorphine treatment in a methadone setting and buprenorphine treatment in the typical office-based setting. (This issue can also be thought of as multiple versions of treatment.) Combining the subset of patients receiving buprenorphine in the methadone setting with the buprenorphine patients from the other 2 trials would have violated an assumption required for identifying our causal quantity of interest from the data, although we could have retained this group as a separate treatment regimen. Estimating a causal quantity (also called a causal estimand) that is not identified from the observed data has questionable utility, as the resulting quantity may be too bias-ridden to be meaningful. Lack of technical sophistication may miss this potential identifiability complication. Additionally, in this particular case, including a subset of people who received a regimen of buprenorphine treatment that does not commonly exist in the real world, and will never routinely exist given the patient-centered barrier of undue burden, also would not add practical value to the study. Thus, in this case, the causally principled decision based on identification assumptions and the practically principled decision based on patient care seem aligned. Causally principled methods do not inherently “obscure social context” or obviate a “public health question” (1, p. XXX). Instead, they can clarify what quantity can be identified and estimated and under what causal and statistical assumptions. It is critical, however, to consider the social, political, and historical contexts in which the data are situated and which produced the data, so that the resulting algorithms and/or findings based on that data can be imbued with appropriate interpretations. This challenge has been discussed in the algorithmic fairness/unfairness literature: (3–5) “Data is frequently imperfect in ways that allow these algorithms to inherit the prejudices of prior decision makers…and may reflect the widespread biases that persist in society at large” (5, p. 671). Bringing a formal discussion of algorithmic fairness to treatment rules learned for optimizing the treatment of OUD or other related substance use disorders is an important endeavor that could shape future work in this area. Finally, we agree with Cartus and Marshall on the need to focus on other OUD patient-centered outcomes and on the need for structural improvements to policies and clinical practice to improve the MOUD treatment landscape. As epidemiologists, our work can inform such improvements. However, work that is not rigorous, reproducible, or methodologically sound, or is divorced from the contexts giving rise to the data, may be more hindrance than help. For our work to be of value, it must answer practical, relevant questions and answer them well. Some research questions can be answered “well” without technical or methodological sophistication. Others may require it. Fortunately, instead of detracting from public health relevance, methodologic sophistication has the potential to clarify and improve it (4). Author affiliations: Department of Epidemiology, Mailman School of Public Health, Columbia University, New York, New York, United States (Kara E. Rudolph, Nicholas T. Williams); Department of Population Health, New York University Grossman School of Medicine, New York, New York, United States (Iván Díaz); Department of Psychiatry, School of Medicine, Columbia University, New York, New York, United States (Sean X. Luo, Edward V. Nunes); New York State Psychiatric Institute, Columbia University, New York, New York, United States (Sean X. Luo, Edward V. Nunes); and Department of Psychiatry, New York University Grossman School of Medicine, New York, New York, United States (John Rotrosen). Conflict of interest: none declared.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.024
metaresearch head score (Gemma)0.139
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Commentary · Consensus signal: Commentary
Teacher disagreement score0.069
Threshold uncertainty score0.125

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0240.139
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0020.002
Bibliometrics0.0010.002
Science and technology studies0.0060.011
Scholarly communication0.0070.010
Open science0.0040.003
Research integrity0.0690.058
Insufficient payload (model declined to judge)0.0060.003

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.070
GPT teacher head0.403
Teacher spread0.333 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designNot applicable
Domainnot available
GenreCommentary

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2023
Admission routes1
Has abstractyes

Explore more

Same venueAmerican Journal of EpidemiologySame topicOpioid Use Disorder TreatmentFrench-language works237,207