MétaCan
Menu
Back to cohort
Record W2110799663 · doi:10.1093/aje/kwt242

Re: "The 'Case-Chaos Study' l Adjunct or Alternative to Conventional Case-Control Study Methodology"

2013· letter· en· W2110799663 on OpenAlexafffund
Juliet R.C. Pulliam, Jonathan Dushoff

Bibliographic record

VenueAmerican Journal of Epidemiology · 2013
Typeletter
Languageen
FieldMedicine
TopicData-Driven Disease Surveillance
Canadian institutionsMcMaster University
FundersFogarty International CenterCanadian Institutes of Health ResearchNatural Sciences and Engineering Research Council of CanadaScience and Technology DirectorateNational Institutes of HealthU.S. Department of Homeland Security
KeywordsAdjunctCHAOS (operating system)MedicineComputer sciencePhilosophy

Abstract

fetched live from OpenAlex

In a recent article, Gillespie et al. (1) proposed a permutation-based method for identification of factors that may be associated with risk of illness in an outbreak setting. They did this by comparing potential risk factors with other potential risk factors in the case population, rather than comparing factors in cases with those in controls. They suggested that in some cases this method may provide an alternative to case-control studies (1). Frequency of exposure among cases can in some situations provide valuable and timely clues about risk, but interpreting these frequencies sensibly depends on information or assumptions about frequency in the general population. For example, a population of newly diagnosed lung cancer cases in the United States would show a much higher frequency of male sex than of asbestos exposure; to evaluate these observations, we need either some sort of control or baseline group or common-sense assumptions about baseline frequencies of these factors. In the absence of data from controls, investigators still need to assess the likelihood that a factor in the cases occurs at an elevated frequency relative to the same factor in a baseline population. The statistical test proposed by Gillespie et al. instead assesses whether a factor is significantly more common in cases than other factors considered as potential risk factors. Thus, their suggested statistical test does not enhance interpretation of the frequency of exposure, and in fact may interfere with it, by adding unnecessary complications. Furthermore, whether the prevalence of a given factor is elevated relative to the prevalences of other factors depends on which other factors are chosen for the study. For example, asbestos exposure is rare even among newly diagnosed lung cancer cases. Not only would a “case-chaos” comparison fail to identify it as a risk factor, but its inclusion in the study would increase the likelihood that other factors would be identified as risk factors. To illustrate the above points for an existing outbreak data set, let us use the case-chaos design to analyze case data from the well-known outbreak of foodborne illness that occurred at a church supper in Oswego County, New York, in 1940 (Figure 1). In addition to the measured risk factors, we introduce 2 hypothetical ones: “church member,” which is a common but randomly distributed factor, and “ate dessert first,” which is rare but an absolute risk factor for illness. As expected, the methodology shows that the case-chaos odds ratio of the common factor is significantly elevated, and that of the rare factor is significantly reduced, in comparison with the other measured factors. Note that the estimated odds ratio of the rare factor is significantly reduced here because most of the other factors considered happen to be relatively common. The same factor, with the same effect on the population, would not show significance in another study, where different sorts of factors had been tested along with it. Figure 1. Illustration of some characteristics of the case-chaos approach proposed by Gillespie et al. (1), using data from an outbreak of foodborne illness that occurred in Oswego County, New York, in 1940 (4, 5). A box-and-whisker plot is shown for each exposure ... Given these limitations, we believe that the proposed case-chaos methodology is not an appropriate alternative to the conventional case-control study design. The analytic formulation suggested by Hohle (2) in a recent letter was intended to clarify the fundamental problem: that the case-chaos approach compares frequencies across different exposures rather than with respective baseline frequencies. McCarthy et al.'s response to Hohle (3) missed this point; in fact, neither a statistical test nor a confidence interval is appropriate, because the hypothesis being addressed is irrelevant to the question at hand. In the event that identifying high-frequency factors among cases is required in the course of an outbreak investigation, we recommend that this be done using the more straightforward approach of calculating and examining the proportions of cases with various exposures.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.017
metaresearch head score (Gemma)0.036
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Meta-epidemiology (narrow), Research integrity, Insufficient payload (model declined to judge)
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Commentary · Consensus signal: Commentary
Teacher disagreement score0.284
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0170.036
Meta-epidemiology (narrow)0.0010.000
Meta-epidemiology (broad)0.0050.001
Bibliometrics0.0010.001
Science and technology studies0.0000.001
Scholarly communication0.0000.000
Open science0.0010.000
Research integrity0.0000.004
Insufficient payload (model declined to judge)0.0020.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.151
GPT teacher head0.425
Teacher spread0.274 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

Study designNot applicable
Domainnot available
GenreCommentary

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations4
Published2013
Admission routes2
Has abstractyes

Explore more

Same venueAmerican Journal of EpidemiologySame topicData-Driven Disease SurveillanceFrench-language works237,207