MétaCan
Menu
Back to cohort
Record W4238878773 · doi:10.1097/aln.0000000000001786

In Reply

2017· letter· en· W4238878773 on OpenAlexaffabout
Daniel I. McIsaac, Colin J. L. McCartney, Carl van Walraven

Bibliographic record

VenueAnesthesiology · 2017
Typeletter
Languageen
FieldEconomics, Econometrics and Finance
TopicHealth Systems, Economic Evaluations, Quality of Life
Canadian institutionsOttawa Hospital
Fundersnot available
KeywordsMedicineConfoundingObservational studyPerspective (graphical)AssertionPathology

Abstract

fetched live from OpenAlex

We thank Drs. Hwang and Jeon and Drs. Kehlet and Jørgensen for their letters and welcome the opportunity to discuss the strengths and limitations of our study.1As stated in the letter from Drs. Hwang and Jeon and acknowledged in our article,1 we were unable to identify whether each nerve block studied was actually clinically effective. When considered from the perspective of an explanatory research question, this is clearly a limitation. However, because the aim of our study was comparative effectiveness, our specific objective was in the realm of pragmatic research, that is, how effective and generalizable might the intervention be in real-world practice.2 From this perspective, we hope that our measures of association provide useful insights into the impact that the peripheral nerve blocks have on system outcomes across a generalizable large sample of patients across an entire healthcare system.With respect to the assertion by Drs. Hwang and Jeon that our lack of control for intraoperative and postoperative variables and complications is a limitation, we would argue the contrary. In observational comparative effectiveness research, efforts must be made to adjust for indication bias and confounding bias (among other sources). When selecting variables that may be confounders, one must ensure that they meet the definition of a confounder, specifically that they differentially impact exposure (i.e., receipt of a block), differentially impact outcome, and are not on the causal pathway.3 Therefore, although complications may contribute to differences in length of stay (LOS), they are not true confounders because they occur after exposure and are likely on the causal pathway to prolonged LOS. Furthermore, it has been shown that control for variables such as these that are not true confounders can lead to spurious associations.4Finally, we agree with Drs. Hwang and Jeon that the choice of analytic approach when performing propensity score–based analyses impacts interpretation of study results.5 Specifically, matched analyses such as ours estimate the average treatment effect in the treated (ATT), because some individuals are excluded if they received treatment but no adequate match was available or if they were untreated and again went unmatched to a treated subject. Although this may decrease overall generalizability, it may also decrease bias. In contrast, methods such as inverse probability of treatment weighting (IPTW) or regression analysis provide an average treatment effect (ATE), that is, what might happen if the entire population was shifted from untreated to treated.6 Although the ATT and ATE are typically similar in direction and magnitude, this is not always the case. In fact, in the case of IPTW, including individuals who were treated despite a very low propensity for treatment can greatly over-weight their contribution to the analysis, especially if extreme tails of the distribution are not trimmed.5 Furthermore, matched analyses can provide an estimate of the absolute risk difference, as opposed to IPTW and regression-based approaches that are typically limited to estimating relative outcome differences. Lastly, in our sensitivity analysis we used a regression-based multilevel multivariable regression analysis, which estimated an ATE for single shot blocks that was identical in direction and magnitude to the ATT estimated from the propensity score–matched analysis.We would also like to thank Drs. Kehlet and Jørgensen for their commentary regarding our publication1 and in particular their interest in promoting improvements in reporting, analysis, and overall research efforts related to LOS. First, we agree that different patterns of care between jurisdictions or individual hospitals can skew LOS findings. As Hart et al.7 outlined in an analysis of Canadian versus American total joint arthroplasty outcomes, LOS in Canadian hospitals tends to be approximately 1.3 to 1.4 days longer, a finding that may be attributable to a 21 to 27% increase in rates of discharge to short-term rehabilitation from American hospitals. Data from Hart et al.7 also suggest a mean LOS after joint replacement in Canadian hospitals of slightly more than four days, a figure consistent with mean LOS reported in our study, which included a larger cross-section of hospitals than would have been included in the National Surgical Quality Improvement Program data file.Regarding differences in practice between hospitals, we fully acknowledge that our data sources do not allow us to measure whether specific fast-track processes of care were used at certain hospitals and for specific patients in our study; this is a limitation. For this reason, we ensured that all of our analyses accounted for clustering of patients within hospitals to allow us to account for unmeasured variation between hospitals, both in the use of perioperative processes of care as well as discharge patterns. In our propensity score–matched analysis this involved direct matching within hospitals along with a propensity score, a method that has been shown to decrease both bias and error in estimating causal effects relative to simply matching on the propensity score.8 In our sensitivity analysis, which used regression analysis, we accounted for clustering of patients in hospitals using a multivariable-adjusted generalized linear model and generalized estimating equation methods. We certainly encourage the use of analytic strategies that account for hierarchal data in all comparative effectiveness research where between-center variation is a consideration.In summary, across a universal healthcare system we report the population-based association between peripheral nerve block exposure and LOS using best-practice methods for comparative effectiveness research and report a LOS consistent with other reports from our jurisdiction. We agree that our data, like any observational data set, have limitations that must be considered when appraising our findings. We also agree that understanding why patients remain in the hospital after surgery is a high-priority area of research and that minimizing variation and instituting best practices should lead to improved patient and system outcomes.The authors declare no competing interests.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.005
metaresearch head score (Gemma)0.062
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesInsufficient payload (model declined to judge)
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Commentary · Consensus signal: Commentary
Teacher disagreement score0.952
Threshold uncertainty score0.000

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0050.062
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0010.001
Science and technology studies0.0030.002
Scholarly communication0.0040.006
Open science0.0030.003
Research integrity0.0180.032
Insufficient payload (model declined to judge)0.0480.034

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.372
GPT teacher head0.431
Teacher spread0.059 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designNot applicable
Domainnot available
GenreCommentary

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2017
Admission routes2
Has abstractyes

Explore more

Same venueAnesthesiologySame topicHealth Systems, Economic Evaluations, Quality of LifeFrench-language works237,207