Intellectual Conflicts of Interest Among Pulmonary and Critical Care Clinical Practice Guidelines
Bibliographic record
Abstract
RATIONALE Conflicts of interest (COI) threaten the validity of clinical practice guidelines (CPGs). CPG-producing organizations, including the American Thoracic Society, have paid significant attention to COI and instituted changes to manage it more effectively in recent years. Although there is a large amount of evidence regarding the prevalence of financial COI, comparatively little is known about intellectual COI, and it has not been previously assessed among pulmonary and critical care CPGs. METHODS We retrospectively analyzed all CPGs published by pulmonary and critical care societies from the U.S, Canada, or Europe between January 1, 2018 and December 31, 2019. We searched prior publications of all chairs and authors in PubMed to identify intellectual COI -defined as prior i) authorship on a reviewed study within the CPG, ii) panel membership on a related CPG, or iii) publication of an editorial expressing an opinion on a topic addressed by the CPG, as these may all indicate a preexisting position that could conflict with an objective evaluation of the evidence. Our primary outcome measure was the median percentage of authors with an intellectual COI. We obtained additional information from the CPGs and organizations' websites on secondary outcome measures regarding management of intellectual COI including: use of GRADE methodology, inclusion of methodologists on the CPG panel, disclosure of nonfinancial COI, recusal due to intellectual COI, and inclusion of intellectual COI with the organization's COI policy. RESULTS We identified 26 CPGs published between January 1, 2018 and December 31, 2019. These CPGs included 465 authors and were produced by 7 different professional societies. Among all CPGs, a median of 58% [Interquartile range (IQR), 44% -74%] of authors had an intellectual COI, and a median of 100% [IQR, 79% -100%] of chairs or co-chairs had an intellectual COI. Although an intellectual COI was identified among at least one author in all CPGs, only 7 of 26 (27%) CPGs included a nonfinancial COI disclosure, and 0 CPGs required a panel member to be recused due to an intellectual COI. GRADE methodology was used in 25 (96%) CPGs, and methodologists were included in 19 (73%) CPGs. A total of 3 of 7 (43%) societies had a COI policy that specifically includes intellectual COI. CONCLUSION Among CPGs recently published by pulmonary and critical care societies, intellectual COI is highly prevalent, although it is infrequently disclosed by authors.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.116 | 0.517 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.002 | 0.001 |
| Bibliometrics | 0.025 | 0.027 |
| Science and technology studies | 0.002 | 0.005 |
| Scholarly communication | 0.006 | 0.006 |
| Open science | 0.003 | 0.006 |
| Research integrity | 0.003 | 0.003 |
| Insufficient payload (model declined to judge) | 0.009 | 0.002 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".