MétaCan
Menu
Retour à la cohorte
Enregistrement W3173361548 · doi:10.1016/j.xjon.2021.06.015

Commentary: Bringing down Babel—a pathway to a universal adverse events language

2021· editorial· en· W3173361548 sur OpenAlexaff
Eagan J. Peters, Biniam Kidane

Notice bibliographique

RevueJTCVS Open · 2021
Typeeditorial
Langueen
DomaineMedicine
ThématiqueCardiac, Anesthesia and Surgical Outcomes
Établissements canadiensCancerCare ManitobaUniversity of Manitoba
Organismes subventionnairesnon disponible
Mots-clésMedicineAdverse effectHarmonizationCardiothoracic surgeryGeneral surgerySurgeryIntensive care medicineInternal medicine

Résumé

récupéré en direct d'OpenAlex

Central MessageCan we build thoracic surgery programs that eliminate/minimize complications? Harmonizing adverse events classifications across databases is a key issue that first must be addressed.“Behold, the people is one, and they have all one language; and this they begin to do: and now nothing will be restrained from them, which they have imagined to do.”—Genesis 11:6See Article page 250 in the June 2021 issue. Can we build thoracic surgery programs that eliminate/minimize complications? Harmonizing adverse events classifications across databases is a key issue that first must be addressed. See Article page 250 in the June 2021 issue. Can we build a thoracic surgery program that eliminates or minimizes all complications? Is this a lofty height which we are destined never to reach? Complications after thoracic surgery have been decreasing, in part due to global efforts to objectively assess, document, and improve on outcomes.1Sigler G. Anstee C. Seely A.J.E. Harmonization of adverse events monitoring following thoracic surgery: pursuit of a common language and methodology.J Thorac Cardiovasc Surg Open. 2021; 6: 250-256Google Scholar While descriptions of postoperative complications in thoracic surgeries are widely reported, Sigler and colleagues1Sigler G. Anstee C. Seely A.J.E. Harmonization of adverse events monitoring following thoracic surgery: pursuit of a common language and methodology.J Thorac Cardiovasc Surg Open. 2021; 6: 250-256Google Scholar identify how the variety of systems used to classify adverse events (AE) undermine the potential of multicenter collaboration and data synthesis. In this issue of JTCVS Open, the authors describe their approach to harmonizing AE across databases.1Sigler G. Anstee C. Seely A.J.E. Harmonization of adverse events monitoring following thoracic surgery: pursuit of a common language and methodology.J Thorac Cardiovasc Surg Open. 2021; 6: 250-256Google Scholar The discordance between thoracic surgery AE databases has been previously described.2Ivanovic J. Seely A.J.E. Anstee C. Villeneuve P.J. Gilbert S. Maziak D.E. et al.Measuring surgical quality: comparison of postoperative adverse events with the American College of Surgeons NSQIP and the thoracic morbidity and mortality classification system.J Am Coll Surg. 2014; 218: 1024-1031Google Scholar,3Salati M. Refai M. Pompili C. Xiumè F. Sabbatini A. Brunelli A. Major morbidity after lung resection: a comparison between the European Society of Thoracic Surgeons Database System and the thoracic morbidity and mortality system.J Thorac Dis. 2013; 5: 217-222Google Scholar As such, it is difficult to draw valid comparisons between the AE of patients characterized using different databases. This precludes centers from pooling their outcomes data for meaningful international collaboration and quality improvement. However, the authors offer a means to collect AE in the same manner for their translation into any of the commonly used AE classification systems. A system is only as strong as the underlying assumptions on which it is constructed. Herein lies an important, but perhaps currently inescapable, methodologic limitation identified by the authors; the definitions of harmonization and the manner in which judgments are made regarding degree of harmonization are currently subjective and somewhat opaque. To harmonize differing definitions of AE, the definition of harmonization itself was characterized by a single author (if “perfect”) or by consensus with 2 authors (if not “perfect”). This subverts the reproducibility of harmonized definitions due to the necessarily subjective interpretation of AE elements. Certainly, there are definitions in each classification system that are straightforward or approximate objective measurement. However, inter-rater reliability cannot be taken for granted, especially in a novel undertaking predicated on the interpretation of a single expert. The authors acknowledge that it is good practice to ensure multidisciplinary discussion in efforts to characterize AE within individual institutions. Efforts to characterize AE across institutions should be held to a similar standard, if not more rigorous due to the risk of data being “lost in translation.” Therefore, such consensus-based discussions around definitions require not only standardized definitions of AE categories but also requisite thresholds of agreement among experts for an AE to be characterized. In doing so, one ensures a robust foundation on which to build this synthesis of multiple classifications. Nevertheless, a major strength of this paper is that it establishes a framework for harmonization. This creates the unique opportunity to compare AE data from institutions across the world. Currently, centers that desire to collaborate across multiple AE databases must fill in their AE data for each separate system. However, the approach of Sigler and colleagues1Sigler G. Anstee C. Seely A.J.E. Harmonization of adverse events monitoring following thoracic surgery: pursuit of a common language and methodology.J Thorac Cardiovasc Surg Open. 2021; 6: 250-256Google Scholar is simple, with 4 drop-down menus that facilitate AE classification on researchers' behalf. Therefore, researchers neither must enter the same data repeatedly nor learn an entirely new system to harmonize. Rather, the authors' approach aligns already-existing systems to harmonize. Because it is practical and user-friendly in this way, this system also ensures accessibility to researchers who seek to collaborate internationally for the first time. At the end of the day, authors should be commended for tackling an important problem in the way that we all communicate with each other, which is a barrier to sustainable and large-scale quality improvement initiatives across jurisdictions. Given the long-reaching implications that may result from such harmonization endeavors, it is imperative that underlying assumptions about definitions and decisions for harmonization be abundantly clear and reproducible. Otherwise, the very human frailty of subjectivity, rather than any vengeful deity, will be what brings down our proverbial tower before we reach the lofty heights of zero complications. Harmonization of adverse events monitoring following thoracic surgery: Pursuit of a common language and methodologyJTCVS OpenVol. 6PreviewThoracic surgery carries significant risk of postoperative adverse events (AEs). Multiple international recording systems are used to define and collect AEs following thoracic surgery procedures. We hypothesized that a simple-yet-ubiquitous approach to AE documentation could be developed to allow universal data entry into separate international databases. Full-Text PDF Open Access

Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.

Comment cette classification a été obtenuedéplier

Prédiction distillée sur la base complète

Imitation des enseignants

Ni prévalence calibrée, ni vérité terrain. Validation humaine à venir. Apprise à partir de 10 348 étiquettes directes de Codex et de 10 348 étiquettes directes de Gemma. Le mode candidate est l'union des têtes enseignantes seuillées; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont ni des étiquettes humaines ni des étiquettes directes de modèles de pointe.

score de la tête « metaresearch » (Codex)0,001
score de la tête « metaresearch » (Gemma)0,001
Version: codex-gemma-dda1882f352aStatut de validation: machine_predicted_unvalidated
Catégories candidatesMéta-épidémiologie (sens strict), Charge utile insuffisante (le modèle a refusé de juger)
Catégories consensuellesaucune
DomaineSignal candidat: aucune · Signal consensuel: aucune
Devis d'étudeSignal candidat: Sans objet · Signal consensuel: Sans objet
GenreSignal candidat: Éditorial · Signal consensuel: Éditorial
Score de désaccord entre enseignants0,060
Score d'incertitude au seuil1,000

Scores Codex et Gemma par catégorie

CatégorieCodexGemma
Métarecherche0,0010,001
Méta-épidémiologie (sens strict)0,0000,000
Méta-épidémiologie (sens large)0,0020,001
Bibliométrie0,0000,000
Études des sciences et des technologies0,0000,000
Communication savante0,0000,000
Science ouverte0,0010,001
Intégrité de la recherche0,0000,001
Charge utile insuffisante (le modèle a refusé de juger)0,0010,000

Scores machine (provisoires)

Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.

Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.

Tête enseignante Opus0,009
Tête enseignante GPT0,296
Écart entre enseignants0,287 · la distance entre les deux têtes enseignantes sur ce seul travail
Statut de validationscore_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découle

Classification

machine, non validée

Prédiction automatique; un appel candidat d’une seule tête enseignante, pas un consensus.

Devis d'étudeSans objet
Domainenon disponible
GenreÉditorial

Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».

En bref

Citations1
Publié2021
Routes d'admission1
Résumé présentoui

Explorer davantage

Même revueJTCVS OpenMême sujetCardiac, Anesthesia and Surgical OutcomesTravaux en français237 207