MétaCan
Menu
Back to cohort

Inter-Rater Reliability of the 4Ts Scoring System for Diagnosing Heparin-Induced Thrombocytopenia in Critically Ill Patients.

2009· article· en· W2547305506 on OpenAlexaff
Mark Crowther, Nicole Zytaruk, K Krolicki, Suzanne Duchesne, Theodore E. Warkentin, Diane Heels‐Ansdell, Jo‐Ann I. Sheppard, Stephen D. Walter, Gordon Guyatt, Deborah Cook

Bibliographic record

VenueBlood · 2009
Typearticle
Languageen
FieldMedicine
TopicHeparin-Induced Thrombocytopenia and Thrombosis
Canadian institutionsHamilton Health SciencesSt. Joseph’s Healthcare HamiltonMcMaster UniversitySt. Joseph's Hospital
Fundersnot available
KeywordsMedicineHeparin-induced thrombocytopeniaHeparinPre- and post-test probabilityPartial thromboplastin timeIntensive care medicineInternal medicinePlatelet

Abstract

fetched live from OpenAlex

Abstract Abstract 3995 Poster Board III-931 Heparin-induced thrombocytopenia (HIT) is commonly suspected, but rarely confirmed, in the critically ill. The lack of readily available rapid diagnostic tests makes the timely diagnosis of HIT challenging. As a result, when HIT is suspected, heparin is often stopped and an alternative anticoagulant is initiated until diagnostic test results become available. A valid scoring system that accurately predicts the likelihood of HIT would be very valuable since it would allow rapid risk stratification that then might allow treatment to be modified in patients at moderate or high risk of harboring HIT, while other strategies might be employed for those at low risk. The 4Ts scoring system has been proposed as such a classification. 4Ts classifies patients on a 4 component, 8 point linear scale. The final score is assigned to 1 of 3 categories representing low, moderate and hand high pretest probability (scores of 0 to 3, 4 to 5 and 6 or more, respectively). We describe results of a pilot study using the 4Ts scoring system within the PROTECT trial (a 3650 patient randomized controlled trial comparing low molecular weight with unfractionated heparin for primary prevention of venous thromboembolism (VTE) in medical-surgical ICU patients). As per the PROTECT protocol, patients are evaluated for HIT if their platelet count falls more than 50% from their initial platelet count (study day 1), if their platelet count falls to less than 50 × 109/l, if VTE occurs, or if HIT is clinically suspected. As of August 6th, 2009, 2657 patients had been enrolled in PROTECT, of whom 523 (19.7%) met criteria for investigation of HIT (170 due to a platelet count fall; 106 due to a platelet count of less than 50×109/l; 343 due to VTE; and 39 due to clinical suspicion (categories not mutually exclusive)). All suspected cases of HIT are to be evaluated using the serotonin release assay (SRA), with HIT confirmed if the HIT test is positive, or HIT refuted if the SRA is negative. To evaluate the 4Ts score, patients are adjudicated independently by 2 experts blinded to each other's scores (MC, hematologist and DC, intensivist). The adjudication occurs in 2 stages: in Stage 1 the clinical case is reviewed and a 4Ts score assigned, masked to SRA testing; in Stage 2 the presence or absence of HIT is ascribed based on review of the patient's laboratory data. Discordant cases are then discussed and consensus achieved. To August 6th, 2009 100 cases have been adjudicated and consensus achieved. Stage 1 raw agreement on the 4Ts score was poor (raw agreement 47.0%). Stage 1 agreement on risk category (low, moderate or high) was better (77%, weighted kappa 0.36 (0.10 to 0.61) reflecting fair agreement). Discordance was largely due to differences in the timing component of the 4Ts score (raw agreement 77%) and the “other” potential cause of thrombocytopenia component (raw agreement 61%). Agreement for the degree of thrombocytopenia and thrombosis components was excellent (92% and 93%, respectively). We conclude that inter-rater reliability of the 4Ts score in medical-surgical ICU patients is fair overall. Additional calibration work or modification of the scoring system is required if 4Ts is to be widely used to accurately predict HIT in critically ill patients. This poster is p Disclosures: Crowther: Sanofi-Aventis: Consultancy, Honoraria, Membership on an entity's Board of Directors or advisory committees, Research Funding; Leo Pharma: Consultancy, Honoraria, Research Funding; Pfizer: Consultancy, Honoraria, Research Funding; Bayer: Consultancy, Honoraria, Membership on an entity's Board of Directors or advisory committees; BI: Consultancy, Honoraria, Membership on an entity's Board of Directors or advisory committees; Artisan Pharma: Consultancy, Membership on an entity's Board of Directors or advisory committees.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.033
metaresearch head score (Gemma)0.069
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.033
Threshold uncertainty score0.172

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0330.069
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0020.001
Science and technology studies0.0000.001
Scholarly communication0.0010.001
Open science0.0010.001
Research integrity0.0010.001
Insufficient payload (model declined to judge)0.0010.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.025
GPT teacher head0.284
Teacher spread0.259 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations2
Published2009
Admission routes1
Has abstractyes

Explore more

Same venueBloodSame topicHeparin-Induced Thrombocytopenia and ThrombosisFrench-language works237,207