MétaCan
Menu
← Back to cohort
Record W7073849661

Reporting guidelines for diagnostic accuracy studies that use Bayesian latent class models (STARD-BLCM)

2017· article· en· W7073849661 on OpenAlexaff

Bibliographic record

VenueTechnical University of Denmark, DTU Orbit (Technical University of Denmark, DTU) · 2017
Typearticle
Languageen
FieldMedicine
TopicPregnancy and preeclampsia studies
Canadian institutionsUniversity of Prince Edward IslandMcGill University
Fundersnot available
KeywordsLatent class modelBayesian probabilityDiagnostic accuracyClass (philosophy)Accuracy and precisionScale (ratio)
DOInot available

Abstract

fetched live from OpenAlex

Evaluation of medical tests is usually based on comparing their results to those from a perfect reference (gold standard) procedure. The Standards for Reporting of Diagnostic Accuracy (STARD) initiative (http://www.equator-network.org/reporting-guidelines/stard/) developed reporting guidelines for studies designed to estimate the accuracy of tests when disease status is known. The original STARD statement was initially published in seven journals, while an updated version — STARD2015 — has been recently released. More than 200 biomedical journals encourage its use in their instructions to authors. An affordable, reliable, and noninvasive reference standard does not always exist as is the case for infectious diseases with a long latent period (e.g., in chronic infections such as tuberculosis). In such situations test accuracy can be estimated using latent class models that do not require knowledge of disease status (i.e., disease status is a latent variable). Statistical methods were introduced in this context by Hui and Walter and have been succesfully applied since then, with the majority of the work being carried out in a Bayesian framework. While STARD provides useful reporting guidelines for diagnostic accuracy studies when a reference standard is available, it required modification and extension to address crucial aspects that are unique to latent class analysis:In the absence of a perfect reference test, the target condition must be explicitly described when performing a latent class analysis to estimate test accuracy. Latent class models, in conjunction with what the tests under evaluation actually detect (e.g., organisms or immune responses to organisms), define the latent status. Thus, a definition/interpretation of the latent disease or infection under consideration from a biological perspective is critical to communicate effectively the contextual meaning of the sensitivity and specificity estimates.A detailed description of the latent class model and its assumptions is required. A meta-analysis found that 28% of the studies that used latent class models to estimate diagnostic test accuracy failed to report any evidence that assumptions were verified or that the underlying models were of adequate fit to the data at hand. Bayesian latent class analysis requires reporting the details and justification of the prior distributions used in the primary and sensitivity analysis. This task takes on increased importance when using non-identifiable latent class models.We adapted the STARD checklist in order to fulfill the reporting requirements for diagnostic test accuracy studies that use Bayesian latent class models. The new guidelines, termed Standards for the Reporting of Diagnostic accuracy studies that use Bayesian Latent Class Models, have been recently published and are available online (https://www.equator-network.org/reporting-guidelines/stard-blcm/). Further, a mailing list has been created and those interested can freely subscribe (http://lists.uth.gr/mailman/listinfo/lcmate). Standards for the Reporting of Diagnostic accuracy studies that use Bayesian Latent Class Models is relevant to both Bayesian and frequentist estimation methods but the focus is on the former. It should prove to be a useful tool for the sound application of latent class models in the evaluation of diagnostic tests and promote optimal reporting practices for studies that use such models.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.370
metaresearch head score (Gemma)0.764
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: Reporting · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Methods · Consensus signal: Methods
Teacher disagreement score0.630
Threshold uncertainty score0.777

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.3700.764
Meta-epidemiology (narrow)0.0050.007
Meta-epidemiology (broad)0.0090.027
Bibliometrics0.0220.023
Science and technology studies0.0030.004
Scholarly communication0.0120.005
Open science0.0160.012
Research integrity0.0130.013
Insufficient payload (model declined to judge)0.0450.016

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.231
GPT teacher head0.354
Teacher spread0.124 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designNot applicable
DomainReporting
GenreMethods

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2017
Admission routes1
Has abstractno

Explore more

Same venueTechnical University of Denmark, DTU Orbit (Technical University of Denmark, DTU)→Same topicPregnancy and preeclampsia studies→French-language works237,207→