MétaCan
Menu
Back to cohort
Record W2945731458 · doi:10.1016/j.autrev.2019.102394

Fast track algorithm: How to differentiate a “scleroderma pattern” from a “non-scleroderma pattern”

2019· review· en· W2945731458 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

fundA Canadian funder is recorded on the work.
no affNo Canadian affiliation: this work is invisible to an affiliation-only frame.
No Canadian affiliation. An affiliation-only frame, the usual design, would never have seen this work. It is one of the works that make the case for inverting the frame.

Bibliographic record

VenueAutoimmunity Reviews · 2019
Typereview
Languageen
FieldMedicine
TopicSystemic Sclerosis and Related Diseases
Canadian institutionsnot available
FundersActelion PharmaceuticalsMedacMitsubishi Tanabe Pharma CorporationVlaamse regeringPécsi TudományegyetemChiba UniversityUniversidad de ChileOulun YliopistoRocheHacettepe ÜniversitesiAzienda Ospedaliero Universitaria Maggiore della CaritàUniversitetet i OsloLeids Universitair Medisch CentrumChung Hua UniversityUrmia UniversityUniversità degli Studi di GenovaSapienza Università di RomaUniversitair Medisch Centrum UtrechtUniversità degli Studi di Milano-BicoccaGazi ÜniversitesiCSL BehringFonds Wetenschappelijk OnderzoekUniversidad Nacional de ColombiaCairo UniversityCentre Hospitalier Universitaire de BordeauxUniversity of GalwayRadboud Universitair Medisch CentrumMount Saint Vincent UniversityUniversité de GenèveUCBUniwersytet Medyczny im. Karola Marcinkowskiego w PoznaniuUniversity of UtahSanofiINAF-Osservatorio Astronomico di PadovaItalfarmacoUniversity of the Witwatersrand, JohannesburgUniversity College LondonNorway GrantsUniversity of AlbertaTokyo ElectronUniversity of LeedsMcGill UniversityGentofte HospitalAarhus UniversitetshospitalGlaxoSmithKlineŚląski Uniwersytet MedycznyUniversitair Ziekenhuis GentAcceleronCentre Hospitalier Universitaire VaudoisChina Medical University HospitalCapital Normal UniversityAmerican Research Center in EgyptPfizerNovartisBoehringer IngelheimAlexandria UniversityAmgenEli Lilly and CompanyBayer
KeywordsMedicineScleroderma (fungus)RheumatismKappaDermatologyReliability (semiconductor)Internal medicinePathologyMathematics

Abstract

fetched live from OpenAlex

OBJECTIVES: This study was designed to propose a simple "Fast Track algorithm" for capillaroscopists of any level of experience to differentiate "scleroderma patterns" from "non-scleroderma patterns" on capillaroscopy and to assess its inter-rater reliability. METHODS: Based on existing definitions to categorise capillaroscopic images as "scleroderma patterns" and taking into account the real life variability of capillaroscopic images described standardly according to the European League Against Rheumatism (EULAR) Study Group on Microcirculation in Rheumatic Diseases, a fast track decision tree, the "Fast Track algorithm" was created by the principal expert (VS) to facilitate swift categorisation of an image as "non-scleroderma pattern (category 1)" or "scleroderma pattern (category 2)". Mean inter-rater reliability between all raters (experts/attendees) of the 8th EULAR course on capillaroscopy in Rheumatic Diseases (Genoa, 2018) and, as external validation, of the 8th European Scleroderma Trials and Research group (EUSTAR) course on systemic sclerosis (SSc) (Nijmegen, 2019) versus the principal expert, as well as reliability between the rater pairs themselves was assessed by mean Cohen's and Light's kappa coefficients. RESULTS: Mean Cohen's kappa was 1/0.96 (95% CI 0.95-0.98) for the 6 experts/135 attendees of the 8th EULAR capillaroscopy course and 1/0.94 (95% CI 0.92-0.96) for the 3 experts/85 attendees of the 8th EUSTAR SSc course. Light's kappa was 1/0.92 at the 8th EULAR capillaroscopy course, and 1/0.87 at the 8th EUSTAR SSc course. CONCLUSION: For the first time, a clinical expert based fast track decision algorithm has been developed to differentiate a "non-scleroderma" from a "scleroderma pattern" on capillaroscopic images, demonstrating excellent reliability when applied by capillaroscopists with varying levels of expertise versus the principal expert and corroborated with external validation.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.001
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMeta-epidemiology (narrow), Insufficient payload (model declined to judge)
Consensus categoriesMeta-epidemiology (narrow), Insufficient payload (model declined to judge)
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Other design · Consensus signal: none
GenreCandidate signal: Review · Consensus signal: Review
Teacher disagreement score0.953
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0010.000
Meta-epidemiology (narrow)0.0020.001
Meta-epidemiology (broad)0.0100.004
Bibliometrics0.0010.001
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0020.001
Research integrity0.0010.002
Insufficient payload (model declined to judge)0.0010.008

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.108
GPT teacher head0.334
Teacher spread0.226 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it