MétaCan
Menu
← Retour à la cohorte
Enregistrement W2979488430 · doi:10.1182/blood.v120.21.2650.2650

Evaluation of Quality of Biomarker Data Capture by Peripheral Sites in an International, Cooperative Study: Analysis of 104 Cases From the T-Cell Project.

2012· article· en· W2979488430 sur OpenAlexaff
Stefano Pileri, Monica Bellei, Julie M. Vose, Joseph M. Connors, Francine M. Foss, Steven M. Horwitz, Silvia Montoto, Aaron Polliack, Pier Luigi Zinzani, Emanuele Zucca, Young Hyeh Ko, Massimo Federico

Notice bibliographique

RevueBlood · 2012
Typearticle
Langueen
DomaineMedicine
ThématiqueLymphoma Diagnosis and Treatment
Établissements canadiensBC Cancer Agency
Organismes subventionnairesnon disponible
Mots-clésMedicineBiomarkerPathologyData qualitySample (material)Data collectionMedical physicsData miningComputer scienceStatistics

Résumé

récupéré en direct d'OpenAlex

Abstract Abstract 2650 Background and Rationale: The T-Cell Project (TCP) aims at verifying if a prospective collection of data in patients with Peripheral T-cell lymphomas (PTCLs) provides more accurate information to better define their prognosis. So far 885 patients have been accrued and diagnosis confirmed in 84% of the 350 reviewed cases. A dedicated online pathology form collecting a detailed biomarkers profile is filled out by research staff at peripheral sites with data from the local pathologist report. However, it is very difficult for people who are not accustomed to routinely reading pathology reports to interpret the findings correctly. To guarantee the data capture of biomarkers reproduces the pathology reports a control of quality of information entered in the pathology forms of the TCP was carried out. A similar evaluation was performed by the COMPLETE Registry, presenting the results in a parallel abstract. Methods: Biomarker data quality assessment concerns the review by an expert pathologist of peripheral capture of a suggested quite wide panel of biomarkers (54) used to diagnose patients registered in the TCP. The first 104 patients enrolled having complete registration data, availability of the original pathology report at the Trial Office and its data entered at the website constitute the sample of this analysis. A single mismatch between the site-entered data and the reviewer's findings, recorded on a separate forms, counts as an error. Results: On the whole, 5740 entries were reviewed, with a mean number of 9 immunophenotypic markers (range 3–22) and a mean number of 0.3 (range 0–4) gene rearrangement tests. In 35 (34%) cases out of the 104 reviewed no conflicting entry between what the site entered and what the reviewer determined was found. Patient disagreement of different extent was determined for the remaining cases: 1–2 errors, 35 (34%); 3–5 errors, 20 (19%); 6–10 errors, 8 (8%); 11–19 errors, 6 (5%). Where the site noted a finding was positive the reviewer was in agreement 73% of the time, noted they were negative in 15%, indeterminate in 1% and not assessed in 11%. For cases where the site noted a finding was negative the reviewer agreed with 97% of cases, noted they were positive in 1%, indeterminate in 0% and not assessed in 2%. The reviewer was in agreement with the site in 96% of the cases when the marker was indicated peripherally as not assessed, and for the remaining tests found the marker was positive, negative or indeterminate in 1%, 2% and 0% of cases respectively. The markers most difficult to interpret (at least 5% of total errors) are listed in the Table, reporting also the types of errors noted. With respect to the T-cell markers, the misreporting is mainly due to the difficulty in recognizing and thus entering the findings on the pathology report. For the suggested B-cell markers, a high rate of errors concerns the coding of the findings of the pathology report noted in the non-neoplastic populations surrounding the neoplastic cells. Of relevance, the very frequent mistaken interpretation of the EBV in situ hybridization (ISH), recorded as the result of the EBV immunoistochemistry test. Gene rearrangement studies are often missing and if present almost totally misinterpreted by the site, and reported as an immunoistochemistry test. The review by the expert pathologist accomplished a 11% of errors due to an ambiguous noting of the findings on the pathology report. Conclusion: The results of the biomarker quality assessment for the TCP confirm the difficulty for a correct interpretation of the pathology report in a relatively high rate of cases. For international projects the need for a periodic review emerges to guide site training and improve the accuracy of biomarker data capture in order to ensure database quality. Disclosures: No relevant conflicts of interest to declare.

Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.

Comment cette classification a été obtenuedéplier

Prédiction machine sur la base complète

Imitation des enseignants

Ni prévalence calibrée, ni vérité terrain. Validation humaine à venir. Le volet Gemma est une étiquette directe du modèle pour chaque travail de la base, lue sur la notice réduite au titre. Le volet Codex est un classifieur appris des 10 348 étiquettes directes de Codex et calibré sur les taux pondérés de l'échantillon; les champs sans appui suffisant ne portent aucun appel Codex. Le mode candidate est l'union des deux volets; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont pas des étiquettes humaines.

score de la tête « metaresearch » (Codex)0,039
score de la tête « metaresearch » (Gemma)0,052
Version: metacan-v3-hybrid-931329e0061cStatut de validation: machine_predicted_unvalidated
Catégories candidatesaucune
Catégories consensuellesaucune
DomaineSignal candidat: aucune · Signal consensuel: aucune
Devis d'étudeSignal candidat: Observationnel · Signal consensuel: Observationnel
GenreSignal candidat: Empirique · Signal consensuel: Empirique
Score de désaccord entre enseignants0,039
Score d'incertitude au seuil0,209

Scores du classifieur distillé par catégorie (deux têtes)

CatégorieCodexGemma
Métarecherche0,0390,052
Méta-épidémiologie (sens strict)0,0000,001
Méta-épidémiologie (sens large)0,0010,001
Bibliométrie0,0060,006
Études des sciences et des technologies0,0010,001
Communication savante0,0010,001
Science ouverte0,0010,002
Intégrité de la recherche0,0010,000
Charge utile insuffisante (le modèle a refusé de juger)0,0010,000

Scores machine (provisoires)

Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.

Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.

Tête enseignante Opus0,194
Tête enseignante GPT0,431
Écart entre enseignants0,237 · la distance entre les deux têtes enseignantes sur ce seul travail
Statut de validationscore_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découle

Classification

machine, non validée

Prédiction automatique; un appel candidat d’une seule source (Gemma direct ou Codex distillé), pas un consensus.

Les modèles n’ont appliqué aucune catégorie : rien dans la taxonomie ne correspondait à ce travail.
Devis d'étudeObservationnel
Domainenon disponible
GenreEmpirique

Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».

En bref

Citations1
Publié2012
Routes d'admission1
Résumé présentoui

Explorer davantage

Même revueBlood→Même sujetLymphoma Diagnosis and Treatment→Travaux en français237 207→