Abstract 208: Development of Evidence Statement curation algorithms to aid cancer variant interpretation
Notice bibliographique
Résumé
Abstract The Clinical Interpretation of Variants in Cancer (CIViC) knowledgebase (civicdb.org) is an open access, centralized hub for structured, community curated and expertly moderated relationships between genomic variants and cancer. Evidence is curated from peer-reviewed, published literature and is classified into one of five Types: Predisposing, Diagnostic, Prognostic, Predictive (therapeutic), or Functional. The robustness of the Evidence is conveyed through the assignment of Levels with the first three derived from patient studies (Validated, Clinical, Case Study), Preclinical, generated from in vivo or in vitro data, and Inferential, which describes indirect associations. Each Evidence Item requires an Evidence Statement written in the curator's own words summarizing the source's results regarding the variant's clinical impact. Collaborations with groups like ClinGen have generated a significant influx of new curators, increasing the demand for detailed principles regarding data prioritization in the Evidence Statement in order to streamline the curation process. The curation community would benefit from simpler, visual guides through the complex decisions needed to appropriately and consistently curate Evidence Items. We are devoting significant effort to continue the development of straightforward Evidence curation algorithms (decision trees) similar to those used in clinical molecular testing labs to aid CIViC curators. Previously published guidelines on development of these statements are the basis of our Evidence algorithms. Obvious inflection points for curators are clearly identified with specific details noted for each to optimize decision efficiency. As the predominant Evidence Type comprising 57% of all CIViC submissions, 58% of referenced patient trials, and 92% of Preclinical submissions, Predictive Evidence is the initial focus of our pilot guidelines with Diagnostic and Prognostic to follow. Within the Predictive Evidence Type, clinical trials, case studies, and preclinical Levels each require vastly different Evidence Statement details and ultimately the creation of three separate, uniquely modeled algorithms. The implementation of these algorithms will assist in streamlining both curation and the expert review process. Notably, a template is not being created, as the preservation of curator style and voice is important to maintain the community feel of the database. To ensure the highest level of clarity, our team is utilizing specific novice and experienced curators to assist with the development process. As these algorithms pass the pilot phase, they are being tested as curator training tools. Ultimately, these guidelines will be used to encourage independence in curators and to enhance the Evidence already contained in CIViC. Citation Format: Jason Saliba, Lana Sheta, Kilannin Krysiak, Arpad Danos, Alex Marr, Erica Barnell, Shahil Pema, Wan-Hsin Lin, Panieh Terraf, Joshua F. McMichael, Cameron J. Grisdale, Shruti Rao, Susanna Kiwala, Adam Coffman, Alex Wagner, Obi L. Griffith, Malachi Griffith. Development of Evidence Statement curation algorithms to aid cancer variant interpretation [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2021; 2021 Apr 10-15 and May 17-21. Philadelphia (PA): AACR; Cancer Res 2021;81(13_Suppl):Abstract nr 208.
Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.
Comment cette classification a été obtenuedéplier
Prédiction machine sur la base complète
Imitation des enseignantsNi prévalence calibrée, ni vérité terrain. Validation humaine à venir. Le volet Gemma est une étiquette directe du modèle pour chaque travail de la base, lue sur la notice réduite au titre. Le volet Codex est un classifieur appris des 10 348 étiquettes directes de Codex et calibré sur les taux pondérés de l'échantillon; les champs sans appui suffisant ne portent aucun appel Codex. Le mode candidate est l'union des deux volets; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont pas des étiquettes humaines.
Scores du classifieur distillé par catégorie (deux têtes)
| Catégorie | Codex | Gemma |
|---|---|---|
| Métarecherche | 0,072 | 0,344 |
| Méta-épidémiologie (sens strict) | 0,002 | 0,002 |
| Méta-épidémiologie (sens large) | 0,002 | 0,005 |
| Bibliométrie | 0,016 | 0,008 |
| Études des sciences et des technologies | 0,002 | 0,002 |
| Communication savante | 0,012 | 0,006 |
| Science ouverte | 0,005 | 0,007 |
| Intégrité de la recherche | 0,004 | 0,005 |
| Charge utile insuffisante (le modèle a refusé de juger) | 0,032 | 0,015 |
Scores machine (provisoires)
Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.
Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.
score_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découleClassification
machine, non validéePrédiction automatique; un appel candidat d’une seule source (Gemma direct ou Codex distillé), pas un consensus.
Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».