MétaCan
Menu
Back to cohort
Record W3171238906 · doi:10.1016/j.jdin.2021.04.002

Comparison of community pathologists with expert dermatopathologists evaluating Breslow thickness and histopathologic subtype in a large international population-based study of melanoma

2021· article· en· W3171238906 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.
aboutThe title or abstract carries a Canadian signal from the geographic lexicon.

Bibliographic record

VenueJAAD International · 2021
Typearticle
Languageen
FieldMedicine
TopicCutaneous Melanoma Detection and Management
Canadian institutionsBC Cancer AgencyCancer Care Ontario
FundersNational Cancer InstituteNational Health and Medical Research CouncilNational Institutes of HealthMemorial Sloan-Kettering Cancer Center
KeywordsMedicineMelanomaBreslow ThicknessPopulationSkin cancerCancerDermatologyOncologyInternal medicinePathologyBreast cancerCancer research

Abstract

fetched live from OpenAlex

To the Editor: As of 2019 National Cancer Institute data show that melanoma is the fifth most common cancer in the United States.1National Cancer InstituteCancer Stat Facts: melanoma of the skin. SEER.https://seer.cancer.gov/statfacts/html/melan.htmlDate accessed: April 28, 2021Google Scholar There has been a recent push to include the histopathologic subtype of nodular melanoma as an independent prognostic classifier due to the identification of associated aggressive histopathologic characteristics and shorter recurrence-free times.2Lattanzi M. Lee Y. Simpson D. et al.Primary melanoma histologic subtype: impact on survival and response to therapy.J Natl Cancer Inst. 2019; 111: 180-188Crossref PubMed Scopus (34) Google Scholar,3Dessinioti C. Dimou N. Geller A.C. et al.Distinct clinicopathological and prognostic features of thin nodular primary melanomas: an international study from 17 centers.J Natl Cancer Inst. 2019; 111: 1314-1322Crossref PubMed Scopus (17) Google Scholar We used the population-based, Genes, Environment, and Melanoma (GEM) study,4Begg C.B. Hummer A.J. Mujumdar U. et al.A design for cancer case-control studies using only incident cases: experience with the GEM study of melanoma.Int J Epidemiol. 2006; 35: 756-764Crossref PubMed Scopus (60) Google Scholar to assess the levels of agreement between community pathologists, those who originally diagnosed the melanoma, and expert study dermatopathologists, who reviewed the lesion for complete histology, histopathologic subtype, and Breslow thickness. The salient components of the GEM study were that it was population-based, multi-country size, and included disease-specific mortality data and re-review of hematoxylin-eosin–stained tissues by dermatopathologists. We evaluated how histopathologic subtype misclassification might impact the reported disease-specific mortality. Our study included 1957 individuals with a first primary melanoma diagnosed in the year 2000, at centers of the GEM study in Australia, Canada, Italy, and the United States. The Institutional Review Board approval was obtained, and the subjects signed written consent. Each patient had their hematoxylin-eosin–stained slides read initially by a community pathologist, who reported Breslow thickness and histopathologic subtype followed by an independent review by a dermatopathologist, blinded to the community pathologist report. The vital status was obtained at an average of 7.4 years. Within the study population and lethal melanoma cases, descriptive statistics were calculated and the frequency tables that compared the kappa value for the readings of community pathologists and dermatopathologists were created for Breslow thickness and histopathologic subtype. All the tests were two-sided and P < .05 was considered significant. The data were analyzed using SAS 9.4 software and the interobserver variability was calculated with Fleiss' method.5Fleiss J.L. Levin B. Paik M.C. Statistical Methods for Rates and Proportions.3rd ed. John Wiley & Sons, Inc., 2003Crossref Google Scholar The mean age of the subjects at diagnosis was 55 years and 48.5% of them were women. The kappa for Breslow thickness was 0.72 (95% CI, 0.69-0.75), demonstrating a “substantial agreement.” The kappa within lethal cases was 0.56 (95% CI, 0.45-0.66), suggesting a “moderate agreement.” The overall kappa for the histopathologic subtype of 0.27 demonstrates only a “fair agreement” (Table I), whereas that for the reviewing dermatopathologists was 0.68, indicating a “substantial agreement.” The kappa for nodular subtype had only 51.3% agreement. Within the lethal cases, the kappa value was “fair,” 0.30 (Table II).Table IConcordance of histopathologic subtype between community pathologists and dermatopathologistsDermatopathologistsCommunity pathologistsSSMNMLMMALMSCNOSOtherTotalSSM919†Numbers in bold represent the number of subjects for which community pathologists and dermatopathologists agreed.337033523NM5596†Numbers in bold represent the number of subjects for which community pathologists and dermatopathologists agreed.712183LMM55472†Numbers in bold represent the number of subjects for which community pathologists and dermatopathologists agreed.1044ALM3113†Numbers in bold represent the number of subjects for which community pathologists and dermatopathologists agreed.100SC82001†Numbers in bold represent the number of subjects for which community pathologists and dermatopathologists agreed.23NOS35450462249†Numbers in bold represent the number of subjects for which community pathologists and dermatopathologists agreed.15Other1100100†Numbers in bold represent the number of subjects for which community pathologists and dermatopathologists agreed.Total (percent agreement)1395 (65.8)187 (51.3)196 (36.7)10 (0.30)10 (0.10)125 (39.2)28 (0.0)1951∗6 missing values.†Numbers in bold represent the number of subjects for which community pathologists and dermatopathologists agreed.Overall Correlation = 0.27 (95% CI, 0.24-0.30).ALM, Acral lentiginous melanoma; LMM, lentigo maligna melanoma; NM, nodular melanoma; NOS, not otherwise specified; SC, spindle cell; SSM, superficial spreading melanoma.∗ 6 missing values.† Numbers in bold represent the number of subjects for which community pathologists and dermatopathologists agreed. Open table in a new tab Table IIDeaths per histopathologic subtypeDermatopathologistsCommunity pathologistsSSMNMLMMALMSCNOSOtherTotalSSM34∗Numbers in bold represent the number of cases where community pathologists and dermatopathologists agreed.702130NM1222∗Numbers in bold represent the number of cases where community pathologists and dermatopathologists agreed.21051LMM422∗Numbers in bold represent the number of cases where community pathologists and dermatopathologists agreed.0001ALM1000∗Numbers in bold represent the number of cases where community pathologists and dermatopathologists agreed.000SC01000∗Numbers in bold represent the number of cases where community pathologists and dermatopathologists agreed.02NOS982109∗Numbers in bold represent the number of cases where community pathologists and dermatopathologists agreed.1Other0100100∗Numbers in bold represent the number of cases where community pathologists and dermatopathologists agreed.Total (percent agreement)60 (56.7)41 (53.7)6 (33.3)4 (0.0)2 (0.0)17 (52.9)5 (0.0)135∗Numbers in bold represent the number of cases where community pathologists and dermatopathologists agreed.Overall Correlation = 0.30, (95% CI, 0.19-0.40).ALM, Acral lentiginous melanoma; LMM, lentigo maligna melanoma; NM, nodular melanoma; NOS, not otherwise specified; SC, spindle cell; SSM, superficial spreading melanoma.∗ Numbers in bold represent the number of cases where community pathologists and dermatopathologists agreed. Open table in a new tab Overall Correlation = 0.27 (95% CI, 0.24-0.30). ALM, Acral lentiginous melanoma; LMM, lentigo maligna melanoma; NM, nodular melanoma; NOS, not otherwise specified; SC, spindle cell; SSM, superficial spreading melanoma. Overall Correlation = 0.30, (95% CI, 0.19-0.40). ALM, Acral lentiginous melanoma; LMM, lentigo maligna melanoma; NM, nodular melanoma; NOS, not otherwise specified; SC, spindle cell; SSM, superficial spreading melanoma. Our study illustrated a moderate-to-substantial agreement on Breslow thickness between the community pathologists and dermatopathologists. The decrease in Breslow-related kappa in fatal cases may represent less precision in measuring thicker tumors as lethal tumors tended to be deeper. We also observed higher rates of disagreement among pathologists for the histopathologic subtype. Considering that the subtype can indicate tumor characteristics, any misclassification might influence patients' counseling, treatment options, and their disease perception. The limitations of our study were that only the Breslow thickness and histopathologic subtype were measured due to the limited initial reporting by community pathologists and that the slide reviewed by the community pathologist may differ from the same slide reviewed by the dermatopathologist. Based on these results, we propose the judicious interpretation of nodular melanoma as a prognostic factor. The data on subtype without expert dermatopathology review should be used with caution until the interrater concordance improves. The patient prognosis should continue to be based on more reproducible characteristics such as Breslow thickness, ulceration, mitotic index, and metastasis. None disclosed. GEM Study Group: Coordinating Center, Memorial Sloan Kettering Cancer Center, New York, New York, Marianne Berwick (PI, currently at the University of New Mexico, Albuquerque, NM), Colin Begg, PhD (co-PI), Irene Orlow, PhD, MS (coinvestigator), Klaus J. Busam, MD (Dermatopathologist), Isidora Autuori, MS (Laboratory Member), Pampa Roy, PhD (Senior Laboratory Technician), Anne Reiner, MS (Biostatistician), University of New Mexico, Albuquerque, NM, Marianne Berwick, MPH, PhD (PI), Li Luo, PhD (Biostatistician), Tawny W. Boyce, MPH (Data Manager). Study Centers: The University of Sydney and The Cancer Council New South Wales, Sydney, Australia: Anne E. Cust, PhD (PI), Bruce K. Armstrong MD, PhD (former PI), Anne Kricker PhD, (former co-PI); Menzies Institute for Medical Research University of Tasmania, Hobart, Australia: Alison Venn (current PI), Terence Dwyer (PI, currently at University of Oxford, United Kingdom), Paul Tucker (Dermatopathologist); BC Cancer Vancouver, Canada: Richard P. Gallagher, M.A. (PI), Cancer Care Ontario, Toronto, Canada: Loraine D. Marrett, PhD (PI), Lynn From, MD (Dermatopathologist); CPO, Center for Cancer Prevention, Torino, Italy: Roberto Zanetti, MD (PI), Stefano Rosso, MD, MSc (co-PI); Lidia Sacchetto, PhD, (Biostatistician); University of California, Irvine, California: Hoda Anton-Culver, PhD (PI); University of Michigan, Ann Arbor, Michigan: Stephen B. Gruber, MD, MPH, PhD (PI, currently at City of Hope National Medical Center, California), Joseph D. Bonner, PhD (coinvestigator, joint at City of Hope-University of Michigan); University of North Carolina, Chapel Hill, North Carolina: Nancy E. Thomas, MD, PhD (PI), Kathleen Conway, PhD (coinvestigator), David W. Ollila, MD (coinvestigator), Pamela A. Groben, MD (Dermatopathologist), Sharon N. Edmiston, BA (Research Analyst), Honglin Hao (Laboratory Specialist), Eloise Parrish, MSPH (Laboratory Specialist), Jill S. Frank, MS (Research Assistant), David C. Gibbs, BS (Research Assistant, currently MD/PhD candidate at Emory University, Atlanta, Georgia); University of Pennsylvania, Philadelphia, Pennsylvania: Timothy R. Rebbeck, PD (former PI), Peter A. Kanetsky, MPH, PhD (PI, currently at Department of Cancer Epidemiology, H. Lee Moffitt Cancer Center and Research Institute.); UV data consultants: Julia Lee Taylor, PhD, and Sasha Madronich, PhD, National Centre for Atmospheric Research, Boulder, Colorado.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.001
metaresearch head score (Gemma)0.001
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.007
Threshold uncertainty score0.475

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0010.001
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.062
GPT teacher head0.384
Teacher spread0.322 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it