Domain Generalization Across Multi-centre Digital Pathology Images for Lymph Node Segmentation and Classification
Bibliographic record
Abstract
Within the last few years, medical deep learning has experienced rapid advances, especially in the area of image interpretation. Using whole-slide images of histological lymph node sections, this thesis develops deep learning models and techniques for detecting and classifying breast cancer metastases. Pathologists would normally have to perform extensive microscopic assessments on this clinically relevant task. In patients with breast cancer, metastases in lymph nodes have therapeutic implications. So, an automated solution may remarkably reduce pathologists’ workload while at the same time reducing the subjectivity of their diagnoses. There are, however, still several significant challenges associated with the development and translation of medical deep learning systems. To begin with, developing large and well-annotated datasets is expensive and most often, the labels are imbalanced. In addition, it is difficult to transfer the performance of deep learning algorithms from one dataset and setting to another due to domain shift issues. Lastly, the results of deep learning systems should be comprehensible and applicable to clinical datasets. In order to enhance effectiveness in an unknown target domain and increase generalization, this thesis assesses ensemble learning by transferring prior knowledge from non-medical and medical sources. Although deep learning methods may be successful, they may not perform well in a clinical workflow. Many datasets are constructed from millions of patches of images, leading to a data curation bias; others only contain annotations at the slide-level, making it difficult to detect errors at the local level as long as the results are correct. As a way of alleviating the class imbalance and biased training data, this thesis proposes a cluster-based sampling method for whole-slide histopathology image analysis. With the proposed ensemble learning and sampling methods, cutting-edge machine learning architectures can be extended, and state-of-the-art performance can be achieved for both diagnostic test images and whole slide images. Results in the sampling part show that using the same dataset, the results are roughly the same, regardless of sampling methods. However, the result of the unseen dataset falls dramatically when it is sampled randomly. By sampling separately, we reduce the probability of drops in the results for unseen datasets. Random selection gives a sensitivity of 0.82 on an unseen dataset, however sampling separately gives a sensitivity of 0.93. In random selection, dice index similarity is 0.83, whereas in sampling separately, dice index similarity is 0.90. Also, observing the slide level results in St. Michael’s hospital dataset, it can be concluded that we cannot decide about the best model and all the models give good results at least in one slide. So, combining the results from multiple configurations would give a more reliable and consistent result.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.002 | 0.005 |
| Meta-epidemiology (narrow) | 0.001 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.002 |
| Bibliometrics | 0.002 | 0.001 |
| Science and technology studies | 0.001 | 0.001 |
| Scholarly communication | 0.001 | 0.001 |
| Open science | 0.001 | 0.001 |
| Research integrity | 0.001 | 0.001 |
| Insufficient payload (model declined to judge) | 0.002 | 0.002 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".