TY - GEN
T1 - Simultaneous Detection and Classification of Partially and Weakly Supervised Cells
AU - Golts, Alona
AU - Livneh, Ido
AU - Zohar, Yaniv
AU - Ciechanover, Aaron
AU - Elad, Michael
N1 - Publisher Copyright: © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.
PY - 2023
Y1 - 2023
N2 - Detection and classification of cells in immunohistochemistry (IHC) images play a vital role in modern computational pathology pipelines. Biopsy scoring and grading at the slide level is routinely performed by pathologists, but analysis at the cell level, often desired in personalized cancer treatment, is both impractical and non-comprehensive. With its remarkable success in natural images, deep learning is already the gold standard in computational pathology. Currently, some learning-based methods of biopsy analysis are performed at the tile level, thereby disregarding intra-tile cell variability; while others do focus on accurate cell segmentation, but do not address possible downstream tasks. Due to the shared low and high-level features in the tasks of cell detection and classification, these can be treated jointly using a single deep neural network, minimizing cumulative errors and improving the efficiency of both training and inference. We construct a novel dataset of Proteasome-stained Multiple Myeloma (MM) bone marrow slides, containing nine categories with unique morphological traits. With the relative difficulty of acquiring high-quality annotations in the medical-imaging domain, the proposed dataset is intentionally annotated with only 5 % of the cells in each tile. To tackle both cell detection and classification within a single network, we model these as a multi-class segmentation task, and train the network with a combination of partial cross-entropy and energy-driven losses. However, as full segmentation masks are unavailable during both training and validation, we perform evaluation on the combined detection and classification performance. Our strategy, uniting both tasks within the same network, achieves a better combined Fscore, at faster training and inference times, as compared to similar disjoint approaches.
AB - Detection and classification of cells in immunohistochemistry (IHC) images play a vital role in modern computational pathology pipelines. Biopsy scoring and grading at the slide level is routinely performed by pathologists, but analysis at the cell level, often desired in personalized cancer treatment, is both impractical and non-comprehensive. With its remarkable success in natural images, deep learning is already the gold standard in computational pathology. Currently, some learning-based methods of biopsy analysis are performed at the tile level, thereby disregarding intra-tile cell variability; while others do focus on accurate cell segmentation, but do not address possible downstream tasks. Due to the shared low and high-level features in the tasks of cell detection and classification, these can be treated jointly using a single deep neural network, minimizing cumulative errors and improving the efficiency of both training and inference. We construct a novel dataset of Proteasome-stained Multiple Myeloma (MM) bone marrow slides, containing nine categories with unique morphological traits. With the relative difficulty of acquiring high-quality annotations in the medical-imaging domain, the proposed dataset is intentionally annotated with only 5 % of the cells in each tile. To tackle both cell detection and classification within a single network, we model these as a multi-class segmentation task, and train the network with a combination of partial cross-entropy and energy-driven losses. However, as full segmentation masks are unavailable during both training and validation, we perform evaluation on the combined detection and classification performance. Our strategy, uniting both tasks within the same network, achieves a better combined Fscore, at faster training and inference times, as compared to similar disjoint approaches.
KW - Cell classification
KW - Cell detection
KW - Cell profiling
UR - http://www.scopus.com/inward/record.url?scp=85151124844&partnerID=8YFLogxK
U2 - https://doi.org/10.1007/978-3-031-25066-8_16
DO - https://doi.org/10.1007/978-3-031-25066-8_16
M3 - منشور من مؤتمر
SN - 9783031250651
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 313
EP - 329
BT - Computer Vision – ECCV 2022 Workshops, Proceedings
A2 - Karlinsky, Leonid
A2 - Michaeli, Tomer
A2 - Nishino, Ko
PB - Springer Science and Business Media Deutschland GmbH
T2 - 17th European Conference on Computer Vision, ECCV 2022
Y2 - 23 October 2022 through 27 October 2022
ER -