Weakly Supervised Brain Tumor Segmentation via Semantic Affinity Deep Neural Network

Moshe Yerachmiel, Hayit Greenspan

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Image segmentation tasks are considered resource intensive. These tasks require domain specialists to labor manually over long periods of time. When considering medical image segmentation tasks, the personnel and the error margin make these tasks expensive. Therefore there is a need for an automated tool. Deep learning has fast become the state of the art for such tasks, yet the methods applied require large data-sets of fully annotated examples. The need for supervision prevents researchers from developing deep learning and machine learning solutions on new datasets, which were not annotated by professional personnel. In this paper we utilize weak supervision to train a deep neural network to perform instance segmentation. The data used for this project is the Multimodal Brain Tumor Segmentation Challenge 3D MRI scans. The method used is a two-step DNN. The first step is binary classification of slices to either pathological or healthy. This is the only step which uses supervision for the training of the DNNs. In the second step, another DNN in the form of a Unet encoder-decoder network is utilized. This network encodes the input raw data and decodes each pixel to a 32 dimensional vector representing a semantic identity (semantic map). The supervision for training this second network is derived from the GradCAM of the classification DNN. Lastly, to segment the input data we determine the semantic distance between suspected lesion points and the entirety of the map. We achieve an average Dice score of 0.73 over three test sets of 38 patients each.

Original languageEnglish
Title of host publicationMedical Imaging 2022
Subtitle of host publicationImage Processing
EditorsOlivier Colliot, Ivana Isgum, Bennett A. Landman, Murray H. Loew
PublisherSPIE
ISBN (Electronic)9781510649392
DOIs
StatePublished - 2022
EventMedical Imaging 2022: Image Processing - Virtual, Online
Duration: 21 Mar 202127 Mar 2021

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
Volume12032

Conference

ConferenceMedical Imaging 2022: Image Processing
CityVirtual, Online
Period21/03/2127/03/21

Keywords

  • AI
  • Brain Tumor
  • Medical Imaging
  • Segmentation
  • Weak Supervision

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Atomic and Molecular Physics, and Optics
  • Biomaterials
  • Radiology Nuclear Medicine and imaging

Fingerprint

Dive into the research topics of 'Weakly Supervised Brain Tumor Segmentation via Semantic Affinity Deep Neural Network'. Together they form a unique fingerprint.

Cite this