Lung structures enhancement in chest radiographs via CT based FCNN training

Ophir Gozes, Hayit Greenspan

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The abundance of overlapping anatomical structures appearing in chest radiographs can reduce the performance of lung pathology detection by automated algorithms (CAD) as well as the human reader. In this paper, we present a deep learning based image processing technique for enhancing the contrast of soft lung structures in chest radiographs using Fully Convolutional Neural Networks (FCNN). Two 2D FCNN architectures were trained to accomplish the task: The first performs 2D lung segmentation which is used for normalization of the lung area. The second FCNN is trained to extract lung structures. To create the training images, we employed Simulated X-Ray or Digitally Reconstructed Radiographs (DRR) derived from 516 scans belonging to the LIDC-IDRI dataset. By first segmenting the lungs in the CT domain, we are able to create a dataset of 2D lung masks to be used for training the segmentation FCNN. For training the extraction FCNN, we create DRR images of only voxels belonging to the 3D lung segmentation which we call “Lung X-ray” and use them as target images. Once the lung structures are extracted, the original image can be enhanced by fusing the original input x-ray and the synthesized “Lung X-ray”. We show that our enhancement technique is applicable to real x-ray data, and display our results on the recently released NIH Chest X-Ray-14 dataset. We see promising results when training a DenseNet-121 based architecture to work directly on the lung enhanced X-ray images.

Original languageEnglish
Title of host publicationImage Analysis for Moving Organ, Breast, and Thoracic Images - Third International Workshop, RAMBO 2018, Fourth International Workshop, BIA 2018, and First International Workshop, TIA 2018, Held in Conjunction with MICCAI 2018, Proceedings
EditorsDavid Snead, Emanuele Trucco, Danail Stoyanov, Zeike Taylor, Lena Maier-Hein, Nasir Rajpoot, Hrvoje Bogunovic, Francesco Ciompi, Mitko Veta, Mona K. Garvin, Xin Jan Chen, Anne Martel, Jeroen van der Laak, Yanwu Xu, Stephen McKenna
Pages147-158
Number of pages12
DOIs
StatePublished - 2018
Event3rd International Workshop on Reconstruction and Analysis of Moving Body Organs, RAMBO 2018, 4th International Workshop on Breast Image Analysis, BIA 2018, and 1st International Workshop on Thoracic Image Analysis, TIA 2018, held in conjunction with 21s... - Granada, Spain
Duration: 16 Sep 201820 Sep 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11040 LNCS

Conference

Conference3rd International Workshop on Reconstruction and Analysis of Moving Body Organs, RAMBO 2018, 4th International Workshop on Breast Image Analysis, BIA 2018, and 1st International Workshop on Thoracic Image Analysis, TIA 2018, held in conjunction with 21s...
Country/TerritorySpain
CityGranada
Period16/09/1820/09/18

Keywords

  • CAD
  • CT
  • Deep learning
  • Image synthesis
  • Lung nodules
  • X-ray

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Lung structures enhancement in chest radiographs via CT based FCNN training'. Together they form a unique fingerprint.

Cite this