Robust light fields denoising with S2N2N

Tal Kozakov, Omer Hazan, Adir Hazan, Adrian Stern

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

We have recently introduced the Single Shot Noise2Noise (S2N2N) framework for denoising Light Fields (LF) captured by Integral Imaging (InI), which is robust against different types and intensities of noise at any arbitrary exposure. S2N2N implicitly learns the noise type and intensity from the captured LF. In this paper, we further investigate S2N2N and introduce several improvements, including integration with a Visual Image Transformer (ViT). We test the method using both synthetic and real-world datasets, demonstrating significant improvements in denoising performance, particularly in high-noise environments. Our results reveal that this unsupervised denoising method has significant potential for real-world 3D imaging applications, offering robust performance without the need for explicit noise models.

Original languageAmerican English
Title of host publicationThree-Dimensional Imaging, Visualization, and Display 2025
EditorsBahram Javidi, Xin Shen, Arun Anand
PublisherSPIE
ISBN (Electronic)9781510687196
DOIs
StatePublished - 1 Jan 2025
EventThree-Dimensional Imaging, Visualization, and Display 2025 - Orlando, United States
Duration: 14 Apr 202516 Apr 2025

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume13465

Conference

ConferenceThree-Dimensional Imaging, Visualization, and Display 2025
Country/TerritoryUnited States
CityOrlando
Period14/04/2516/04/25

Keywords

  • Deep Neural Networks
  • Denoise
  • Integral Imaging
  • Noise2Noise
  • SN2N
  • Three-Dimensional (3-D) Imaging
  • Visual Image Transformers

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Robust light fields denoising with S2N2N'. Together they form a unique fingerprint.

Cite this