Comparing vision-based to sonar-based 3D reconstruction

Netanel Frank, Lior Wolf, Danny Olshansky, Arjan Boonman, Yossi Yovel

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Our understanding of sonar based sensing is very limited in comparison to light based imaging. In this work, we synthesize a ShapeNet variant in which echolocation replaces the role of vision. A new hypernetwork method is presented for 3D reconstruction from a single echolocation view. The success of the method demonstrates the ability to reconstruct a 3D shape from bat-like sonar, and not just obtain the relative position of the bat with respect to obstacles. In addition, it is shown that integrating information from multiple orientations around the same view point helps performance. The sonar-based method we develop is analog to the state-of-the-art single image reconstruction method, which allows us to directly compare the two imaging modalities. Based on this analysis, we learn that while 3D can be reliably reconstructed form sonar, as far as the current technology shows, the accuracy is lower than the one obtained based on vision, that the performance in sonar and in vision are highly correlated, that both modalities favor shapes that are not round, and that while the current vision method is able to better reconstruct the 3D shape, its advantage with respect to estimating the normal's direction is much lower.

Original languageEnglish
Title of host publicationIEEE International Conference on Computational Photography, ICCP 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728152301
DOIs
StatePublished - Apr 2020
Event2020 IEEE International Conference on Computational Photography, ICCP 2020 - Saint Louis, United States
Duration: 24 Apr 202026 Apr 2020

Publication series

NameIEEE International Conference on Computational Photography, ICCP 2020

Conference

Conference2020 IEEE International Conference on Computational Photography, ICCP 2020
Country/TerritoryUnited States
CitySaint Louis
Period24/04/2026/04/20

Keywords

  • 3D reconstruction
  • Hypernetworks
  • Sonar imaging

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Signal Processing
  • Media Technology
  • Instrumentation

Fingerprint

Dive into the research topics of 'Comparing vision-based to sonar-based 3D reconstruction'. Together they form a unique fingerprint.

Cite this