Multi-chart generative surface modeling

Heli Ben-Hamu, Haggai Maron, Itay Kezurer, Gal Avineri, Yaron Lipman

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This paper introduces a 3D shape generative model based on deep neural networks. A new image-like (i.e., tensor) data representation for genus-zero 3D shapes is devised. It is based on the observation that complicated shapes can be well represented by multiple parameterizations (charts), each focusing on a different part of the shape. The new tensor data representation is used as input to Generative Adversarial Networks for the task of 3D shape generation. The 3D shape tensor representation is based on a multi-chart structure that enjoys a shape covering property and scale-translation rigidity. Scale-translation rigidity facilitates high quality 3D shape learning and guarantees unique reconstruction. The multi-chart structure uses as input a dataset of 3D shapes (with arbitrary connectivity) and a sparse correspondence between them. The output of our algorithm is a generative model that learns the shape distribution and is able to generate novel shapes, interpolate shapes, and explore the generated shape space. The effectiveness of the method is demonstrated for the task of anatomic shape generation including human body and bone (teeth) shape generation.

Original languageEnglish
Title of host publicationSIGGRAPH Asia 2018 Technical Papers, SIGGRAPH Asia 2018
ISBN (Electronic)9781450360081
DOIs
StatePublished - 4 Dec 2018
Externally publishedYes
EventSIGGRAPH Asia 2018 Technical Papers - International Conference on Computer Graphics and Interactive Techniques, SIGGRAPH Asia 2018 - Tokyo, Japan
Duration: 4 Dec 20187 Dec 2018

Publication series

NameSIGGRAPH Asia 2018 Technical Papers, SIGGRAPH Asia 2018

Conference

ConferenceSIGGRAPH Asia 2018 Technical Papers - International Conference on Computer Graphics and Interactive Techniques, SIGGRAPH Asia 2018
Country/TerritoryJapan
CityTokyo
Period4/12/187/12/18

Keywords

  • Deep Learning
  • Generative Adveserial Networks
  • Shape Generation

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Human-Computer Interaction

Fingerprint

Dive into the research topics of 'Multi-chart generative surface modeling'. Together they form a unique fingerprint.

Cite this