Neural tensor contractions and the expressive power of deep neural quantum states

Or Sharir, Amnon Shashua, Giuseppe Carleo

Research output: Contribution to journalArticlepeer-review

Abstract

We establish a direct connection between general tensor networks and deep feed-forward artificial neural networks. The core of our results is the construction of neural-network layers that efficiently perform tensor contractions and that use commonly adopted nonlinear activation functions. The resulting deep networks feature a number of edges that closely match the contraction complexity of the tensor networks to be approximated. In the context of many-body quantum states, this result establishes that neural-network states have strictly the same or higher expressive power than practically usable variational tensor networks. As an example, we show that all matrix product states can be efficiently written as neural-network states with a number of edges polynomial in the bond dimension and depth that is logarithmic in the system size. The opposite instead does not hold true, and our results imply that there exist quantum states that are not efficiently expressible in terms of matrix product states or projected entangled pair states but that are instead efficiently expressible with neural network states.

Original languageAmerican English
Article number205136
JournalPhysical Review B
Volume106
Issue number20
DOIs
StatePublished - 15 Nov 2022

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics

Fingerprint

Dive into the research topics of 'Neural tensor contractions and the expressive power of deep neural quantum states'. Together they form a unique fingerprint.

Cite this