Graph Unrolling Networks: Interpretable Neural Networks for Graph Signal Denoising

Siheng Chen, Yonina C. Eldar, Lingxiao Zhao

Research output: Contribution to journalArticlepeer-review

Abstract

We propose an interpretable graph neural network framework to denoise single or multiple noisy graph signals. The proposed graph unrolling networks expand algorithm unrolling to the graph domain and provide an interpretation of the architecture design from a signal processing perspective. We unroll an iterative denoising algorithm by mapping each iteration into a single network layer where the feed-forward process is equivalent to iteratively denoising graph signals. We train the graph unrolling networks through unsupervised learning, where the input noisy graph signals are used to supervise the networks. By leveraging the learning ability of neural networks, we adaptively capture appropriate priors from input noisy graph signals. A core component of graph unrolling networks is the edge-weight-sharing graph convolution operation, which parameterizes each edge weight by a trainable kernel function whose trainable parameters are shared by all the edges. The proposed convolution is permutation-equivariant and can flexibly adjust the edge weights to various graph signals. We further consider two special cases of this class of networks, graph unrolling sparse coding (GUSC) and graph unrolling trend filtering (GUTF), by unrolling sparse coding and trend filtering, respectively. To validate the proposed methods, we conduct extensive experiments on both real-world datasets and simulated datasets, and demonstrate that our methods have smaller denoising errors than conventional denoising algorithms and state-of-the-art graph neural networks. For denoising a single smooth graph signal, the normalized mean square error of the proposed networks is around 40% and 60% lower than that of graph Laplacian denoising and graph wavelets, respectively.

Original languageEnglish
Article number9453145
Pages (from-to)3699-3713
Number of pages15
JournalIEEE Transactions on Signal Processing
Volume69
DOIs
StatePublished - 11 Jun 2021

Keywords

  • Graph neural networks
  • algorithm unrolling
  • graph convolution
  • graph signal denoising
  • weight sharing

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Graph Unrolling Networks: Interpretable Neural Networks for Graph Signal Denoising'. Together they form a unique fingerprint.

Cite this