HyperSR: A Hypernetwork Based Framework for Image Super-Resolution

Divya Mishra, Ofek Finkelstein, Ofer Hadar

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Image super-resolution models often require a large number of parameters to capture the complex mapping between low-resolution and high-resolution images. Hypernetworks allow for efficient parameterization by generating the weights of the target network dynamically based on the input low-resolution image. This enables the model to have a smaller set of fixed parameters while still being able to adapt and generate high-resolution images. Hypernetworks are meta-learning neural networks that generate the weights or parameters of another neural network, known as the target network, based on the input data. With only a 0.12% increase in computation parameters complexity for SRCNN as the target network, the proposed framework, Hyper-SR: a Hyper-network-based framework for single-image Super-Resolution, outperforms the target network in terms of perceptual image quality at higher scaling factors and faster convergence time at fewer epochs. We demonstrate results and ablation experiments using existing SRCNN as the target network and reported an average gain on SET5 dataset of +0.83 db for PSNR and +0.0208 for SSIM, on SET14 dataset, a gain of +0.62 db for PSNR and +0.0109 for SSIM at scaling factor of 4. However, our methodology may be used for any existing super-resolution network as the target network to obtain marginally improved resolution without necessitating a large number of computational parameters.

Original languageAmerican English
Title of host publication2024 International Joint Conference on Neural Networks, IJCNN 2024 - Proceedings
ISBN (Electronic)9798350359312
DOIs
StatePublished - 1 Jan 2024
Event2024 International Joint Conference on Neural Networks, IJCNN 2024 - Yokohama, Japan
Duration: 30 Jun 20245 Jul 2024

Publication series

NameProceedings of the International Joint Conference on Neural Networks

Conference

Conference2024 International Joint Conference on Neural Networks, IJCNN 2024
Country/TerritoryJapan
CityYokohama
Period30/06/245/07/24

Keywords

  • Computer vision
  • Deep learning
  • Hyper networks
  • Image super-resolution

All Science Journal Classification (ASJC) codes

  • Software
  • Artificial Intelligence

Cite this