Unified Single-Image and Video Super-Resolution via Denoising Algorithms

Alon Brifman, Yaniv Romano, Michael Elad

Research output: Contribution to journalArticlepeer-review


Single image super-resolution (SISR) aims to recover a high-resolution image from a given low-resolution version of it. Video super-resolution (VSR) targets a series of given images, aiming to fuse them to create a higher resolution outcome. Although SISR and VSR seem to have a lot in common, most SISR algorithms do not have a simple and direct extension to VSR. VSR is considered a more challenging inverse problem, mainly due to its reliance on a sub-pixel accurate motion-estimation, which has no parallel in SISR. Another complication is the dynamics of the video, often addressed by simply generating a single frame instead of a complete output sequence. In this paper, we suggest a simple and robust super-resolution framework that can be applied to single images and easily extended to video. Our work relies on the observation that denoising of images and videos is well-managed and very effectively treated by a variety of methods. We exploit the plug-and-play-prior framework and the regularization-by-denoising (RED) approach that extends it, and show how to use such denoisers in order to handle the SISR and the VSR problems using a unified formulation and framework. This way, we benefit from the effectiveness and efficiency of existing image/video denoising algorithms, while solving much more challenging problems. More specifically, harnessing the VBM3D video denoiser, we obtain a strongly competitive motion-estimation free VSR algorithm, showing tendency to a high-quality output and fast processing.

Original languageEnglish
Article number8746778
Pages (from-to)6063-6076
Number of pages14
JournalIEEE Transactions on Image Processing
Issue number12
StatePublished - Dec 2019


  • ADMM
  • Plug-and-Play-Prior
  • RED
  • Single image super-resolution
  • denoising
  • video super-resolution

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Graphics and Computer-Aided Design


Dive into the research topics of 'Unified Single-Image and Video Super-Resolution via Denoising Algorithms'. Together they form a unique fingerprint.

Cite this