Correction filter for single image super-resolution: Robustifying off-the-shelf deep super-resolvers

Shady Abu Hussein, Tom Tirer, Raja Giryes

פרסום מחקרי: פרסום בכתב עתמאמר מכנסביקורת עמיתים

תקציר

The single image super-resolution task is one of the most examined inverse problems in the past decade. In the recent years, Deep Neural Networks (DNNs) have shown superior performance over alternative methods when the acquisition process uses a fixed known downscaling kernel—typically a bicubic kernel. However, several recent works have shown that in practical scenarios, where the test data mismatch the training data (e.g. when the downscaling kernel is not the bicubic kernel or is not available at training), the leading DNN methods suffer from a huge performance drop. Inspired by the literature on generalized sampling, in this work we propose a method for improving the performance of DNNs that have been trained with a fixed kernel on observations acquired by other kernels. For a known kernel, we design a closed-form correction filter that modifies the low-resolution image to match one which is obtained by another kernel (e.g. bicubic), and thus improves the results of existing pre-trained DNNs. For an unknown kernel, we extend this idea and propose an algorithm for blind estimation of the required correction filter. We show that our approach outperforms other super-resolution methods, which are designed for general downscaling kernels.

שפה מקוריתאנגלית
מספר המאמר9156619
עמודים (מ-עד)1425-1434
מספר עמודים10
כתב עתProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
מזהי עצם דיגיטלי (DOIs)
סטטוס פרסוםפורסם - 2020
אירוע2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020 - Virtual, Online, ארצות הברית
משך הזמן: 14 יוני 202019 יוני 2020

ASJC Scopus subject areas

  • ???subjectarea.asjc.1700.1712???
  • ???subjectarea.asjc.1700.1707???

טביעת אצבע

להלן מוצגים תחומי המחקר של הפרסום 'Correction filter for single image super-resolution: Robustifying off-the-shelf deep super-resolvers'. יחד הם יוצרים טביעת אצבע ייחודית.

פורמט ציטוט ביבליוגרפי