Correction filter for single image super-resolution: Robustifying off-the-shelf deep super-resolvers

Shady Abu Hussein, Tom Tirer, Raja Giryes

نتاج البحث: نشر في مجلةمقالة من مؤنمرمراجعة النظراء

ملخص

The single image super-resolution task is one of the most examined inverse problems in the past decade. In the recent years, Deep Neural Networks (DNNs) have shown superior performance over alternative methods when the acquisition process uses a fixed known downscaling kernel—typically a bicubic kernel. However, several recent works have shown that in practical scenarios, where the test data mismatch the training data (e.g. when the downscaling kernel is not the bicubic kernel or is not available at training), the leading DNN methods suffer from a huge performance drop. Inspired by the literature on generalized sampling, in this work we propose a method for improving the performance of DNNs that have been trained with a fixed kernel on observations acquired by other kernels. For a known kernel, we design a closed-form correction filter that modifies the low-resolution image to match one which is obtained by another kernel (e.g. bicubic), and thus improves the results of existing pre-trained DNNs. For an unknown kernel, we extend this idea and propose an algorithm for blind estimation of the required correction filter. We show that our approach outperforms other super-resolution methods, which are designed for general downscaling kernels.

اللغة الأصليةالإنجليزيّة
رقم المقال9156619
الصفحات (من إلى)1425-1434
عدد الصفحات10
دوريةProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
المعرِّفات الرقمية للأشياء
حالة النشرنُشِر - 2020
الحدث2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020 - Virtual, Online, الولايات المتّحدة
المدة: ١٤ يونيو ٢٠٢٠١٩ يونيو ٢٠٢٠

All Science Journal Classification (ASJC) codes

  • !!Software
  • !!Computer Vision and Pattern Recognition

بصمة

أدرس بدقة موضوعات البحث “Correction filter for single image super-resolution: Robustifying off-the-shelf deep super-resolvers'. فهما يشكلان معًا بصمة فريدة.

قم بذكر هذا