Difficulty-aware Image Super Resolution via Deep Adaptive Dual-Network
Abstract
Recently, deep learning based single image super-resolution(SR) approaches have achieved great development. The state-of-the-art SR methods usually adopt a feed-forward pipeline to establish a non-linear mapping between low-res(LR) and high-res(HR) images. However, due to treating all image regions equally without considering the difficulty diversity, these approaches meet an upper bound for optimization. To address this issue, we propose a novel SR approach that discriminately processes each image region within an image by its difficulty. Specifically, we propose a dual-way SR network that one way is trained to focus on easy image regions and another is trained to handle hard image regions. To identify whether a region is easy or hard, we propose a novel image difficulty recognition network based on PSNR prior. Our SR approach that uses the region mask to adaptively enforce the dual-way SR network yields superior results. Extensive experiments on several standard benchmarks (e.g., Set5, Set14, BSD100, and Urban100) show that our approach achieves state-of-the-art performance.
Cite
@article{arxiv.1904.05802,
title = {Difficulty-aware Image Super Resolution via Deep Adaptive Dual-Network},
author = {Jinghui Qin and Ziwei Xie and Yukai Shi and Wushao Wen},
journal= {arXiv preprint arXiv:1904.05802},
year = {2019}
}
Comments
ICME2019(Oral), code and results are available at: https://github.com/xzwlx/Difficulty-SR