English

Bicubic++: Slim, Slimmer, Slimmest -- Designing an Industry-Grade Super-Resolution Network

Computer Vision and Pattern Recognition 2023-05-04 v1 Machine Learning Image and Video Processing

Abstract

We propose a real-time and lightweight single-image super-resolution (SR) network named Bicubic++. Despite using spatial dimensions of the input image across the whole network, Bicubic++ first learns quick reversible downgraded and lower resolution features of the image in order to decrease the number of computations. We also construct a training pipeline, where we apply an end-to-end global structured pruning of convolutional layers without using metrics like magnitude and gradient norms, and focus on optimizing the pruned network's PSNR on the validation set. Furthermore, we have experimentally shown that the bias terms take considerable amount of the runtime while increasing PSNR marginally, hence we have also applied bias removal to the convolutional layers. Our method adds ~1dB on Bicubic upscaling PSNR for all tested SR datasets and runs with ~1.17ms on RTX3090 and ~2.9ms on RTX3070, for 720p inputs and 4K outputs, both in FP16 precision. Bicubic++ won NTIRE 2023 RTSR Track 2 x3 SR competition and is the fastest among all competitive methods. Being almost as fast as the standard Bicubic upsampling method, we believe that Bicubic++ can set a new industry standard.

Keywords

Cite

@article{arxiv.2305.02126,
  title  = {Bicubic++: Slim, Slimmer, Slimmest -- Designing an Industry-Grade Super-Resolution Network},
  author = {Bahri Batuhan Bilecen and Mustafa Ayazoglu},
  journal= {arXiv preprint arXiv:2305.02126},
  year   = {2023}
}

Comments

Winner of the New Trends in Image Restoration and Enhancement (NTIRE) @ CVPR 2023, Real Time Super Resolution (RTSR) Challange Track 2 (x3 super-resolution). Code available at: https://github.com/aselsan-research-imaging-team/bicubic-plusplus