English
Related papers

Related papers: Real Image Denoising with Knowledge Distillation f…

200 papers

Current approaches for restoration of degraded images face a trade-off: high-performance models are slow for practical use, while fast models produce poor results. Knowledge distillation transfers teacher knowledge to students, but existing…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Shourya Verma , Mengbo Wang , Nadia Atallah Lanman , Ananth Grama

A rapidly increasing portion of Internet traffic is dominated by requests from mobile devices with limited- and metered-bandwidth constraints. To satisfy these requests, it has become standard practice for websites to transmit small and…

Computer Vision and Pattern Recognition · Computer Science 2018-12-10 Shumeet Baluja , Dave Marwood , Nick Johnston , Michele Covell

Quantization-Aware Training (QAT), combined with Knowledge Distillation (KD), holds immense promise for compressing models for edge deployment. However, joint optimization for precision-sensitive image restoration (IR) to recover visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 S. M. A. Sharif , Abdur Rehman , Seongwan Kim , Jaeho Lee

Knowledge distillation is a popular technique for transferring the knowledge from a large teacher model to a smaller student model by mimicking. However, distillation by directly aligning the feature maps between teacher and student may…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Ziwei Liu , Yongtao Wang , Xiaojie Chu

Deep neural networks have been widely used in image denoising during the past few years. Even though they achieve great success on this problem, they are computationally inefficient which makes them inappropriate to be implemented in mobile…

Image and Video Processing · Electrical Eng. & Systems 2021-08-05 Lu Xu , Jiawei Zhang , Xuanye Cheng , Feng Zhang , Xing Wei , Jimmy Ren

Recent advances have been made in applying convolutional neural networks to achieve more precise prediction results for medical image segmentation problems. However, the success of existing methods has highly relied on huge computational…

Image and Video Processing · Electrical Eng. & Systems 2021-08-24 Dian Qin , Jiajun Bu , Zhe Liu , Xin Shen , Sheng Zhou , Jingjun Gu , Zhijua Wang , Lei Wu , Huifen Dai

Image restoration aims to restore high-quality images from degraded counterparts and has seen significant advancements through deep learning techniques. The technique has been widely applied to mobile devices for tasks such as mobile…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Xiangyu Chen , Ruiwen Zhen , Shuai Li , Xiaotian Li , Guanghui Wang

In the past few years, transformers have achieved promising performances on various computer vision tasks. Unfortunately, the immense inference overhead of most existing vision transformers withholds their from being deployed on edge…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Zhiwei Hao , Jianyuan Guo , Ding Jia , Kai Han , Yehui Tang , Chao Zhang , Han Hu , Yunhe Wang

Image denoising is always a challenging task in the field of computer vision and image processing. In this paper, we have proposed an encoder-decoder model with direct attention, which is capable of denoising and reconstruct highly…

Machine Learning · Statistics 2018-01-17 Kazi Nazmul Haque , Mohammad Abu Yousuf , Rajib Rana

Text-to-image diffusion models can create stunning images from natural language descriptions that rival the work of professional artists and photographers. However, these models are large, with complex network architectures and tens of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Yanyu Li , Huan Wang , Qing Jin , Ju Hu , Pavlo Chemerys , Yun Fu , Yanzhi Wang , Sergey Tulyakov , Jian Ren

Cloud detection is a pivotal satellite image pre-processing step that can be performed both on the ground and on board a satellite to tag useful images. In the latter case, it can reduce the amount of data to downlink by pruning the cloudy…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Bartosz Grabowski , Maciej Ziaja , Michal Kawulok , Piotr Bosowski , Nicolas Longépé , Bertrand Le Saux , Jakub Nalepa

Inspired by the traditional partial differential equation (PDE) approach for image denoising, we propose a novel neural network architecture, referred as NODE-ImgNet, that combines neural ordinary differential equations (NODEs) with…

Image and Video Processing · Electrical Eng. & Systems 2023-11-07 Xinheng Xie , Yue Wu , Hao Ni , Cuiyu He

Convolutional neural networks (CNNs) have allowed remarkable advances in single image super-resolution (SISR) over the last decade. Most SR methods based on CNNs have focused on achieving performance gains in terms of quality metrics, such…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Wonkyung Lee , Junghyup Lee , Dohyung Kim , Bumsub Ham

Recent denoising algorithms based on the "blind-spot" strategy show impressive blind image denoising performances, without utilizing any external dataset. While the methods excel in recovering highly contaminated images, we observe that…

Image and Video Processing · Electrical Eng. & Systems 2022-04-07 Chaewon Kim , Jaeho Lee , Jinwoo Shin

Following the recent success of deep neural networks (DNN) on video computer vision tasks, performing DNN inferences on videos that originate from mobile devices has gained practical significance. As such, previous approaches developed…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-08 Jae-Won Chung , Jae-Yun Kim , Soo-Mook Moon

Image denoising, one of the essential inverse problems, targets to remove noise/artifacts from input images. In general, digital image denoising algorithms, executed on computers, present latency due to several iterations implemented in,…

Many engineers wish to deploy modern neural networks in memory-limited settings; but the development of flexible methods for reducing memory use is in its infancy, and there is little knowledge of the resulting cost-benefit. We propose…

Machine Learning · Statistics 2019-01-18 Elliot J. Crowley , Gavin Gray , Amos Storkey

Image denoising is an essential tool in computational photography. Standard denoising techniques, which use deep neural networks at their core, require pairs of clean and noisy images for its training. If we do not possess the clean…

Image and Video Processing · Electrical Eng. & Systems 2020-08-26 David Honzátko , Siavash A. Bigdeli , Engin Türetken , L. Andrea Dunbar

In instance-level detection tasks (e.g., object detection), reducing input resolution is an easy option to improve runtime efficiency. However, this option traditionally hurts the detection performance much. This paper focuses on boosting…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Lu Qi , Jason Kuen , Jiuxiang Gu , Zhe Lin , Yi Wang , Yukang Chen , Yanwei Li , Jiaya Jia

Medical image denoising is considered among the most challenging vision tasks. Despite the real-world implications, existing denoising methods have notable drawbacks as they often generate visual artifacts when applied to heterogeneous…

Image and Video Processing · Electrical Eng. & Systems 2025-03-11 S M A Sharif , Rizwan Ali Naqvi , Woong-Kee Loh