English
Related papers

Related papers: Real Image Denoising with Knowledge Distillation f…

200 papers

While deep neural networks have revolutionized image denoising capabilities, their deployment on edge devices remains challenging due to substantial computational and memory requirements. To this end, we present DnLUT, an ultra-efficient…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Sidi Yang , Binxiao Huang , Yulun Zhang , Dahai Yu , Yujiu Yang , Ngai Wong

High levels of noise usually exist in today's captured images due to the relatively small sensors equipped in the smartphone cameras, where the noise brings extra challenges to lossy image compression algorithms. Without the capacity to…

Image and Video Processing · Electrical Eng. & Systems 2022-07-25 Ka Leong Cheng , Yueqi Xie , Qifeng Chen

Convolutional neural networks have been widely deployed in various application scenarios. In order to extend the applications' boundaries to some accuracy-crucial domains, researchers have been investigating approaches to boost accuracy…

Machine Learning · Computer Science 2019-05-21 Linfeng Zhang , Jiebo Song , Anni Gao , Jingwei Chen , Chenglong Bao , Kaisheng Ma

Most dataset distillation methods struggle to accommodate large-scale datasets due to their substantial computational and memory requirements. Recent research has begun to explore scalable disentanglement methods. However, there are still…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Zhiheng Ma , Anjia Cao , Funing Yang , Yihong Gong , Xing Wei

Variations of deep neural networks such as convolutional neural network (CNN) have been successfully applied to image denoising. The goal is to automatically learn a mapping from a noisy image to a clean image given training data consisting…

Computer Vision and Pattern Recognition · Computer Science 2017-09-29 Tianyang Wang , Mingxuan Sun , Kaoning Hu

A novel energy-efficient edge computing paradigm is proposed for real-time deep learning-based image upsampling applications. State-of-the-art deep learning solutions for image upsampling are currently trained using either resize or…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Ian Colbert , Ken Kreutz-Delgado , Srinjoy Das

Knowledge distillation aims to compress a powerful yet cumbersome teacher model into a lightweight student model without much sacrifice of performance. For this purpose, various approaches have been proposed over the past few years,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Defang Chen , Jian-Ping Mei , Hailin Zhang , Can Wang , Yan Feng , Chun Chen

Knowledge distillation which learns a lightweight student model by distilling knowledge from a cumbersome teacher model is an attractive approach for learning compact deep neural networks (DNNs). Recent works further improve student network…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Cuong Pham , Tuan Hoang , Thanh-Toan Do

Image denoising is a fundamental and challenging task in the field of computer vision. Most supervised denoising methods learn to reconstruct clean images from noisy inputs, which have intrinsic spectral bias and tend to produce…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Yujin Wang , Lingen Li , Tianfan Xue , Jinwei Gu

As a promising 6G enabler beyond conventional bit-level transmission, semantic communication can considerably reduce required bandwidth resources, while its combination with multiple access requires further exploration. This paper proposes…

Information Theory · Computer Science 2026-01-27 Qifei Wang , Zhen Gao , Shuo Sun , Zhijin Qin , Xiaodong Xu , Meixia Tao

Compressing deep neural network (DNN) models becomes a very important and necessary technique for real-world applications, such as deploying those models on mobile devices. Knowledge distillation is one of the most popular methods for model…

Machine Learning · Computer Science 2020-03-02 Makoto Takamoto , Yusuke Morishita , Hitoshi Imaoka

In this paper we revisit the efficacy of knowledge distillation as a function matching and metric learning problem. In doing so we verify three important design decisions, namely the normalisation, soft maximum function, and projection…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Roy Miles , Krystian Mikolajczyk

Image denoising can remove natural noise that widely exists in images captured by multimedia devices due to low-quality imaging sensors, unstable image transmission processes, or low light conditions. Recent works also find that image…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Yupeng Cheng , Qing Guo , Felix Juefei-Xu , Wei Feng , Shang-Wei Lin , Weisi Lin , Yang Liu

Universal style transfer methods typically leverage rich representations from deep Convolutional Neural Network (CNN) models (e.g., VGG-19) pre-trained on large collections of images. Despite the effectiveness, its application is heavily…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Huan Wang , Yijun Li , Yuehai Wang , Haoji Hu , Ming-Hsuan Yang

Recent advances in camera designs and imaging pipelines allow us to capture high-quality images using smartphones. However, due to the small size and lens limitations of the smartphone cameras, we commonly find artifacts or degradation in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Marcos V. Conde , Florin Vasluianu , Javier Vazquez-Corral , Radu Timofte

Most of the classical denoising methods restore clear results by selecting and averaging pixels in the noisy input. Instead of relying on hand-crafted selecting and averaging strategies, we propose to explicitly learn this process with deep…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Xiangyu Xu , Muchen Li , Wenxiu Sun

Boosting the task accuracy of tiny neural networks (TNNs) has become a fundamental challenge for enabling the deployments of TNNs on edge devices which are constrained by strict limitations in terms of memory, computation, bandwidth, and…

Machine Learning · Computer Science 2023-11-01 Shunyao Zhang , Yonggan Fu , Shang Wu , Jyotikrishna Dass , Haoran You , Yingyan , Lin

Deep learning techniques have been applied in the context of image super-resolution (SR), achieving remarkable advances in terms of reconstruction performance. Existing techniques typically employ highly complex model structures which…

Image and Video Processing · Electrical Eng. & Systems 2024-11-22 Yuxuan Jiang , Jakub Nawala , Fan Zhang , David Bull

Deep convolutional neural networks (CNNs) for image denoising can effectively exploit rich hierarchical features and have achieved great success. However, many deep CNN-based denoising models equally utilize the hierarchical features of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Wencong Wu , An Ge , Guannan Lv , Yuelong Xia , Yungang Zhang , Wen Xiong

Denoising is a core operation in modern video pipelines. In codecs, in-loop filters suppress sensor noise and quantisation artefacts to improve rate-distortion performance; in cinema post-production, denoisers are used for restoration,…

Image and Video Processing · Electrical Eng. & Systems 2025-10-07 Changhong Li , Clément Bled , Rosa Fernandez , Shreejith Shanker