English
Related papers

Related papers: Real Image Denoising with Knowledge Distillation f…

200 papers

The task of accelerating large neural networks on general purpose hardware has, in recent years, prompted the use of channel pruning to reduce network size. However, the efficacy of pruning based approaches has since been called into…

Machine Learning · Statistics 2019-03-08 Jack Turner , Elliot J. Crowley , Valentin Radu , José Cano , Amos Storkey , Michael O'Boyle

Dataset distillation aims to distill the knowledge of a large-scale real dataset into small yet informative synthetic data such that a model trained on it performs as well as a model trained on the full dataset. Despite recent progress,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Ahmad Sajedi , Samir Khaki , Lucy Z. Liu , Ehsan Amjadian , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

The detection of objects considering a 6DoF pose is a common requirement to build virtual and augmented reality applications. It is usually a complex task which requires real-time processing and high precision results for adequate user…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Heitor Felix , Walber M. Rodrigues , David Macêdo , Francisco Simões , Adriano L. I. Oliveira , Veronica Teichrieb , Cleber Zanchettin

In this paper, we introduce NBNet, a novel framework for image denoising. Unlike previous works, we propose to tackle this challenging problem from a new perspective: noise reduction by image-adaptive projection. Specifically, we propose to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Shen Cheng , Yuzhi Wang , Haibin Huang , Donghao Liu , Haoqiang Fan , Shuaicheng Liu

Although the advances of self-supervised blind denoising are significantly superior to conventional approaches without clean supervision in synthetic noise scenarios, it shows poor quality in real-world images due to spatially correlated…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Kanggeun Lee , Kyungryun Lee , Won-Ki Jeong

Convolutional Neural Network (CNN) has been widely used in unstructured datasets, one of which is image denoising. Image denoising is a noisy image reconstruction process that aims to reduce additional noise that occurs from the noisy image…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Bintang Pradana Erlangga Putra , Heri Prasetyo , Esti Suryani

Resource-constrained perception systems such as edge computing and vision-for-robotics require vision models to be both accurate and lightweight in computation and memory usage. While knowledge distillation is a proven strategy to enhance…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Shengcao Cao , Mengtian Li , James Hays , Deva Ramanan , Yi-Xiong Wang , Liang-Yan Gui

Image denoising is a fundamental problem in computational photography, where achieving high perception with low distortion is highly demanding. Current methods either struggle with perceptual quality or suffer from significant distortion.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Tong Li , Hansen Feng , Lizhi Wang , Zhiwei Xiong , Hua Huang

The deep layers of modern neural networks extract a rather rich set of features as an input propagates through the network. This paper sets out to harvest these rich intermediate representations for quantization with minimal accuracy loss…

Machine Learning · Computer Science 2020-03-04 Ahmed T. Elthakeb , Prannoy Pilligundla , Alex Cloninger , Hadi Esmaeilzadeh

Efficient and adaptable deep learning models are an important area of deep learning research, driven by the need for highly efficient models on edge devices. Few-shot learning enables the use of deep learning models in low-data regimes, a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Shuhei Tsuyuki , Reda Bensaid , Jérémy Morlier , Mathieu Léonardon , Naoya Onizawa , Vincent Gripon , Takahiro Hanyu

Images captured from the real world are often affected by different types of noise, which can significantly impact the performance of Computer Vision systems and the quality of visual data. This study presents a novel approach for defect…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Mohsen Hami , Mahdi JameBozorg

Fast and accurate 3D hand reconstruction is essential for real-time applications in VR/AR, human-computer interaction, robotics, and healthcare. Most state-of-the-art methods rely on heavy models, limiting their use on resource-constrained…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Hunain Ahmed Jillani , Ahmed Tawfik Aboukhadra , Ahmed Elhayek , Jameel Malik , Nadia Robertini , Didier Stricker

This paper tackles the problem of semi-supervised video object segmentation on resource-constrained devices, such as mobile phones. We formulate this problem as a distillation task, whereby we demonstrate that small space-time-memory…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Roy Miles , Mehmet Kerim Yucel , Bruno Manganelli , Albert Saa-Garriga

Recent research on deep convolutional neural networks (CNNs) has provided a significant performance boost on efficient super-resolution (SR) tasks by trading off the performance and applicability. However, most existing methods focus on…

Image and Video Processing · Electrical Eng. & Systems 2023-12-25 Yan Wang , Tongtong Su , Yusen Li , Jiuwen Cao , Gang Wang , Xiaoguang Liu

Current state-of-the-art object detectors are at the expense of high computational costs and are hard to deploy to low-end devices. Knowledge distillation, which aims at training a smaller student network by transferring knowledge from a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Ruoyu Sun , Fuhui Tang , Xiaopeng Zhang , Hongkai Xiong , Qi Tian

Deep convolutional neural networks perform better on images containing spatially invariant degradations, also known as synthetic degradations; however, their performance is limited on real-degraded photographs and requires multiple-stage…

Computer Vision and Pattern Recognition · Computer Science 2020-10-02 Saeed Anwar , Nick Barnes , Lars Petersson

Deep learning-based models are at the forefront of most driver observation benchmarks due to their remarkable accuracies but are also associated with high computational costs. This is challenging, as resources are often limited in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Calvin Tanama , Kunyu Peng , Zdravko Marinov , Rainer Stiefelhagen , Alina Roitberg

The number of traffic accidents has been continuously increasing in recent years worldwide. Many accidents are caused by distracted drivers, who take their attention away from driving. Motivated by the success of Convolutional Neural…

Computer Vision and Pattern Recognition · Computer Science 2023-02-10 Dichao Liu , Toshihiko Yamasaki , Yu Wang , Kenji Mase , Jien Kato

Image denoising is an important low-level computer vision task, which aims to reconstruct a noise-free and high-quality image from a noisy image. With the development of deep learning, convolutional neural network (CNN) has been gradually…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Chao Yao , Shuo Jin , Meiqin Liu , Xiaojuan Ban

All techniques for denoising involve a notion of a true (noise-free) image, and a hypothesis space. The hypothesis space may reconstruct the image directly as a grayscale valued function, or indirectly by its Fourier or wavelet spectrum.…

Image and Video Processing · Electrical Eng. & Systems 2025-05-29 Sajal Chakroborty , Suddhasattwa Das