English
Related papers

Related papers: Frequency-Aware Re-Parameterization for Over-Fitti…

200 papers

Deploying trained convolutional neural networks (CNNs) to mobile devices is a challenging task because of the simultaneous requirements of the deployed model to be fast, lightweight and accurate. Designing and training a CNN architecture…

Machine Learning · Computer Science 2019-12-02 Ramit Pahwa , Manoj Ghuhan Arivazhagan , Ankur Garg , Siddarth Krishnamoorthy , Rohit Saxena , Sunav Choudhary

Recently, many deep image compression methods have been proposed and achieved remarkable performance. However, these methods are dedicated to optimizing the compression performance and speed at medium and high bitrates, while research on…

Image and Video Processing · Electrical Eng. & Systems 2024-02-27 Zhiyuan Li , Chenyang Ge , Shun Li

Depthwise separable convolutions and frequency-domain convolutions are two recent ideas for building efficient convolutional neural networks. They are seemingly incompatible: the vast majority of operations in depthwise separable CNNs are…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Mark Buckler , Neil Adit , Yuwei Hu , Zhiru Zhang , Adrian Sampson

Most state of the art deep neural networks are overparameterized and exhibit a high computational cost. A straightforward approach to this problem is to replace convolutional kernels with its low-rank tensor approximations, whereas the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Anh-Huy Phan , Konstantin Sobolev , Konstantin Sozykin , Dmitry Ermilov , Julia Gusak , Petr Tichavsky , Valeriy Glukhov , Ivan Oseledets , Andrzej Cichocki

Using single-pixel detection, the end-to-end neural network that jointly optimizes both encoding and decoding enables high-precision imaging and high-level semantic sensing. However, for varied sampling rates, the large-scale network…

Image and Video Processing · Electrical Eng. & Systems 2022-01-11 Xinrui Zhan , Liheng Bian , Chunli Zhu , Jun Zhang

The search for image compression optimization techniques is a topic of constant interest both in and out of academic circles. One method that shows promise toward future improvements in this field is image colorization since image…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Ian Tassin , Kristen Goebel , Brittany Lasher

We customize an end-to-end image compression framework for retina OCT images based on deep convolutional neural networks (CNNs). The customized compression scheme consists of three parts: data Preprocessing, compression CNNs, and…

Image and Video Processing · Electrical Eng. & Systems 2019-08-28 Pengfei Guo , Dawei Li , Xingde Li

Compression is a standard procedure for making convolutional neural networks (CNNs) adhere to some specific computing resource constraints. However, searching for a compressed architecture typically involves a series of time-consuming…

Image and Video Processing · Electrical Eng. & Systems 2021-07-08 Suraj Mishra , Danny Z. Chen , X. Sharon Hu

The mainstream approach for filter pruning is usually either to force a hard-coded importance estimation upon a computation-heavy pretrained model to select "important" filters, or to impose a hyperparameter-sensitive sparse constraint on…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Mingbao Lin , Bohong Chen , Fei Chao , Rongrong Ji

Hyperdimensional Computing (HDC) is emerging as a promising approach for edge AI, offering a balance between accuracy and efficiency. However, current HDC-based applications often rely on high-precision models and/or encoding matrices to…

Machine Learning · Computer Science 2025-05-09 Nilesh Prasad Pandey , Shriniwas Kulkarni , David Wang , Onat Gungor , Flavio Ponzina , Tajana Rosing

Recently it has been shown that deep learning-based image compression has shown the potential to outperform traditional codecs. However, most existing methods train multiple networks for multiple bit rates, which increases the…

Image and Video Processing · Electrical Eng. & Systems 2019-12-13 Mohammad Akbari , Jie Liang , Jingning Han , Chengjie Tu

The successful training of deep neural networks requires addressing challenges such as overfitting, numerical instabilities leading to divergence, and increasing variance in the residual stream. A common solution is to apply regularization…

Machine Learning · Computer Science 2025-11-20 Jörg K. H. Franke , Urs Spiegelhalter , Marianna Nezhurina , Jenia Jitsev , Frank Hutter , Michael Hefenbrock

Convolutional neural networks (CNNs) have achieved astonishing advances over the past decade, defining state-of-the-art in several computer vision tasks. CNNs are capable of learning robust representations of the data directly from the RGB…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Samuel Felipe dos Santos , Nicu Sebe , Jurandy Almeida

Convolutional neural networks (CNNs) have achieved astonishing advances over the past decade, defining state-of-the-art in several computer vision tasks. CNNs are capable of learning robust representations of the data directly from the RGB…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Samuel Felipe dos Santos , Nicu Sebe , Jurandy Almeida

Learned image compression methods have shown superior rate-distortion performance and remarkable potential compared to traditional compression methods. Most existing learned approaches use stacked convolution or window-based self-attention…

Image and Video Processing · Electrical Eng. & Systems 2024-01-03 Huairui Wang , Nianxiang Fu , Zhenzhong Chen , Shan Liu

The modern convolutional neural networks although achieve great results in solving complex computer vision tasks still cannot be effectively used in mobile and embedded devices due to the strict requirements for computational complexity,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Nikolay Kozyrskiy , Anh-Huy Phan

Detection of double JPEG compression is important to forensics analysis. A few methods were proposed based on convolutional neural networks (CNNs). These methods only accept inputs from pre-processed data, such as histogram features and/or…

Computer Vision and Pattern Recognition · Computer Science 2017-10-17 Bin Li , Hu Luo , Haoxin Zhang , Shunquan Tan , Zhongzhou Ji

When approaching a novel visual recognition problem in a specialized image domain, a common strategy is to start with a pre-trained deep neural network and fine-tune it to the specialized domain. If the target domain covers a smaller visual…

Computer Vision and Pattern Recognition · Computer Science 2017-07-31 Frederick Tung , Srikanth Muralidharan , Greg Mori

Convolutional Neural Network (CNN)-based filters have achieved significant performance in video artifacts reduction. However, the high complexity of existing methods makes it difficult to be applied in real usage. In this paper, a CNN-based…

Image and Video Processing · Electrical Eng. & Systems 2020-09-08 Chao Liu , Heming Sun , Jiro Katto , Xiaoyang Zeng , Yibo Fan

Deep neural networks (DNNs) have achieved significant success in a variety of real world applications, i.e., image classification. However, tons of parameters in the networks restrict the efficiency of neural networks due to the large model…

Machine Learning · Computer Science 2019-08-21 Yuzhe Ma , Ran Chen , Wei Li , Fanhua Shang , Wenjian Yu , Minsik Cho , Bei Yu