English
Related papers

Related papers: Compressing Weight-updates for Image Artifacts Rem…

200 papers

This paper is dedicated to an efficient compression of weights and optimizer states (called checkpoints) obtained at different stages during a neural network training process. First, we propose a prediction-based compression approach, where…

Machine Learning · Computer Science 2025-06-16 Yuriy Kim , Evgeny Belyaev

Learning-based image compression has improved to a level where it can outperform traditional image codecs such as HEVC and VVC in terms of coding performance. In addition to good compression performance, device interoperability is essential…

Image and Video Processing · Electrical Eng. & Systems 2022-12-05 Esin Koyuncu , Timofey Solovyev , Elena Alshina , André Kaup

In recent years, with the development of deep neural networks, end-to-end optimized image compression has made significant progress and exceeded the classic methods in terms of rate-distortion performance. However, most learning-based image…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Meng Li , Shangyin Gao , Yihui Feng , Yibo Shi , Jing Wang

Pruning neural networks has regained interest in recent years as a means to compress state-of-the-art deep neural networks and enable their deployment on resource-constrained devices. In this paper, we propose a robust compressive learning…

Machine Learning · Computer Science 2020-06-05 George Retsinas , Athena Elafrou , Georgios Goumas , Petros Maragos

The advancement of deep learning has led to the development of neural decoders for low latency communications. However, neural decoders can be very complex which can lead to increased computation and latency. We consider iterative pruning…

Machine Learning · Computer Science 2022-11-17 Vikrant Malik , Rohan Ghosh , Mehul Motani

To enhance image compression performance, recent deep neural network-based research can be divided into three categories: a learnable codec, a postprocessing network, and a compact representation network. The learnable codec has been…

Image and Video Processing · Electrical Eng. & Systems 2021-12-21 Hanbin Son , Taeoh Kim , Hyeongmin Lee , Sangyoun Lee

In this paper, we propose a novel layer-adaptive weight-pruning approach for Deep Neural Networks (DNNs) that addresses the challenge of optimizing the output distortion minimization while adhering to a target pruning ratio constraint. Our…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Kaixin Xu , Zhe Wang , Xue Geng , Jie Lin , Min Wu , Xiaoli Li , Weisi Lin

Deep convolution neural network has achieved great success in many artificial intelligence applications. However, its enormous model size and massive computation cost have become the main obstacle for deployment of such powerful algorithm…

Computer Vision and Pattern Recognition · Computer Science 2018-07-23 Zhezhi He , Boqing Gong , Deliang Fan

For lossy image compression, we develop a neural-based system which learns a nonlinear estimator for decoding from quantized representations. The system links two recurrent networks that \help" each other reconstruct same target image…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Ankur Mali , Alexander G. Ororbia , Clyde Lee Giles

Existing compression methods typically focus on the removal of signal-level redundancies, while the potential and versatility of decomposing visual data into compact conceptual components still lack further study. To this end, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Jianhui Chang , Zhenghui Zhao , Chuanmin Jia , Shiqi Wang , Lingbo Yang , Qi Mao , Jian Zhang , Siwei Ma

Image coding for machines (ICM) aims at reducing the bitrate required to represent an image while minimizing the drop in machine vision analysis accuracy. In many use cases, such as surveillance, it is also important that the visual quality…

Image and Video Processing · Electrical Eng. & Systems 2024-01-22 Nam Le , Honglei Zhang , Francesco Cricri , Ramin G. Youvalari , Hamed Rezazadegan Tavakoli , Emre Aksu , Miska M. Hannuksela , Esa Rahtu

We consider the compression artifacts reduction problem, where a compressed image is transformed into an artifact-free image. Recent approaches for this problem typically train a one-to-one mapping using a per-pixel $L_2$ loss between the…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Jun Guo , Hongyang Chao

Using single-pixel detection, the end-to-end neural network that jointly optimizes both encoding and decoding enables high-precision imaging and high-level semantic sensing. However, for varied sampling rates, the large-scale network…

Image and Video Processing · Electrical Eng. & Systems 2022-01-11 Xinrui Zhan , Liheng Bian , Chunli Zhu , Jun Zhang

We present ApproxConv, a novel method for compressing the layers of a convolutional neural network. Reframing conventional discrete convolution as continuous convolution of parametrised functions over space, we use functional approximations…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Theo W. Costain , Victor Adrian Prisacariu

We present a filter pruning approach for deep model compression, using a multitask network. Our approach is based on learning a a pruner network to prune a pre-trained target network. The pruner is essentially a multitask deep neural…

Computer Vision and Pattern Recognition · Computer Science 2020-01-17 Vinay Kumar Verma , Pravendra Singh , Vinay P. Namboodiri , Piyush Rai

This paper focuses on the task of quality enhancement for compressed videos. Although deep network-based video restorers achieve impressive progress, most of the existing methods lack a structured design to optimally leverage the priors…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Hanchi Sun , Xiaohong Liu , Xinyang Jiang , Yifei Shen , Dongsheng Li , Xiongkuo Min , Guangtao Zhai

Convolutional neural networks show outstanding results in a variety of computer vision tasks. However, a neural network architecture design usually faces a trade-off between model performance and computational/memory complexity. For some…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Pavel Kaloshin

With the advancement of deep models, research work on image captioning has led to a remarkable gain in raw performance over the last decade, along with increasing model complexity and computational cost. However, surprisingly works on…

Computer Vision and Pattern Recognition · Computer Science 2021-10-08 Jia Huei Tan , Chee Seng Chan , Joon Huang Chuah

In this work, we investigate the fundamental trade-off regarding accuracy and parameter efficiency in the parameterization of neural network weights using predictor networks. We present a surprising finding that, when recovering the…

Machine Learning · Computer Science 2024-07-02 Hongjun Choi , Jayaraman J. Thiagarajan , Ruben Glatt , Shusen Liu

Recent works have shown that learned models can achieve significant performance gains, especially in terms of perceptual quality measures, over traditional methods. Hence, the state of the art in image restoration and compression is getting…

Image and Video Processing · Electrical Eng. & Systems 2021-05-03 A. Murat Tekalp , Michele Covell , Radu Timofte , Chao Dong