English
Related papers

Related papers: A Compression Objective and a Cycle Loss for Neura…

200 papers

We propose a general framework for neural network compression that is motivated by the Minimum Description Length (MDL) principle. For that we first derive an expression for the entropy of a neural network, which measures its complexity…

Machine Learning · Computer Science 2018-12-20 Simon Wiedemann , Arturo Marban , Klaus-Robert Müller , Wojciech Samek

Image coding for machines (ICM) aims to compress images to support downstream AI analysis instead of human perception. For ICM, developing a unified codec to reduce information redundancy while empowering the compressed features to support…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Ruoyu Feng , Jinming Liu , Xin Jin , Xiaohan Pan , Heming Sun , Zhibo Chen

It is shown that neural networks (NNs) achieve excellent performances in image compression and reconstruction. However, there are still many shortcomings in the practical application, which eventually lead to the loss of neural network…

Multimedia · Computer Science 2019-11-15 Zhiqing Lu , Zhaoxia Yin , Bin Luo

The popular softmax loss and its recent extensions have achieved great success in the deep learning-based image classification. However, the data for training image classifiers usually has different quality. Ignoring such problem, the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Weihua Liu , Xiabi Liu , Murong Wang , Ling Ma

Deep learning, e.g., convolutional neural networks (CNNs), has achieved great success in image processing and computer vision especially in high level vision applications such as recognition and understanding. However, it is rarely used to…

Computer Vision and Pattern Recognition · Computer Science 2017-08-03 Feng Jiang , Wen Tao , Shaohui Liu , Jie Ren , Xun Guo , Debin Zhao

We propose an end-to-end learned image compression codec wherein the analysis transform is jointly trained with an object classification task. This study affirms that the compressed latent representation can predict human perceptual…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Chen-Hsiu Huang , Ja-Ling Wu

Autoencoders are commonly trained using element-wise loss. However, element-wise loss disregards high-level structures in the image which can lead to embeddings that disregard them as well. A recent improvement to autoencoders that helps…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Gustav Grund Pihlgren , Fredrik Sandin , Marcus Liwicki

We propose an image restoration algorithm that can control the perceptual quality and/or the mean square error (MSE) of any pre-trained model, trading one over the other at test time. Our algorithm is few-shot: Given about a dozen images…

Artificial Intelligence · Computer Science 2024-08-13 Theo Adrai , Guy Ohayon , Tomer Michaeli , Michael Elad

Neural-network-based compressors have proven to be remarkably effective at compressing sources, such as images, that are nominally high-dimensional but presumed to be concentrated on a low-dimensional manifold. We consider a continuous-time…

Information Theory · Computer Science 2020-11-11 Aaron B. Wagner , Johannes Ballé

This paper introduces a novel generative encoder (GE) model for generative imaging and image processing with applications in compressed sensing and imaging, image compression, denoising, inpainting, deblurring, and super-resolution. The GE…

Image and Video Processing · Electrical Eng. & Systems 2019-06-03 Lin Chen , Haizhao Yang

Currently, video transmission serves not only the Human Visual System (HVS) for viewing but also machine perception for analysis. However, existing codecs are primarily optimized for pixel-domain and HVS-perception metrics rather than the…

Image and Video Processing · Electrical Eng. & Systems 2025-03-28 Yuxiao Sun , Yao Zhao , Meiqin Liu , Chao Yao , Weisi Lin

For lossy image compression systems, we develop an algorithm, iterative refinement, to improve the decoder's reconstruction compared to standard decoding techniques. Specifically, we propose a recurrent neural network approach for…

Computer Vision and Pattern Recognition · Computer Science 2018-11-13 Alexander G. Ororbia , Ankur Mali , Jian Wu , Scott O'Connell , David Miller , C. Lee Giles

While recent neural codecs achieve strong performance at low bitrates when optimized for perceptual quality, their effectiveness deteriorates significantly under ultra-low bitrate conditions. To mitigate this, generative compression methods…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Chuqin Zhou , Xiaoyue Ling , Yunuo Chen , Jincheng Dai , Guo Lu , Wenjun Zhang

Denoising autoencoders (DAEs) are powerful deep learning models used for feature extraction, data generation and network pre-training. DAEs consist of an encoder and decoder which may be trained simultaneously to minimise a loss (function)…

Computer Vision and Pattern Recognition · Computer Science 2017-10-10 Antonia Creswell , Kai Arulkumaran , Anil A. Bharath

Sparse autoencoders (SAEs) decompose polysemantic neural representations, where neurons respond to multiple unrelated concepts, into monosemantic features that capture single, interpretable concepts. However, standard training objectives…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Ali Nasiri-Sarvi , Anh Tien Nguyen , Hassan Rivaz , Dimitris Samaras , Mahdi S. Hosseini

This paper presents a novel convolutional neural network (CNN) based image compression framework via scalable auto-encoder (SAE). Specifically, our SAE based deep image codec consists of hierarchical coding layers, each of which is an…

Multimedia · Computer Science 2019-04-02 Chuanmin Jia , Zhaoyi Liu , Yao Wang , Siwei Ma , Wen Gao

Autoencoder-based image codecs achieve state-of-the-art compression performance but often incur high computational complexity, particularly at decoding time. This work introduces a low-complexity learned image compression framework based on…

Image and Video Processing · Electrical Eng. & Systems 2026-05-14 Théophile Blard , Pierrick Philippe , Théo Ladune , Xiaoran Jiang , Olivier Déforges

Image compression is a method to remove spatial redundancy between adjacent pixels and reconstruct a high-quality image. In the past few years, deep learning has gained huge attention from the research community and produced promising image…

Image and Video Processing · Electrical Eng. & Systems 2021-09-07 Khawar Islam , L. Minh Dang , Sujin Lee , Hyeonjoon Moon

Autoencoders are composed of coding and decoding units, hence they hold the inherent potential of high-performance data compression and signal compressed sensing. The main disadvantages of current autoencoders comprise the following several…

Machine Learning · Computer Science 2022-07-28 Honggui Li , Dimitri Galayko , Maria Trocan , Mohamad Sawan

Learned image compression codecs have recently achieved impressive compression performances surpassing the most efficient image coding architectures. However, most approaches are trained to minimize rate and distortion which often leads to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Daniele Mari , Simone Milani