English
Related papers

Related papers: Learned Image Compression with Soft Bit-based Rate…

200 papers

Extensive efforts have been made to boost the performance in the domain of language models by introducing various attention-based transformers. However, the inclusion of linear layers with large dimensions contributes to significant…

Machine Learning · Computer Science 2024-11-19 Priyansh Bhatnagar , Linfeng Wen , Mingu Kang

Optimized for pixel fidelity metrics, images compressed by existing image codec are facing systematic challenges when used for visual analysis tasks, especially under low-bitrate coding. This paper proposes a visual analysis-motivated…

Image and Video Processing · Electrical Eng. & Systems 2021-04-22 Zhimeng Huang , Chuanmin Jia , Shanshe Wang , Siwei Ma

Recent advances in learned image codecs have been extended from human perception toward machine perception. However, progressive image compression with fine granular scalability (FGS)-which enables decoding a single bitstream at multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Jungwoo Kim , Jun-Hyuk Kim , Jong-Seok Lee

Deep video compression has made significant progress in recent years, achieving rate-distortion performance that surpasses that of traditional video compression methods. However, rate control schemes tailored for deep video compression have…

Multimedia · Computer Science 2025-05-09 Bowen Gu , Hao Chen , Ming Lu , Jie Yao , Zhan Ma

This survey articles focuses on emerging connections between the fields of machine learning and data compression. While fundamental limits of classical (lossy) data compression are established using rate-distortion theory, the connections…

Information Theory · Computer Science 2024-06-17 Jun Chen , Yong Fang , Ashish Khisti , Ayfer Ozgur , Nir Shlezinger , Chao Tian

Recently, many neural network-based image compression methods have shown promising results superior to the existing tool-based conventional codecs. However, most of them are often trained as separate models for different target bit rates,…

Image and Video Processing · Electrical Eng. & Systems 2022-11-09 Jooyoung Lee , Seyoon Jeong , Munchurl Kim

While deep neural networks are a highly successful model class, their large memory footprint puts considerable strain on energy consumption, communication bandwidth, and storage requirements. Consequently, model size reduction has become an…

Machine Learning · Statistics 2018-10-02 Marton Havasi , Robert Peharz , José Miguel Hernández-Lobato

In the low-bit quantization field, training Binary Neural Networks (BNNs) is the extreme solution to ease the deployment of deep models on resource-constrained devices, having the lowest storage cost and significantly cheaper bit-wise…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Yikai Wang , Yi Yang , Fuchun Sun , Anbang Yao

Prevailing quantization techniques in Learned Image Compression (LIC) typically employ a static, uniform bit-width across all layers, failing to adapt to the highly diverse data distributions and sensitivity characteristics inherent in LIC…

Image and Video Processing · Electrical Eng. & Systems 2025-11-12 Youneng Bao , Yulong Cheng , Yiping Liu , Yichen Yang , Peng Qin , Mu Li , Yongsheng Liang

Image codecs are typically optimized to trade-off bitrate \vs distortion metrics. At low bitrates, this leads to compression artefacts which are easily perceptible, even when training with perceptual or adversarial losses. To improve image…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Marlène Careil , Matthew J. Muckley , Jakob Verbeek , Stéphane Lathuilière

Rate distortion theory is concerned with optimally encoding a given signal class $\mathcal{S}$ using a budget of $R$ bits, as $R\to\infty$. We say that $\mathcal{S}$ can be compressed at rate $s$ if we can achieve an error of…

Functional Analysis · Mathematics 2020-08-04 Philipp Grohs , Andreas Klotz , Felix Voigtlaender

Image compression is a fundamental research field and many well-known compression standards have been developed for many decades. Recently, learned compression methods exhibit a fast development trend with promising results. However, there…

Image and Video Processing · Electrical Eng. & Systems 2020-03-31 Zhengxue Cheng , Heming Sun , Masaru Takeuchi , Jiro Katto

Recent learning-based lossless image compression methods encode an image in the unit of subimages and achieve comparable performances to conventional non-learning algorithms. However, these methods do not consider the performance drop in…

Image and Video Processing · Electrical Eng. & Systems 2021-12-14 Hochang Rhee , Yeong Il Jang , Seyun Kim , Nam Ik Cho

This paper presents an autoencoder-based neural network architecture to compress histopathological images while retaining the denser and more meaningful representation of the original images. Current research into improving compression…

Image and Video Processing · Electrical Eng. & Systems 2023-05-15 Agnes Barsi , Suvendu Chandan Nayak , Sasmita Parida , Raj Mani Shukla

Despite its improvements in coding performance compared to traditional codecs, Learned Image Compression (LIC) suffers from large computational costs for storage and deployment. Model quantization offers an effective solution to reduce the…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Md Adnan Faisal Hossain , Zhihao Duan , Fengqing Zhu

We propose a lossy image compression system using the deep-learning autoencoder structure to participate in the Challenge on Learned Image Compression (CLIC) 2018. Our autoencoder uses the residual blocks with skip connections to reduce the…

Computer Vision and Pattern Recognition · Computer Science 2019-02-21 David Alexandre , Chih-Peng Chang , Wen-Hsiao Peng , Hsueh-Ming Hang

We propose DiffQ a differentiable method for model compression for quantizing model parameters without gradient approximations (e.g., Straight Through Estimator). We suggest adding independent pseudo quantization noise to model parameters…

Machine Learning · Statistics 2022-10-18 Alexandre Défossez , Yossi Adi , Gabriel Synnaeve

The enormous size of modern deep neural networks makes it challenging to deploy those models in memory and communication limited scenarios. Thus, compressing a trained model without a significant loss in performance has become an…

Information Theory · Computer Science 2019-01-25 Weihao Gao , Yu-Han Liu , Chong Wang , Sewoong Oh

Noisy images are a challenge to image compression algorithms due to the inherent difficulty of compressing noise. As noise cannot easily be discerned from image details, such as high-frequency signals, its presence leads to extra bits…

Image and Video Processing · Electrical Eng. & Systems 2024-02-09 Yuxin Xie , Li Yu , Farhad Pakdaman , Moncef Gabbouj

We present a new approach to learn compressible representations in deep architectures with an end-to-end training strategy. Our method is based on a soft (continuous) relaxation of quantization and entropy, which we anneal to their discrete…

Machine Learning · Computer Science 2017-06-09 Eirikur Agustsson , Fabian Mentzer , Michael Tschannen , Lukas Cavigelli , Radu Timofte , Luca Benini , Luc Van Gool
‹ Prev 1 4 5 6 7 8 10 Next ›