English
Related papers

Related papers: Learned Image Compression with Soft Bit-based Rate…

200 papers

Due to their high computational complexity, deep neural networks are still limited to powerful processing units. To promote a reduced model complexity by dint of low-bit fixed-point quantization, we propose a gradient-based optimization…

Machine Learning · Computer Science 2019-07-18 Lukas Enderich , Fabian Timm , Lars Rosenbaum , Wolfram Burgard

The leading approach for image compression with artificial neural networks (ANNs) is to learn a nonlinear transform and a fixed entropy model that are optimized for rate-distortion performance. We show that this approach can be…

Computer Vision and Pattern Recognition · Computer Science 2018-06-01 David Minnen , George Toderici , Saurabh Singh , Sung Jin Hwang , Michele Covell

In recent years, there has been rapid development in learned image compression techniques that prioritize ratedistortion-perceptual compression, preserving fine details even at lower bit-rates. However, current learning-based image…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Peirong Ning , Wei Jiang , Ronggang Wang

All Lossy compression algorithms employ similar compression schemes -- frequency domain transform followed by quantization and lossless encoding schemes. They target tradeoffs by quantizating high frequency data to increase compression…

Information Theory · Computer Science 2021-12-15 Johnathan Chiu

The state-of-the-art video-based point cloud compression scheme projects the 3D point cloud to 2D patch by patch and organizes the patches into frames to compress them using the efficient video compression scheme. Such a scheme shows a good…

Multimedia · Computer Science 2019-02-13 Li Li , Zhu Li , Shan Liu , Houqiang Li

This paper presents a new progressive compression method for triangular meshes. This method, in fact, is based on a schema of irregular multi-resolution analysis and is centered on the optimization of the rate-distortion trade-off. The…

Graphics · Computer Science 2013-09-16 Zeineb Abderrahim , Elhem Techini , Mohamed Salim Bouhlel

Image noise is ubiquitous in photography. However, image noise is not compressible nor desirable, thus attempting to convey the noise in compressed image bitstreams yields sub-par results in both rate and distortion. We propose to…

Image and Video Processing · Electrical Eng. & Systems 2023-07-13 Benoit Brummer , Christophe De Vleeschouwer

Lossy compression algorithms are typically designed and analyzed through the lens of Shannon's rate-distortion theory, where the goal is to achieve the lowest possible distortion (e.g., low MSE or high SSIM) at any given bit rate. However,…

Machine Learning · Computer Science 2019-07-31 Yochai Blau , Tomer Michaeli

We present a theoretical analysis and empirical evaluations of a novel set of techniques for computational cost reduction of classifiers that are based on learned transform and soft-threshold. By modifying optimization procedures for…

Shift neural networks reduce computation complexity by removing expensive multiplication operations and quantizing continuous weights into low-bit discrete values, which are fast and energy efficient compared to conventional neural…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Xinlin Li , Bang Liu , Yaoliang Yu , Wulong Liu , Chunjing Xu , Vahid Partovi Nia

High levels of noise usually exist in today's captured images due to the relatively small sensors equipped in the smartphone cameras, where the noise brings extra challenges to lossy image compression algorithms. Without the capacity to…

Image and Video Processing · Electrical Eng. & Systems 2022-07-25 Ka Leong Cheng , Yueqi Xie , Qifeng Chen

Quantizing a floating-point neural network to its fixed-point representation is crucial for Learned Image Compression (LIC) because it improves decoding consistency for interoperability and reduces space-time complexity for implementation.…

Image and Video Processing · Electrical Eng. & Systems 2023-10-10 Junqi Shi , Ming Lu , Zhan Ma

The problem of high-dimensional and large-scale representation of visual data is addressed from an unsupervised learning perspective. The emphasis is put on discrete representations, where the description length can be measured in bits and…

Machine Learning · Computer Science 2019-01-25 Sohrab Ferdowsi

Autoencoder-based structures have dominated recent learned image compression methods. However, the inherent information loss associated with autoencoders limits their rate-distortion performance at high bit rates and restricts their…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Hanyue Tu , Siqi Wu , Li Li , Wengang Zhou , Houqiang Li

The problem of 1-bit compressive sampling is addressed in this paper. We introduce an optimization model for reconstruction of sparse signals from 1-bit measurements. The model targets a solution that has the least l0-norm among all signals…

Information Theory · Computer Science 2013-02-07 Lixin Shen , Bruce W. Suter

Neural image compression methods have seen increasingly strong performance in recent years. However, they suffer orders of magnitude higher computational complexity compared to traditional codecs, which hinders their real-world deployment.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-13 Yibo Yang , Stephan Mandt

Recent advances in text-to-image generative models provide the ability to generate high-quality images from short text descriptions. These foundation models, when pre-trained on billion-scale datasets, are effective for various downstream…

Machine Learning · Computer Science 2023-07-06 Eric Lei , Yiğit Berkay Uslu , Hamed Hassani , Shirin Saeedi Bidokhti

Quantized neural networks (QNNs) are among the main approaches for deploying deep neural networks on low resource edge devices. Training QNNs using different levels of precision throughout the network (dynamic quantization) typically…

Machine Learning · Computer Science 2021-02-19 Benjamin J. Bodner , Gil Ben Shalom , Eran Treister

Handling digital images is almost always accompanied by a lossy compression in order to facilitate efficient transmission and storage. This introduces an unavoidable tension between the allocated bit-budget (rate) and the faithfulness of…

Image and Video Processing · Electrical Eng. & Systems 2020-08-04 Xiyang Luo , Hossein Talebi , Feng Yang , Michael Elad , Peyman Milanfar

Classical rate-distortion theory requires knowledge of an elusive source distribution. Instead, we analyze rate-distortion properties of individual objects using the recently developed algorithmic rate-distortion theory. The latter is based…

Information Theory · Computer Science 2007-07-16 Steven de Rooij , Paul Vitanyi