English
Related papers

Related papers: Differentiable Vector Quantization for Rate-Distor…

200 papers

The deployment of deep neural networks on resource-constrained devices relies on quantization. While static, uniform quantization applies a fixed bit-width to all inputs, it fails to adapt to their varying complexity. Dynamic,…

Machine Learning · Computer Science 2026-03-24 Hazem Hesham Yousef Shalby , Fabrizio Pittorino , Francesca Palermo , Diana Trojaniello , Manuel Roveri

Images captured in nighttime scenes suffer from severely reduced visibility, hindering effective content perception. Current low-light image enhancement (LLIE) methods face significant challenges: data-driven end-to-end mapping networks…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Tongshun Zhang , Pingping Liu , Zhe Zhang , Qiuzhan Zhou

End-to-end optimized neural image compression (NIC) has obtained superior lossy compression performance recently. In this paper, we consider the problem of rate-distortion (R-D) characteristic analysis and modeling for NIC. We make efforts…

Image and Video Processing · Electrical Eng. & Systems 2022-01-14 Chuanmin Jia , Ziqing Ge , Shanshe Wang , Siwei Ma , Wen Gao

Recently it has been shown that deep learning-based image compression has shown the potential to outperform traditional codecs. However, most existing methods train multiple networks for multiple bit rates, which increases the…

Image and Video Processing · Electrical Eng. & Systems 2019-12-13 Mohammad Akbari , Jie Liang , Jingning Han , Chengjie Tu

Recent advancements in deep learning-based image compression are notable. However, prevalent schemes that employ a serial context-adaptive entropy model to enhance rate-distortion (R-D) performance are markedly slow. Furthermore, the…

Applications · Statistics 2024-03-25 Haisheng Fu , Feng Liang , Jie Liang , Zhenman Fang , Guohe Zhang , Jingning Han

This paper uses the reconstruction-computation-quantization (RCQ) paradigm to decode low-density parity-check (LDPC) codes. RCQ facilitates dynamic non-uniform quantization to achieve good frame error rate (FER) performance with very low…

Signal Processing · Electrical Eng. & Systems 2022-02-10 Linfang Wang , Caleb Terrill , Maximilian Stark , Zongwang Li , Sean Chen , Chester Hulse , Calvin Kuo , Richard Wesel , Gerhard Bauch , Rekha Pitchumani

Vector quantization(VQ) is a lossy data compression technique from signal processing, which is restricted to feature vectors and therefore inapplicable for combinatorial structures. This contribution presents a theoretical foundation of…

Artificial Intelligence · Computer Science 2010-01-07 Brijnesh J. Jain , Klaus Obermayer

Vector Quantized Variational Autoencoders (VQ-VAEs) are fundamental to modern generative modeling, yet they often suffer from training instability and "codebook collapse" due to the inherent coupling of representation learning and discrete…

Machine Learning · Computer Science 2026-02-20 Linwei Zhai , Han Ding , Mingzhi Lin , Cui Zhao , Fei Wang , Ge Wang , Wang Zhi , Wei Xi

Neural Video Compression (NVC) has achieved remarkable performance in recent years. However, precise rate control remains a challenge due to the inherent limitations of learning-based codecs. To solve this issue, we propose a dynamic video…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Chenhao Zhang , Wei Gao

Spatio-temporal forecasting is crucial in various fields and requires a careful balance between identifying subtle patterns and filtering out noise. Vector quantization (VQ) appears well-suited for this purpose, as it quantizes input…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Chao Chen , Tian Zhou , Yanjun Zhao , Hui Liu , Liang Sun , Rong Jin

The integration of Vector Quantised Variational AutoEncoder (VQ-VAE) with autoregressive models as generation part has yielded high-quality results on image generation. However, the autoregressive models will strictly follow the progressive…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Minghui Hu , Yujie Wang , Tat-Jen Cham , Jianfei Yang , P. N. Suganthan

Despite breakthrough advances in image super-resolution (SR) with convolutional neural networks (CNNs), SR has yet to enjoy ubiquitous applications due to the high computational complexity of SR networks. Quantization is one of the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Cheeun Hong , Sungyong Baik , Heewon Kim , Seungjun Nah , Kyoung Mu Lee

Neural image compression has surpassed state-of-the-art traditional codecs (H.266/VVC) for rate-distortion (RD) performance, but suffers from large complexity and separate models for different rate-distortion trade-offs. In this paper, we…

Image and Video Processing · Electrical Eng. & Systems 2023-02-13 Guo-Hua Wang , Jiahao Li , Bin Li , Yan Lu

Vision Transformers (ViTs) have exhibited exceptional performance across diverse computer vision tasks, while their substantial parameter size incurs significantly increased memory and computational demands, impeding effective inference on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Yanfeng Jiang , Ning Sun , Xueshuo Xie , Fei Yang , Tao Li

Quality-Diversity (QD) algorithms have emerged as a powerful optimization paradigm with the aim of generating a set of high-quality and diverse solutions. To achieve such a challenging goal, QD algorithms require maintaining a large archive…

Machine Learning · Computer Science 2024-06-07 Ren-Jian Wang , Ke Xue , Cong Guan , Chao Qian

This paper accelerates video perception, such as semantic segmentation and human pose estimation, by levering cross-frame redundancies. Unlike the existing approaches, which avoid redundant computations by warping the past features using…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Davide Abati , Haitam Ben Yahia , Markus Nagel , Amirhossein Habibian

Human motion data is inherently rich and complex, containing both semantic content and subtle stylistic features that are challenging to model. We propose a novel method for effective disentanglement of the style and content in human motion…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Fatemeh Zargarbashi , Dhruv Agrawal , Jakob Buhmann , Martin Guay , Stelian Coros , Robert W. Sumner

Efficient 3D LiDAR point cloud compression (LPCC) and streaming are critical for edge server-assisted robotic systems, enabling real-time communication with compact data representations. A widely adopted approach represents LiDAR point…

Image and Video Processing · Electrical Eng. & Systems 2026-03-17 Shengqian Wang , Chang Tu , He Chen

Generative models with discrete latent representations have recently demonstrated an impressive ability to learn complex high-dimensional data distributions. However, their performance relies on a long sequence of tokens per instance and a…

Machine Learning · Computer Science 2024-03-26 David D. Nguyen , David Leibowitz , Surya Nepal , Salil S. Kanhere

Compressing large neural networks is an important step for their deployment in resource-constrained computational platforms. In this context, vector quantization is an appealing framework that expresses multiple parameters using a single…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Julieta Martinez , Jashan Shewakramani , Ting Wei Liu , Ioan Andrei Bârsan , Wenyuan Zeng , Raquel Urtasun