English
Related papers

Related papers: Parallelized Rate-Distortion Optimized Quantizatio…

200 papers

Mobile cyberphysical systems have received considerable attention over the last decade, as communication, computing and control come together on a common platform. Understanding the complex interactions that govern the behavior of large…

Networking and Internet Architecture · Computer Science 2014-06-10 Ahmed Abdelhadi , Andreas Gerstlauer , Sriram Vishwanath

In intra coding, Rate Distortion Optimization (RDO) is performed to achieve the optimal intra mode from a pre-defined candidate list. The optimal intra mode is also required to be encoded and transmitted to the decoder side besides the…

Image and Video Processing · Electrical Eng. & Systems 2022-04-11 Linwei Zhu , Yun Zhang , Na Li , Gangyi Jiang , Sam Kwong

Despite a short history, neural image codecs have been shown to surpass classical image codecs in terms of rate-distortion performance. However, most of them suffer from significantly longer decoding times, which hinders the practical…

Image and Video Processing · Electrical Eng. & Systems 2023-05-16 Yixin Gao , Runsen Feng , Zongyu Guo , Zhibo Chen

Post Training Quantization (PTQ), a mainstream model compression technique, often leads to the paradoxical 'low error, high loss' phenomenon because it focuses solely on minimizing quantization error. The root cause lies in the Hessian…

Machine Learning · Computer Science 2026-01-30 Jinhao Zhang Yunquan Zhang , Zicheng yan , Boyang Zhang , Jun Sun , Daning Cheng

Current neural audio codecs typically use residual vector quantization (RVQ) to discretize speech signals. However, they often experience codebook collapse, which reduces the effective codebook size and leads to suboptimal performance. To…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-12 Rui-Chen Zheng , Hui-Peng Du , Xiao-Hang Jiang , Yang Ai , Zhen-Hua Ling

Product Quantization (PQ) has long been a mainstream for generating an exponentially large codebook at very low memory/time cost. Despite its success, PQ is still tricky for the decomposition of high-dimensional vector space, and the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Lianli Gao , Xiaosu Zhu , Jingkuan Song , Zhou Zhao , Heng Tao Shen

Mixed-precision quantization mostly predetermines the model bit-width settings before actual training due to the non-differential bit-width sampling process, obtaining sub-optimal performance. Worse still, the conventional static…

Artificial Intelligence · Computer Science 2023-02-10 Yingchun Wang , Jingcai Guo , Song Guo , Weizhan Zhang

Feature coding for machines (FCM) is a lossy compression paradigm for split-inference. The transmitter encodes the outputs of the first part of a neural network before sending them to the receiver for completing the inference. Practical FCM…

Image and Video Processing · Electrical Eng. & Systems 2026-01-30 Samuel Fernández-Menduiña , Hyomin Choi , Fabien Racapé , Eduardo Pavez , Antonio Ortega

Quantizing deep convolutional neural networks for image super-resolution substantially reduces their computational costs. However, existing works either suffer from a severe performance drop in ultra-low precision of 4 or lower bit-widths,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Cheeun Hong , Heewon Kim , Sungyong Baik , Junghun Oh , Kyoung Mu Lee

Structural similarity (SSIM)-based distortion $D_\text{SSIM}$ is more consistent with human perception than the traditional mean squared error $D_\text{MSE}$. To achieve better video quality, many studies on optimal bit allocation (OBA) and…

Multimedia · Computer Science 2021-04-06 Yang Li , Xuanqin Mou

Quantization methods have been introduced to perform large scale approximate nearest search tasks. Residual Vector Quantization (RVQ) is one of the effective quantization methods. RVQ uses a multi-stage codebook learning scheme to lower the…

Computer Vision and Pattern Recognition · Computer Science 2015-09-18 Shicong Liu , Hongtao Lu , Junru Shao

Quantum Computing aims to streamline machine learning, making it more effective with fewer trainable parameters. This reduction of parameters can speed up the learning process and reduce the use of computational resources. However, in the…

Quantum Physics · Physics 2024-05-22 Michael Kölle , Timo Witter , Tobias Rohe , Gerhard Stenzel , Philipp Altmann , Thomas Gabor

Utilizing low-resolution analog-to-digital converters (ADCs) in uplink massive multiple-input multiple-output (MIMO) systems is a practical solution to decrease power consumption. The performance gap between the low and high-resolution…

Information Theory · Computer Science 2023-10-05 Gökhan Yılmaz , Ali Özgür Yılmaz

Quantization has been an effective technology in ANN (approximate nearest neighbour) search due to its high accuracy and fast search speed. To meet the requirement of different applications, there is always a trade-off between retrieval…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Jingkuan Song , Xiaosu Zhu , Lianli Gao , Xin-Shun Xu , Wu Liu , Heng Tao Shen

In theory, vector quantization (VQ) is always better than scalar quantization (SQ) in terms of rate-distortion (R-D) performance. Recent state-of-the-art methods for neural image compression are mainly based on nonlinear transform coding…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Runsen Feng , Zongyu Guo , Weiping Li , Zhibo Chen

High Efficiency Video Coding (HEVC) significantly reduces bit-rates over the proceeding H.264 standard but at the expense of extremely high encoding complexity. In HEVC, the quad-tree partition of coding unit (CU) consumes a large…

Computer Vision and Pattern Recognition · Computer Science 2019-03-06 Mai Xu , Tianyi Li , Zulin Wang , Xin Deng , Ren Yang , Zhenyu Guan

Rate-control plays an important role in video coding. However, in the conventional rate-control algorithms, the number and position of Macroblocks (MBs) inside one basic unit for rate-control is inflexible and predetermined. The different…

Multimedia · Computer Science 2016-11-17 Hai-Miao Hu , Bo Li , Weiyao Lin , Wei Li , Ming-Ting Sun

Post-training quantization offers an efficient pathway to deploy super-resolution models, yet existing methods treat weight and activation quantization independently, missing their critical interplay. Through controlled experiments on…

Image and Video Processing · Electrical Eng. & Systems 2025-11-12 Hongjun Wang , Jiyuan Chen , Xuan Song , Yinqiang Zheng

Practical applicability of quantum optimisation on near term devices is constrained by limited qubit counts and hardware noise, which restricts the scalability of quantum optimisation algorithms for combinatorial problems. The simulation of…

Quantum Physics · Physics 2026-05-01 Namasi G Sankar , Georgios Miliotis , Simon Caton

Vector quantization is a fundamental technique for compression and large-scale nearest neighbor search. For high-accuracy operating points, multi-codebook quantization associates data vectors with one element from each of multiple…

Machine Learning · Computer Science 2025-01-08 Théophane Vallaeys , Matthew Muckley , Jakob Verbeek , Matthijs Douze