English
Related papers

Related papers: Residual Quantization with Implicit Neural Codeboo…

200 papers

Deep learning often faces the challenge of efficiently processing dynamic inputs, such as sensor data or user inputs. For example, an AI writing assistant is required to update its suggestions in real time as a document is edited.…

Machine Learning · Computer Science 2023-07-28 Or Sharir , Anima Anandkumar

Fighting against noise is crucial for NISQ devices to demonstrate practical quantum applications. In this work, we give a new paradigm of quantum error mitigation based on the vectorization of density matrices. Different from the ideas of…

Quantum Physics · Physics 2024-07-22 Zhong-Xia Shang , Zi-Han Chen , Cai-Sheng Cheng

This study explores the intersection of continuous-variable quantum computing (CVQC) and classical machine learning, focusing on CVQC data encoding techniques, including Displacement encoding and squeezing encoding, alongside Instantaneous…

Quantum Physics · Physics 2025-04-10 Minati Rath , Hema Date

The rapid scaling of Large Language Models (LLMs) elevates inference costs and compounds substantial deployment barriers. While quantization to 8 or 4 bits mitigates this, sub-3-bit methods face severe accuracy, scalability, and efficiency…

Vector quantization is a technique in machine learning that discretizes continuous representations into a set of discrete vectors. It is widely employed in tokenizing data representations for large language models, diffusion models, and…

Machine Learning · Computer Science 2024-11-26 Wenhao Zhao , Qiran Zou , Rushi Shah , Dianbo Liu

The realization of scalable fault-tolerant quantum computing is expected to hinge on quantum error-correcting codes. In the quest for more efficient quantum fault tolerance, a critical code parameter is the weight of measurements that…

Quantum Physics · Physics 2025-02-21 Austin Yubo He , Zi-Wen Liu

Recent advances in quantum hardware motivate the development of algorithmic frameworks that integrate quantum sampling with classical inference. This work introduces a segmentation-based regression method tailored to quantum neural networks…

Quantum Physics · Physics 2025-07-02 James C. Hateley

Post-training quantization (PTQ) reduces the memory footprint of LLMs by quantizing weights to low-precision datatypes. Since LLM inference is usually memory-bound, PTQ methods can improve inference throughput. Recent state-of-the-art PTQ…

Machine Learning · Computer Science 2025-06-19 Albert Tseng , Qingyao Sun , David Hou , Christopher De Sa

This paper presents a novel network compression framework Kernel Quantization (KQ), targeting to efficiently convert any pre-trained full-precision convolutional neural network (CNN) model into a low-precision version without significant…

Machine Learning · Computer Science 2020-03-12 Zhongzhi Yu , Yemin Shi , Tiejun Huang , Yizhou Yu

We propose a post-selection technique, based on quantum error detection, for quantum key distribution (QKD) systems that run over quantum repeaters with encoding. In such repeaters, quantum error correction techniques are used for…

Quantum Physics · Physics 2021-01-04 Yumang Jing , Daniel Alsina Leal , Mohsen Razavi

Deep neural networks (DNNs) are ubiquitous in computer vision and natural language processing, but suffer from high inference cost. This problem can be addressed by quantization, which consists in converting floating point operations into a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Edouard Yvinec , Arnaud Dapgony , Matthieu Cord , Kevin Bailly

In this paper, we introduce a new approach, called Posthoc Interpretation via Quantization (PIQ), for interpreting decisions made by trained classifiers. Our method utilizes vector quantization to transform the representations of a…

Artificial Intelligence · Computer Science 2023-05-30 Francesco Paissan , Cem Subakan , Mirco Ravanelli

Inverted file and asymmetric distance computation (IVFADC) have been successfully applied to approximate nearest neighbor search and subsequently maximum inner product search. In such a framework, vector quantization is used for coarse…

Machine Learning · Computer Science 2019-03-26 Xiang Wu , Ruiqi Guo , Sanjiv Kumar , David Simcha

Vector-quantized variational autoencoders (VQ-VAEs) are central to models that rely on high reconstruction fidelity, from neural compression to generative pipelines. Hierarchical extensions, such as VQ-VAE2, are often credited with superior…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Shirin Reyhanian , Laurenz Wiskott

Quantum machine learning applies principles such as superposition and entanglement to data processing and optimization. Variational quantum models operate on qubits in high-dimensional Hilbert spaces and provide an alternative approach to…

Machine Learning · Computer Science 2026-03-02 Miras Seilkhan , Adilbek Taizhanov

Image generative models can learn the distributions of the training data and consequently generate examples by sampling from these distributions. However, when the training dataset is corrupted with outliers, generative models will likely…

Machine Learning · Computer Science 2022-09-21 Chieh-Hsin Lai , Dongmian Zou , Gilad Lerman

Quantum computing is a promising candidate for accelerating machine learning tasks. Limited by the control accuracy of current quantum hardware, reducing the consumption of quantum resources is the key to achieving quantum advantage. Here,…

Quantum Physics · Physics 2024-05-22 Fan Yang , Furong Wang , Xusheng Xu , Pao Gao , Tao Xin , ShiJie Wei , Guilu Long

Combinatorial optimization (CO) aims to efficiently find the best solution to NP-hard problems ranging from statistical physics to social media marketing. A wide range of CO applications can benefit from local search methods because they…

Machine Learning · Computer Science 2023-04-14 Yuanhang Shao , Tonmoy Dey , Nikola Vuckovic , Luke Van Popering , Alan Kuhnle

It is customary to deploy uniform scalar quantization in the end-to-end optimized Neural image compression methods, instead of more powerful vector quantization, due to the high complexity of the latter. Lattice vector quantization (LVQ),…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Xi Zhang , Xiaolin Wu

Layer-wise quantization is a key technique for efficiently compressing large models without expensive retraining. Previous methods typically quantize the weights of each layer by "uniformly" optimizing the layer reconstruction loss across…

Machine Learning · Computer Science 2025-03-04 Yi-Lin Sung , Prateek Yadav , Jialu Li , Jaehong Yoon , Mohit Bansal