English
Related papers

Related papers: Single-bit Quantization Capacity of Binary-input C…

200 papers

A popular approach to learning encoders for lossy compression is to use additive uniform noise during training as a differentiable approximation to test-time quantization. We demonstrate that a uniform noise channel can also be implemented…

Machine Learning · Statistics 2020-10-22 Eirikur Agustsson , Lucas Theis

Let $X$ and $Y$ be dependent random variables. This paper considers the problem of designing a scalar quantizer for $Y$ to maximize the mutual information between the quantizer's output and $X$, and develops fundamental properties and…

Information Theory · Computer Science 2019-10-30 Alankrita Bhatt , Bobak Nazer , Or Ordentlich , Yury Polyanskiy

A generic qubit unitary operator affected by depolarizing noise is duplicated and inserted in a quantum switch process realizing a superposition of causal orders. The characterization of the resulting switched quantum channel is worked out…

Quantum Physics · Physics 2021-04-14 Francois Chapeau-Blondeau

A generic qubit unitary operator affected by quantum noise is duplicated and inserted in a coherently superposed channel, superposing two paths offered to a probe qubit across the noisy unitary, and driven by a control qubit. A…

Quantum Physics · Physics 2021-10-14 Francois Chapeau-Blondeau

We propose to send a Gaussian source over an average-power limited additive white Gaussian noise channel by transmitting a linear combination of the source sequence and the result of its quantization using a high dimensional Gaussian vector…

Information Theory · Computer Science 2007-07-16 Shraga Bross , Amos Lapidoth , Stephan Tinguely

This paper studies fixed-rate randomized vector quantization under the constraint that the quantizer's output has a given fixed probability distribution. A general representation of randomized quantizers that includes the common models in…

Information Theory · Computer Science 2016-11-15 Naci Saldi , Tamás Linder , Serdar Yüksel

We present a novel method for neural network quantization that emulates a non-uniform $k$-quantile quantizer, which adapts to the distribution of the quantized parameters. Our approach provides a novel alternative to the existing uniform…

Machine Learning · Computer Science 2021-03-30 Chaim Baskin , Eli Schwartz , Evgenii Zheltonozhskii , Natan Liss , Raja Giryes , Alex M. Bronstein , Avi Mendelson

We study the problem of the transmission of currently observed time variable signals via a channel that is capable of sending a single binary signal only for each measurement of the underlying process. For encoding and decoding, we suggest…

Information Theory · Computer Science 2015-01-22 Nikolai Dokuchaev

Quantizers take part in nearly every digital signal processing system which operates on physical signals. They are commonly designed to accurately represent the underlying signal, regardless of the specific task to be performed on the…

Signal Processing · Electrical Eng. & Systems 2019-07-24 Nir Shlezinger , Yonina C. Eldar , Miguel R. D. Rodrigues

Quantization has been an effective technology in ANN (approximate nearest neighbour) search due to its high accuracy and fast search speed. To meet the requirement of different applications, there is always a trade-off between retrieval…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Jingkuan Song , Xiaosu Zhu , Lianli Gao , Xin-Shun Xu , Wu Liu , Heng Tao Shen

The binary neural network, largely saving the storage and computation, serves as a promising technique for deploying deep models on resource-limited devices. However, the binarization inevitably causes severe information loss, and even…

Neural and Evolutionary Computing · Computer Science 2020-04-08 Haotong Qin , Ruihao Gong , Xianglong Liu , Xiao Bai , Jingkuan Song , Nicu Sebe

Due to the crossbar array architecture, the sneak-path problem severely degrades the data integrity in the resistive random access memory (ReRAM). In this letter, we investigate the channel quantizer design for ReRAM arrays with multiple…

Information Theory · Computer Science 2024-10-08 Zhen Mei , Kui Cai , Long Shi , Jun Li

We formally study the effects of a restricted single-qubit noise model inspired by real quantum hardware, and corruption in quantum training data, on the performance of binary classification using quantum circuits. We find that, under the…

Quantum Physics · Physics 2023-05-09 Yonghoon Lee , Doga Murat Kurkcuoglu , Gabriel Nathan Perdue

Binarization is an extreme network compression approach that provides large computational speedups along with energy and memory savings, albeit at significant accuracy costs. We investigate the question of where to binarize inputs at…

Computer Vision and Pattern Recognition · Computer Science 2018-04-12 Ameya Prabhu , Vishal Batchu , Rohit Gajawada , Sri Aurobindo Munagala , Anoop Namboodiri

This work considers a binomial noise channel. The paper can be roughly divided into two parts. The first part is concerned with the properties of the capacity-achieving distribution. In particular, for the binomial channel, it is not known…

Information Theory · Computer Science 2024-01-24 Ian Zieder , Antonino Favano , Luca Barletta , Alex Dytso

We study the super dense coding capacity in the presence of quantum channels with correlated noise. We investigate both the cases of unitary and non-unitary encoding. Pauli channels for arbitrary dimensions are treated explicitly. The super…

Quantum Physics · Physics 2011-10-07 Zahra Shadman , Hermann Kampermann , Chiara Macchiavello , Dagmar Bruß

Quantization is essential for reducing the computational cost and memory usage of deep neural networks, enabling efficient inference on low-precision hardware. Despite the growing adoption of uniform and floating-point quantization schemes,…

Machine Learning · Statistics 2026-05-19 Mehmet Aktukmak , Daniel Huang , Ke Ding

We develop several lower bounds on the capacity of binary input symmetric output channels with synchronization errors which also suffer from other types of impairments such as substitutions, erasures, additive white Gaussian noise (AWGN)…

Information Theory · Computer Science 2012-03-30 Mojtaba Rahmati , Tolga M. Duman

In this article, we are proposing a closed-form solution for the capacity of the single quantum channel. The Gaussian distributed input has been considered for the analytical calculation of the capacity. In our previous couple of papers, we…

Information Theory · Computer Science 2023-02-17 Mouli Chakraborty , Harun Siljak , Indrakshi Dey , Nicola Marchetti

We investigate strategies for estimating a depolarizing channel for a finite dimensional system. Our analysis addresses the double optimization problem of selecting the best input probe state and the measurement strategy that minimizes the…

Quantum Physics · Physics 2009-11-07 Masahide Sasaki , Masashi Ban , Stephen M. Barnett