English
Related papers

Related papers: Optimal Quantization For Mixed Distributions

200 papers

We present an analysis of optimal quantization of probability measures with nonuniform densities on spherical curves. We begin by deriving the centroid condition, followed by a high-resolution asymptotic analysis to establish the…

Probability · Mathematics 2026-02-13 Silpi Saha , Sangita Jha , Mrinal Kanti Roychowdhury

Quantization summarizes continuous distributions by calculating a discrete approximation. Among the widely adopted methods for data quantization is Lloyd's algorithm, which partitions the space into Vorono\"i cells, that can be seen as…

In this paper, we have considered a uniform probability distribution supported by a stretched Sierpi\'nski triangle. For this probability measure, the optimal sets of $n$-means and the $n$th quantization errors are determined for all $n\geq…

Dynamical Systems · Mathematics 2019-06-17 Dogan Comez , Mrinal Kanti Roychowdhury

Quantization is a technique for creating efficient Deep Neural Networks (DNNs), which involves performing computations and storing tensors at lower bit-widths than f32 floating point precision. Quantization reduces model size and inference…

Machine Learning · Computer Science 2023-10-02 Eliska Kloberdanz , Wei Le

Quantization for a Borel probability measure refers to the idea of estimating a given probability by a discrete probability with support containing a finite number of elements. In this paper, we have considered a Borel probability measure…

Information Theory · Computer Science 2025-05-28 Megha Pandey , Mrinal Kanti Roychowdhury

Quantiles are very important statistics information used to describe the distribution of datasets. Given the quantiles of a dataset, we can easily know the distribution of the dataset, which is a fundamental problem in data analysis.…

Databases · Computer Science 2015-08-25 Zixuan Zhuang

A theoretical framework is developed to describe the transformation that distributes probability density functions uniformly over space. In one dimension, the cumulative distribution can be used, but does not generalize to higher…

Neural and Evolutionary Computing · Computer Science 2016-09-08 Eric Kee

We present some new and explicit error bounds for the approximation of distributions. The approximation error is quantified by the maximal density ratio of the distribution $Q$ to be approximated and its proxy $P$. This non-symmetric…

Statistics Theory · Mathematics 2022-09-02 Lutz Duembgen , Richard Samworth , Jon Wellner

Unlike classification, whose goal is to estimate the class of each data point in a dataset, prevalence estimation or quantification is a task that aims to estimate the distribution of classes in a dataset. The two main tasks in prevalence…

Machine Learning · Statistics 2025-07-09 Aime Bienfait Igiraneza , Christophe Fraser , Robert Hinch

In this paper, for a given family of constraints and the classical Cantor distribution we determine the constrained optimal sets of $n$-points, $n$th constrained quantization errors for all positive integers $n$. We also calculate the…

Dynamical Systems · Mathematics 2024-03-05 Megha Pandey , Mrinal Kanti Roychowdhury

One of the main concepts in quantum physics is a density matrix, which is a symmetric positive definite matrix of trace one. Finite probability distributions are a special case where the density matrix is restricted to be diagonal. Density…

Quantum Physics · Physics 2014-08-14 Manfred K. Warmuth , Dima Kuzmin

Distributed graph signal processing algorithms require the network nodes to communicate by exchanging messages in order to achieve a common objective. These messages have a finite precision in realistic networks, which may necessitate to…

Signal Processing · Electrical Eng. & Systems 2019-09-30 Isabela Cunha Maia Nobre , Pascal Frossard

This work addresses the problem of state estimation in multivariable dynamic systems with quantized outputs, a common scenario in applications involving low-resolution sensors or communication constraints. A novel method is proposed to…

Systems and Control · Electrical Eng. & Systems 2025-09-10 Angel L. Cedeño , Rodrigo A. González , Boris I. Godoy , Juan C. Agüero

In this paper, we address the probabilistic error quantification of a general class of prediction methods. We consider a given prediction model and show how to obtain, through a sample-based approach, a probabilistic upper bound on the…

Statistics Theory · Mathematics 2021-06-07 Victor Mirasierra , Martina Mammarella , Fabrizio Dabbene , Teodoro Alamo

This paper considers the problem of estimating the cumulative distribution function and probability density function of a random variable using data quantized by uniform and non-uniform quantizers. A simple estimator is proposed based on…

Signal Processing · Electrical Eng. & Systems 2018-05-03 Paolo Carbone , Johan Schoukens , István Kollár , Antonio Moschitta

We consider statistical learning problems in which data are observed as a set of probability measures. Optimal transport (OT) is a popular tool to compare and manipulate such objects, but its computational cost becomes prohibitive when the…

Machine Learning · Statistics 2026-03-24 Erell Gachon , Elsa Cazelles , Jérémie Bigot

Nonuniform subsampling methods are effective to reduce computational burden and maintain estimation efficiency for massive data. Existing methods mostly focus on subsampling with replacement due to its high computational efficiency. If the…

Methodology · Statistics 2021-07-06 Jun Yu , HaiYing Wang , Mingyao Ai , Huiming Zhang

The optimal and minimal measuring strategy is obtained for a two-state system prepared in a mixed state with a probability given by any isotropic a priori distribution. We explicitly construct the specific optimal and minimal generalized…

Quantum Physics · Physics 2009-10-31 G. Vidal , J. I. Latorre , P. Pascual , R. Tarrach

We study distributed optimization problems over a network when the communication between the nodes is constrained, and so information that is exchanged between the nodes must be quantized. This imperfect communication poses a fundamental…

Optimization and Control · Mathematics 2018-10-30 Thinh T. Doan , Siva Theja Maguluri , Justin Romberg

Quantization is essential for reducing the computational cost and memory usage of deep neural networks, enabling efficient inference on low-precision hardware. Despite the growing adoption of uniform and floating-point quantization schemes,…

Machine Learning · Statistics 2026-05-19 Mehmet Aktukmak , Daniel Huang , Ke Ding