English
Related papers

Related papers: Discretizing Distributions with Exact Moments: Err…

200 papers

Estimating the Shannon entropy of a discrete distribution from which we have only observed a small sample is challenging. Estimating other information-theoretic metrics, such as the Kullback-Leibler divergence between two sparsely sampled…

Data Analysis, Statistics and Probability · Physics 2023-02-24 Angelo Piga , Lluc Font-Pomarol , Marta Sales-Pardo , Roger Guimerà

The maximum likelihood method is the best-known method for estimating the probabilities behind the data. However, the conventional method obtains the probability model closest to the empirical distribution, resulting in overfitting. Then…

Machine Learning · Statistics 2023-10-03 Akihisa Ichiki

Diffusion models for continuous state spaces based on Gaussian noising processes are now relatively well understood from both practical and theoretical perspectives. In contrast, results for diffusion models on discrete state spaces remain…

Machine Learning · Computer Science 2026-04-02 Giovanni Conforti , Alain Durmus , Le-Tuyet-Nhi Pham , Gael Raoul

We consider dynamical systems evolving near an equilibrium statistical state where the interest is in modelling long term behavior that is consistent with thermodynamic constraints. We adjust the distribution using an entropy-optimizing…

Fluid Dynamics · Physics 2014-11-25 Keith Myerscough , Jason Frank , Benedict Leimkuhler

We examine the estimation of the Kullback-Leibler (KL) divergence and the use of the goodness-of-fit test for multivariate continuous distributions. Our starting point is the maximum entropy principle for Shannon entropy: among all…

Statistics Theory · Mathematics 2026-03-10 Mehmet Siddik Cadirci , Martin Singull

This paper addresses the problem of distributed detection in fixed and switching networks. A network of agents observe partially informative signals about the unknown state of the world. Hence, they collaborate with each other to identify…

Systems and Control · Computer Science 2016-01-01 Shahin Shahrampour , Alexander Rakhlin , Ali Jadbabaie

We propose a general algorithm for approximating nonstandard Bayesian posterior distributions. The algorithm minimizes the Kullback-Leibler divergence of an approximating distribution to the intractable posterior distribution. Our method…

Computation · Statistics 2014-07-29 Tim Salimans , David A. Knowles

We consider the problem of learning a discrete distribution in the presence of an $\epsilon$ fraction of malicious data sources. Specifically, we consider the setting where there is some underlying distribution, $p$, and each data source…

Machine Learning · Computer Science 2017-11-23 Mingda Qiao , Gregory Valiant

We consider a two-level discrete-time control framework with real-time constraints where a central controller issues setpoints to be implemented by local controllers. The local controllers implement the setpoints with some approximation and…

Optimization and Control · Mathematics 2016-12-22 Andrey Bernstein , Niek J. Bouman , Jean-Yves Le Boudec

This work develops a distributed optimization strategy with guaranteed exact convergence for a broad class of left-stochastic combination policies. The resulting exact diffusion strategy is shown in Part II to have a wider stability range…

Optimization and Control · Mathematics 2017-12-05 Kun Yuan , Bicheng Ying , Xiaochuan Zhao , Ali H. Sayed

We consider a distributed learning setup where a network of agents sequentially access realizations of a set of random variables with unknown distributions. The network objective is to find a parametrized distribution that best describes…

Optimization and Control · Mathematics 2016-05-10 Angelia Nedić , Alex Olshevsky , César Uribe

We revisit the classical problem of estimating an unknown distribution from its samples by fitting a mixture model that minimizes cross-entropy loss. Framing the task as a stochastic convex optimization problem over the space of $ M…

Machine Learning · Statistics 2026-05-26 Mohammadreza Ahmadypour , Tara Javidi , Farinaz Koushanfar

We consider a linear-quadratic elliptic optimal control problem with point evaluations of the state variable in the cost functional. The state variable is discretized by conforming linear finite elements. For control discretization, three…

Numerical Analysis · Mathematics 2018-02-09 Niklas Behringer , Dominik Meidner , Boris Vexler

We present a novel approach to estimating discrete distributions with (potentially) infinite support in the total variation metric. In a departure from the established paradigm, we make no structural assumptions whatsoever on the sampling…

Statistics Theory · Mathematics 2020-10-16 Doron Cohen , Aryeh Kontorovich , Geoffrey Wolfer

We introduce a new information-theoretic formulation of quantum measurement uncertainty relations, based on the notion of relative entropy between measurement probabilities. In the case of a finite-dimensional system and for any approximate…

Mathematical Physics · Physics 2018-03-02 Alberto Barchielli , Matteo Gregoratti , Alessandro Toigo

We consider the parameter estimation problem of a probabilistic generative model prescribed using a natural exponential family of distributions. For this problem, the typical maximum likelihood estimator usually overfits under limited…

Machine Learning · Statistics 2020-10-13 Viet Anh Nguyen , Xuhui Zhang , Jose Blanchet , Angelos Georghiou

We consider the numerical solution of coupled volume-surface reaction-diffusion systems having a detailed balance equilibrium. Based on the conservation of mass, an appropriate quadratic entropy functional is identified and an…

Numerical Analysis · Mathematics 2015-11-04 Herbert Egger , Klemens Fellner , Jan-Frederik Pietschmann , Bao Quoc Tang

The discrete moment problem is a foundational problem in distribution-free robust optimization, where the goal is to find a worst-case distribution that satisfies a given set of moments. This paper studies the discrete moment problems with…

Optimization and Control · Mathematics 2017-08-08 Xi Chen , Simai He , Bo Jiang , Christopher Thomas Ryan , Teng Zhang

In this paper we propose a new deterministic approximation method, called discretization approximation, for Bayesian computation. Discretization approximation is very simple to understand and to implement, It only requires calculating…

Computation · Statistics 2026-01-13 Shifeng Xiong

What is the fastest possible "diffusion"? A trivial answer would be "a process that converts a Dirac delta-function into a uniform distribution infinitely fast". Below, we consider a more reasonable formulation: a process that maximizes…

Statistical Mechanics · Physics 2025-10-10 Vasili Baranau