English
Related papers

Related papers: Minimum relative entropy distributions with a larg…

200 papers

If the prior probability distributions of all possible hypothetical true means and all possible observed means of a continuous variable are conditional on the universal set of all numbers (i.e., before the nature of a study is known and a…

Methodology · Statistics 2025-06-05 Huw Llewelyn

A finite quantum system evolving unitarily equilibrates in a probabilistic fashion. In the general many-body setting the time-fluctuations of an observable \mathcal{A} are typically exponentially small in the system size. We consider here…

Statistical Mechanics · Physics 2013-01-22 Lorenzo Campos Venuti , Paolo Zanardi

We show that the naive application of the maximum entropy principle can yield answers which depend on the level of description, i.e. the result is not invariant under coarse-graining. We demonstrate that the correct approach, even for…

Statistical Mechanics · Physics 2007-05-23 Jayanth Banavar , Amos Maritan

Supplement 1 to GUM (GUM-S1) recommends the use of maximum entropy principle (MaxEnt) in determining the probability distribution of a quantity having specified properties, e.g., specified central moments. When we only know the mean value…

Data Analysis, Statistics and Probability · Physics 2012-07-20 Stefano Olivares , Matteo G. A. Paris

The method of maximum entropy is quite a powerful tool to solve the generalized moment problem, which consists of determining the probability density of a random variable X from the knowledge of the expected values of a few functions of the…

Statistics Theory · Mathematics 2015-10-15 Henryk Gzyl

The classical problem of moments is addressed by the maximum entropy approach for one-dimensional discrete distributions. The numerical technique of adaptive support approximation is proposed to reconstruct the distributions in the region…

Numerical Analysis · Mathematics 2014-09-02 Alexander Andreychenko , Linar Mikeev , Verena Wolf

In this note, we provide an overarching analysis of primal-dual dynamics associated to linear equality-constrained optimization problems using contraction analysis. For the well-known standard version of the problem: we establish…

Systems and Control · Electrical Eng. & Systems 2021-06-22 Pedro Cisneros-Velarde , Saber Jafarpour , Francesco Bullo

Maximum-Entropy Distributions offer an attractive family of probability densities suitable for moment closure problems. Yet finding the Lagrange multipliers which parametrize these distributions, turns out to be a computational bottleneck…

Machine Learning · Statistics 2023-08-14 Mohsen Sadr , Manuel Torrilhon , M. Hossein Gorji

We consider the problem of distributedly estimating Gaussian processes in multi-agent frameworks. Each agent collects few measurements and aims to collaboratively reconstruct a common estimate based on all data. Agents are assumed with…

Multiagent Systems · Computer Science 2018-05-11 Gianluigi Pillonetto , Luca Schenato , Damiano Varagnolo

For a system consisting of several Dirac fields and a particle, we study the Cauchy problem with random initial data. We assume that the initial measure has zero mean value, a finite mean charge density, a translation-invariant covariance…

Mathematical Physics · Physics 2025-04-23 T. V. Dudnikova

The trimmed mean of $n$ scalar random variables from a distribution $P$ is the variant of the standard sample mean where the $k$ smallest and $k$ largest values in the sample are discarded for some parameter $k$. In this paper, we look at…

Statistics Theory · Mathematics 2025-01-08 Roberto I. Oliveira , Paulo Orenstein , Zoraida F. Rico

We develop the argument that the Gibbs-von Neumann entropy is the appropriate statistical mechanical generalisation of the thermodynamic entropy, for macroscopic and microscopic systems, whether in thermal equilibrium or not, as a…

Quantum Physics · Physics 2008-01-23 O. J. E. Maroney

We propose a general framework for solving quantum state estimation problems using the minimum relative entropy criterion. A convex optimization approach allows us to decide the feasibility of the problem given the data and, whenever…

Quantum Physics · Physics 2013-01-29 Mattia Zorzi , Francesco Ticozzi , Augusto Ferrante

This paper establishes the optimal sub-Gaussian variance proxy for truncated Gaussian and truncated exponential random variables. The proofs rely on first characterizing the optimal variance proxy as the unique solution to a set of two…

Statistics Theory · Mathematics 2024-11-27 Mathias Barreto , Olivier Marchal , Julyan Arbel

In this paper, we consider asymptotics of the optimal value and the optimal solutions of parametric minimax estimation problems. Specifically, we consider estimators of the optimal value and the optimal solutions in a sample minimax problem…

Statistics Theory · Mathematics 2025-04-16 Mika Meitz , Alexander Shapiro

In the need for low assumption inferential methods in infinite-dimensional settings, Bayesian adaptive estimation via a prior distribution that does not depend on the regularity of the function to be estimated nor on the sample size is…

Methodology · Statistics 2014-09-23 Catia Scricciolo

In this paper, we study the asymptotic (large time) behavior of a selection-mutation-competition model for a population structured with respect to a phenotypic trait, when the rate of mutation is very small. We assume that the reproduction…

Analysis of PDEs · Mathematics 2015-11-17 Àngel Calsina , Sílvia Cuadrado , Laurent Desvillettes , Gaël Raoul

One way of getting insight into non-Gaussian measures, posed on infinite dimensional Hilbert spaces, is to first obtain best fit Gaussian approximations, which are more amenable to numerical approximation. These Gaussians can then be used…

Numerical Analysis · Mathematics 2019-05-23 Gideon Simpson , Daniel Watkins

We show that when the proportions of a countable set of species are organized as an exchangeable partition of the unit interval and we take a sample on it, then the Bayesian posterior entropy converges a.s. and in L^1 to the entropy of the…

Probability · Mathematics 2023-11-20 Servet Martinez

Randomized experiments are the gold standard for evaluating the effects of changes to real-world systems. Data in these tests may be difficult to collect and outcomes may have high variance, resulting in potentially large measurement error.…

Machine Learning · Statistics 2018-06-27 Benjamin Letham , Brian Karrer , Guilherme Ottoni , Eytan Bakshy