English
Related papers

Related papers: Bounds on Variance for Unimodal Distributions

200 papers

We propose a criterion of equidistribution by the differentiability of certain arithmetic invariants. Combined with the slope method and the asymptotic measures, this criterion gives a new "conceptual" proof to equidistribution results…

Algebraic Geometry · Mathematics 2008-12-19 Huayi Chen

For a closed-loop control system with a digital channel between the sensor and the controller, the notion of invariance entropy quantifies the smallest average rate of information transmission above which a given compact subset of the state…

Systems and Control · Electrical Eng. & Systems 2020-04-13 Mahendra Singh Tomar , Christoph Kawan , Pushpak Jagtap , Majid Zamani

We establish the limiting spectral distribution of Kendall's correlation matrices in the moderate high-dimensional regime where the dimension grows slower than the sample size. Our framework allows observations to be independent but not…

Statistics Theory · Mathematics 2026-03-10 Raunak Shevade , Monika Bhattacharjee

The statistics and machine learning communities have recently seen a growing interest in classification-based approaches to two-sample testing. The outcome of a classification-based two-sample test remains a rejection decision, which is not…

Statistics Theory · Mathematics 2022-11-15 Loris Michel , Jeffrey Näf , Nicolai Meinshausen

We consider the problem of estimating the support size of a distribution $D$. Our investigations are pursued through the lens of distribution testing and seek to understand the power of conditional sampling (denoted as COND), wherein one is…

Data Structures and Algorithms · Computer Science 2022-11-23 Diptarka Chakraborty , Gunjan Kumar , Kuldeep S. Meel

In this paper, we provide bounds on the asymptotic variance for a class of sequential Monte Carlo (SMC) samplers designed for approximating multimodal distributions. Such methods combine standard SMC methods and Markov chain Monte Carlo…

Probability · Mathematics 2018-01-25 Daniel Paulin , Ajay Jasra , Alexandre Thiery

In this thesis, we provide an initial investigation into bounds for topological entropy of switched linear systems. Entropy measures, roughly, the information needed to describe the behavior of a system with finite precision on finite time…

Optimization and Control · Mathematics 2016-10-14 James Schmidt

Kernel embeddings of distributions and the Maximum Mean Discrepancy (MMD), the resulting distance between distributions, are useful tools for fully nonparametric two-sample testing and learning on distributions. However, it is rarely that…

Machine Learning · Statistics 2017-11-07 Ho Chung Leon Law , Christopher Yau , Dino Sejdinovic

We define the entropic bounds, i.e minimal uncertainty for pairs of unitary testers in distinguishing between unitary transformations not unlike the well known entropic bounds for observables. We show that in the case of specific sets of…

Quantum Physics · Physics 2021-03-16 Jesni Shamsul Shaari , Stefano Mancini

The entropy power inequality (EPI) and the Brascamp-Lieb inequality (BLI) are fundamental inequalities concerning the differential entropies of linear transformations of random vectors. The EPI provides lower bounds for the differential…

Information Theory · Computer Science 2021-09-28 Venkat Anantharam , Varun Jog , Chandra Nair

A marginal problem asks whether a given family of marginal distributions for some set of random variables arises from some joint distribution of these variables. Here we point out that the existence of such a joint distribution imposes…

Information Theory · Computer Science 2013-01-25 Tobias Fritz , Rafael Chaves

This work presents an upper-bound to value that the Kullback-Leibler (KL) divergence can reach for a class of probability distributions called quantum distributions (QD). The aim is to find a distribution $U$ which maximizes the KL…

Machine Learning · Computer Science 2020-12-11 Vincenzo Bonnici

Much of uncertainty quantification to date has focused on determining the effect of variables modeled probabilistically, and with a known distribution, on some physical or engineering system. We develop methods to obtain information on the…

Numerical Analysis · Mathematics 2015-03-19 Kamaljit Chowdhary , Paul Dupuis

Over the past ten years, propensity score methods have made an important contribution to improving generalizations from studies that do not select samples randomly from a population of inference. However, these methods require assumptions…

Methodology · Statistics 2021-01-26 Wendy Chan

We extend previously proposed measures of complexity, emergence, and self-organization to continuous distributions using differential entropy. This allows us to calculate the complexity of phenomena for which distributions are known. We…

Adaptation and Self-Organizing Systems · Physics 2016-04-01 Guillermo Santamaría-Bonfil , Nelson Fernández , Carlos Gershenson

We compute the limit distribution of partial transposes (when both the number and the size of blocks tends to infinity) for a large class of ensembles of unitarily invariant random matrices. Furthermore, it is shown the asymptotic freeness…

Probability · Mathematics 2024-05-28 James A. Mingo , Mihai Popa

We derive a lower bound on the smallest output entropy that can be achieved via vector quantization of a $d$-dimensional source with given expected $r$th-power distortion. Specialized to the one-dimensional case, and in the limit of…

Information Theory · Computer Science 2017-03-27 Tobias Koch , Gonzalo Vazquez-Vilar

Language models famously improve under a smooth scaling law, but some specific capabilities exhibit sudden breakthroughs in performance. Advocates of "emergence" view these capabilities as unlocked at a specific scale, but others attribute…

Machine Learning · Computer Science 2026-02-19 Rosie Zhao , Tian Qin , David Alvarez-Melis , Sham Kakade , Naomi Saphra

We introduce a new discrepancy score between two distributions that gives an indication on their similarity. While much research has been done to determine if two samples come from exactly the same distribution, much less research…

Machine Learning · Computer Science 2012-10-16 Maayan Harel , Shie Mannor

Diffusion of a particle in the N-dimensional external potential which is periodic in one dimension and unbounded in the other N-1 dimensions is investigated. We find an analytical expression for the overdamped diffusion and study…

Statistical Mechanics · Physics 2016-08-31 O. M. Braun