English
Related papers

Related papers: How Many Modes Can a Mixture of Gaussians with Uni…

200 papers

We study the problem of learning mixtures of Gaussians with censored data. Statistical learning with censored data is a classical problem, with numerous practical applications, however, finite-sample guarantees for even simple latent…

Machine Learning · Computer Science 2023-06-30 Wai Ming Tai , Bryon Aragam

We consider a high-dimensional mean estimation problem over a binary hidden Markov model, which illuminates the interplay between memory in data, sample size, dimension, and signal strength in statistical inference. In this model, an…

Statistics Theory · Mathematics 2022-10-13 Yihan Zhang , Nir Weinberger

We investigate mappings $F = (f_1, f_2) \colon \mathbb{R}^2 \to \mathbb{R}^2 $ where $ f_1, f_2 $ are bivariate normal densities from the perspective of singularity theory of mappings, motivated by the need to understand properties of…

Statistics Theory · Mathematics 2025-03-11 Yutaro Kabata , Hirotaka Matsumoto , Seiichi Uchida , Masao Ueki

We consider estimating the parameters of a Gaussian mixture density with a given number of components best representing a given set of weighted samples. We adopt a density interpretation of the samples by viewing them as a discrete Dirac…

Machine Learning · Statistics 2025-04-03 Daniel Frisch , Uwe D. Hanebeck

(2+1)-dimensional Georgi-Glashow model is explored in the regime when the Higgs boson is not infinitely heavy, but its mass is rather of the same order of magnitude as the mass of the W boson. In the weak-coupling limit, the Debye mass of…

High Energy Physics - Theory · Physics 2009-11-07 Dmitri Antonov

This paper derives fundamental limits on the performance of compressive classification when the source is a mixture of Gaussians. It provides an asymptotic analysis of a Bhattacharya based upper bound on the misclassification probability…

Information Theory · Computer Science 2014-01-28 Hugo Reboredo , Francesco Renna , Robert Calderbank , Miguel R. D. Rodrigues

Mixtures of high dimensional Gaussian distributions have been studied extensively in statistics and learning theory. While the total variation distance appears naturally in the sample complexity of distribution learning, it is analytically…

Probability · Mathematics 2022-03-11 Sami Davies , Arya Mazumdar , Soumyabrata Pal , Cyrus Rashtchian

We study the problem of learning mixtures of Gaussians with approximate differential privacy. We prove that roughly $kd^2 + k^{1.5} d^{1.75} + k^2 d$ samples suffice to learn a mixture of $k$ arbitrary $d$-dimensional Gaussians up to low…

Machine Learning · Computer Science 2024-11-05 Hassan Ashtiani , Mahbod Majid , Shyam Narayanan

We resolve most cases of identifiability from sixth-order moments for Gaussian mixtures on spaces of large dimensions. Our results imply that the parameters of a generic mixture of $ m\leq\mathcal{O}(n^4) $ Gaussians on $ \mathbb R^n $ can…

Algebraic Geometry · Mathematics 2024-12-11 Alexander Taveira Blomenhofer

In this paper, we study Eulerian polynomials for permutations and signed permutations of the multiset $\{1,1,2,2,\ldots,n,n\}$. Properties of these polynomials, including recurrence relations and unimodality are discussed. In particular, we…

Combinatorics · Mathematics 2021-03-09 Shi-Mei Ma , Jun Ma , Yeong-Nan Yeh

The following anticoncentration property is proved. The probability that the $k$-order statistic of an arbitrarily correlated jointly Gaussian random vector $X$ with unit variance components lies within an interval of length $\varepsilon$…

Statistics Theory · Mathematics 2021-07-23 Damian Kozbur

We prove that $\tilde{\Theta}(k d^2 / \varepsilon^2)$ samples are necessary and sufficient for learning a mixture of $k$ Gaussians in $\mathbb{R}^d$, up to error $\varepsilon$ in total variation distance. This improves both the known upper…

Machine Learning · Computer Science 2020-07-23 Hassan Ashtiani , Shai Ben-David , Nick Harvey , Christopher Liaw , Abbas Mehrabian , Yaniv Plan

The total variation distance is a core statistical distance between probability measures that satisfies the metric axioms, with value always falling in $[0,1]$. This distance plays a fundamental role in machine learning and signal…

Machine Learning · Computer Science 2018-07-02 Frank Nielsen , Ke Sun

A variational method that allows for replica-symmetry breaking is applied to directed polymers in an (N+1)-dimensional disordered medium. The noise studied here has gaussian correlations, i.e. it is short-ranged. In dimensions N<2, the…

Condensed Matter · Physics 2007-05-23 T. Blum

We address the question of the multiplicativity of the maximal p-norm output purities of bosonic Gaussian channels under Gaussian inputs. We focus on general Gaussian channels resulting from the reduction of unitary dynamics in larger…

Quantum Physics · Physics 2009-11-10 A. Serafini , J. Eisert , M. M. Wolf

We derive novel anti-concentration bounds for the difference between the maximal values of two Gaussian random vectors across various settings. Our bounds are dimension-free, scaling with the dimension of the Gaussian vectors only through…

Statistics Theory · Mathematics 2024-08-27 Alexandre Belloni , Ethan X. Fang , Shuting Shen

We study an intermittent map which has exactly two ergodic invariant densities. The densities are supported on two subintervals with a common boundary point. Due to certain perturbations, leakage of mass through subsets, called holes, of…

Dynamical Systems · Mathematics 2015-05-28 Wael Bahsoun , Sandro Vaienti

The paper concerns a particular example of the Gibbs sampler and its mixing efficiency. Coordinates of a point are rerandomized in the unit square $[0,1]^2$ to approach a stationary distribution with density proportional to…

Probability · Mathematics 2018-10-09 Balázs Gerencsér

The likelihood function of a finite mixture model is a non-convex function with multiple local maxima and commonly used iterative algorithms such as EM will converge to different solutions depending on initial conditions. In this paper we…

Machine Learning · Computer Science 2016-08-19 Elad Mezuman , Yair Weiss

The q-Gaussians are discussed from the point of view of variance mixtures of normals and exchangeability. For each q< 3, there is a q-Gaussian distribution that maximizes the Tsallis entropy under suitable constraints. This paper shows that…

Probability · Mathematics 2015-05-14 Marjorie G. Hahn , Xinxin Jiang , Sabir Umarov