English
Related papers

Related papers: Gaussian Mixture Identifiability from degree 6 Mom…

200 papers

We study the problem of list-decodable Gaussian mean estimation and the related problem of learning mixtures of separated spherical Gaussians. We develop a set of techniques that yield new efficient algorithms with significantly improved…

Data Structures and Algorithms · Computer Science 2017-11-21 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

We prove that $\tilde{\Theta}(k d^2 / \varepsilon^2)$ samples are necessary and sufficient for learning a mixture of $k$ Gaussians in $\mathbb{R}^d$, up to error $\varepsilon$ in total variation distance. This improves both the known upper…

Machine Learning · Computer Science 2020-07-23 Hassan Ashtiani , Shai Ben-David , Nick Harvey , Christopher Liaw , Abbas Mehrabian , Yaniv Plan

The question of polynomial learnability of probability distributions, particularly Gaussian mixture distributions, has recently received significant attention in theoretical computer science and machine learning. However, despite major…

Machine Learning · Computer Science 2010-05-13 Mikhail Belkin , Kaushik Sinha

Gaussian mixture models are widely used in Statistics. A fundamental aspect of these distributions is the study of the local maxima of the density, or modes. In particular, it is not known how many modes a mixture of $k$ Gaussians in $d$…

Statistics Theory · Mathematics 2019-07-22 Carlos Améndola , Alexander Engström , Christian Haase

An open problem that is widely regarded as one of the most important in quantum query complexity is to resolve the quantum query complexity of the k-distinctness function on inputs of size N. While the case of k=2 (also called Element…

Quantum Physics · Physics 2023-03-15 Nikhil S. Mande , Justin Thaler , Shuchen Zhu

The Gaussian mixture model is a classic technique for clustering and data modeling that is used in numerous applications. With the rise of big data, there is a need for parameter estimation techniques that can handle streaming data and…

Artificial Intelligence · Computer Science 2016-09-20 Priyank Jaini , Pascal Poupart

We consider the problem of estimating the parameters a Gaussian Mixture Model with K components of known weights, all with an identity covariance matrix. We make two contributions. First, at the population level, we present a sharper…

Machine Learning · Computer Science 2021-09-24 Nimrod Segol , Boaz Nadler

Mixtures of high dimensional Gaussian distributions have been studied extensively in statistics and learning theory. While the total variation distance appears naturally in the sample complexity of distribution learning, it is analytically…

Probability · Mathematics 2022-03-11 Sami Davies , Arya Mazumdar , Soumyabrata Pal , Cyrus Rashtchian

We study linear chance-constrained problems where the coefficients follow a Gaussian mixture distribution. We provide mixed-binary quadratic programs that give inner and outer approximations of the chance constraint based on piecewise…

Optimization and Control · Mathematics 2025-11-24 Shibshankar Dey , Sanjay Mehrotra , Anirudh Subramanyam

The use of a finite mixture of normal distributions in model-based clustering allows to capture non-Gaussian data clusters. However, identifying the clusters from the normal components is challenging and in general either achieved by…

Methodology · Statistics 2016-06-21 Gertraud Malsiner-Walli , Sylvia Frühwirth-Schnatter , Bettina Grün

An identifying code is a subset of vertices of a graph such that each vertex is uniquely determined by its neighbourhood within the identifying code. If $\M(G)$ denotes the minimum size of an identifying code of a graph $G$, it was…

Discrete Mathematics · Computer Science 2012-09-24 Florent Foucaud , Guillem Perarnau

We study truncated moment sequences of distribution mixtures, especially from Gaussian and log-normal distributions and their Carath\'eodory numbers. For $\mathsf{A} = \{a_1,\dots,a_m\}$ continuous (sufficiently differentiable) functions on…

Probability · Mathematics 2019-07-01 Philipp J. di Dio

We consider the problem of efficiently learning mixtures of a large number of spherical Gaussians, when the components of the mixture are well separated. In the most basic form of this problem, we are given samples from a uniform mixture of…

Data Structures and Algorithms · Computer Science 2017-11-01 Oded Regev , Aravindan Vijayaraghavan

We study the problem of learning mixtures of Gaussians with approximate differential privacy. We prove that roughly $kd^2 + k^{1.5} d^{1.75} + k^2 d$ samples suffice to learn a mixture of $k$ arbitrary $d$-dimensional Gaussians up to low…

Machine Learning · Computer Science 2024-11-05 Hassan Ashtiani , Mahbod Majid , Shyam Narayanan

We uncover a hidden Gaussian ensemble inside each of the three circular ensembles of random matrices, which provide novel diagrammatic rules for the calculation of moments. The matrices involved are generic complex for $\beta=2$, complex…

Mathematical Physics · Physics 2023-06-14 Marcel Novaes

We give an efficient algorithm for robustly clustering of a mixture of two arbitrary Gaussians, a central open problem in the theory of computationally efficient robust estimation, assuming only that the the means of the component Gaussians…

Data Structures and Algorithms · Computer Science 2020-06-02 He Jia , Santosh Vempala

We prove that the the mixing time of the Glauber dynamics for sampling independent sets on $n$-vertex $k$-uniform hypergraphs is $O(n\log n)$ when the maximum degree $\Delta$ satisfies $\Delta \leq c 2^{k/2}$, improving on the previous…

Probability · Mathematics 2019-12-25 Jonathan Hermon , Allan Sly , Yumeng Zhang

We consider the problem of identifying, from its first $m$ noisy moments, a probability distribution on $[0,1]$ of support $k<\infty$. This is equivalent to the problem of learning a distribution on $m$ observable binary random variables…

Machine Learning · Computer Science 2020-09-08 Spencer Gordon , Bijan Mazaheri , Leonard J. Schulman , Yuval Rabani

Let $G$ be an intersection graph of $n$ geometric objects in the plane. We show that a maximum matching in $G$ can be found in $O(\rho^{3\omega/2}n^{\omega/2})$ time with high probability, where $\rho$ is the density of the geometric…

Computational Geometry · Computer Science 2024-05-02 Édouard Bonnet , Sergio Cabello , Wolfgang Mulzer

We show that a collection of Gaussian mixture models (GMMs) in $R^{n}$ can be optimally classified using $O(n)$ neurons in a neural network with two hidden layers (deep neural network), whereas in contrast, a neural network with a single…

Machine Learning · Computer Science 2019-02-18 Shirin Jalali , Carl Nuzman , Iraj Saniee