中文
相关论文

相关论文: On the Role of Channel Capacity in Learning Gaussi…

200 篇论文

We study the problem of learning general (i.e., not necessarily homogeneous) halfspaces with Random Classification Noise under the Gaussian distribution. We establish nearly-matching algorithmic and Statistical Query (SQ) lower bound…

机器学习 · 计算机科学 2023-07-18 Ilias Diakonikolas , Jelena Diakonikolas , Daniel M. Kane , Puqian Wang , Nikos Zarifis

This work focuses on optimizing the hybrid quantum noise model to improve the capacity of Gaussian quantum channels using Machine Learning (ML) generated clusters. The work specifically leverages Gaussian Mixture Model (GMM) and the…

信号处理 · 电气工程与系统科学 2025-01-24 Mouli Chakraborty , Anshu Mukherjee , Ioannis Krikidis , Avishek Nag , Subhash Chandra

Learning a Gaussian mixture model (GMM) is a fundamental problem in machine learning, learning theory, and statistics. One notion of learning a GMM is proper learning: here, the goal is to find a mixture of $k$ Gaussians $\mathcal{M}$ that…

数据结构与算法 · 计算机科学 2015-06-04 Jerry Li , Ludwig Schmidt

We study the complexity of learning mixtures of separated Gaussians with common unknown bounded covariance matrix. Specifically, we focus on learning Gaussian mixture models (GMMs) on $\mathbb{R}^d$ of the form $P= \sum_{i=1}^k w_i…

机器学习 · 计算机科学 2023-06-23 Ilias Diakonikolas , Daniel M. Kane , Thanasis Pittas , Nikos Zarifis

In this paper, we study the problem of learning a mixture of Gaussians with streaming data: given a stream of $N$ points in $d$ dimensions generated by an unknown mixture of $k$ spherical Gaussians, the goal is to estimate the model…

机器学习 · 计算机科学 2017-07-11 Aditi Raghunathan , Ravishankar Krishnaswamy , Prateek Jain

We prove that $\tilde{\Theta}(k d^2 / \varepsilon^2)$ samples are necessary and sufficient for learning a mixture of $k$ Gaussians in $\mathbb{R}^d$, up to error $\varepsilon$ in total variation distance. This improves both the known upper…

机器学习 · 计算机科学 2020-07-23 Hassan Ashtiani , Shai Ben-David , Nick Harvey , Christopher Liaw , Abbas Mehrabian , Yaniv Plan

One of the most popular algorithms for clustering in Euclidean space is the $k$-means algorithm; $k$-means is difficult to analyze mathematically, and few theoretical guarantees are known about it, particularly when the data is {\em…

机器学习 · 计算机科学 2009-12-02 Kamalika Chaudhuri , Sanjoy Dasgupta , Andrea Vattani

Efficiently learning mixture of Gaussians is a fundamental problem in statistics and learning theory. Given samples coming from a random one out of k Gaussian distributions in Rn, the learning problem asks to estimate the means and the…

机器学习 · 计算机科学 2015-03-11 Rong Ge , Qingqing Huang , Sham M. Kakade

This paper analyzes the convergence and generalization of training a one-hidden-layer neural network when the input features follow the Gaussian mixture model consisting of a finite number of Gaussian distributions. Assuming the labels are…

机器学习 · 计算机科学 2023-01-30 Hongkang Li , Shuai Zhang , Meng Wang

We study the complexity of learning $k$-mixtures of Gaussians ($k$-GMMs) on $\mathbb{R}^d$. This task is known to have complexity $d^{\Omega(k)}$ in full generality. To circumvent this exponential lower bound on the number of components,…

机器学习 · 计算机科学 2025-04-22 Ilias Diakonikolas , Daniel M. Kane , Sushrut Karmalkar , Jasper C. H. Lee , Thanasis Pittas

In this paper, we study the problem of learning multi-dimensional Gaussian Mixture Models (GMMs), with a specific focus on model order selection and efficient mixing distribution estimation. We first establish an information-theoretic lower…

机器学习 · 统计学 2026-03-23 Xinyu Liu , Hai Zhang

In this letter, we propose a Gaussian mixture model (GMM)-based channel estimator which is learned on imperfect training data, i.e., the training data are solely comprised of noisy and sparsely allocated pilot observations. In a practical…

信号处理 · 电气工程与系统科学 2023-02-14 Benedikt Fesl , Nurettin Turan , Michael Joham , Wolfgang Utschick

We describe a general technique that yields the first {\em Statistical Query lower bounds} for a range of fundamental high-dimensional learning problems involving Gaussian distributions. Our main results are for the problems of (1) learning…

机器学习 · 计算机科学 2017-05-18 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

In this paper, we find a sample complexity bound for learning a simplex from noisy samples. Assume a dataset of size $n$ is given which includes i.i.d. samples drawn from a uniform distribution over an unknown simplex in $\mathbb{R}^K$,…

机器学习 · 统计学 2023-05-02 Amir Hossein Saberi , Amir Najafi , Seyed Abolfazl Motahari , Babak H. Khalaj

A novel Gaussian mixture model (GMM) aided sparse Bayesian learning (SBL) framework is proposed for channel state information (CSI) estimation in orthogonal time-frequency space (OTFS) modulated systems. The key attribute of the proposed…

信号处理 · 电气工程与系统科学 2026-03-31 Surbhi Gehlot , Suraj Srivastava , Sandeep Kumar Yadav , Lajos Hanzo

In this work, we propose variations of a Gaussian mixture model (GMM) based channel estimator that was recently proven to be asymptotically optimal in the minimum mean square error (MMSE) sense. We account for the need of low computational…

信息论 · 计算机科学 2023-06-06 Benedikt Fesl , Michael Joham , Sha Hu , Michael Koller , Nurettin Turan , Wolfgang Utschick

The problem of learning a channel decoder is considered for two channel models. The first model is an additive noise channel whose noise distribution is unknown and nonparametric. The learner is provided with a fixed codebook and a dataset…

信息论 · 计算机科学 2023-02-17 Amit Tsvieli , Nir Weinberger

This paper studies the decentralized learning of tree-structured Gaussian graphical models (GGMs) from noisy data. In decentralized learning, data set is distributed across different machines (sensors), and GGMs are widely used to model…

机器学习 · 计算机科学 2021-09-23 Akram Hussain

The learning of mixture models can be viewed as a clustering problem. Indeed, given data samples independently generated from a mixture of distributions, we often would like to find the {\it correct target clustering} of the samples…

机器学习 · 统计学 2022-08-26 Zhaoqiang Liu , Vincent Y. F. Tan

We give a new algorithm for learning mixtures of $k$ Gaussians (with identity covariance in $\mathbb{R}^n$) to TV error $\varepsilon$, with quasi-polynomial ($O(n^{\text{poly\,log}\left(\frac{n+k}{\varepsilon}\right)})$) time and sample…

机器学习 · 计算机科学 2025-03-05 Khashayar Gatmiry , Jonathan Kelner , Holden Lee
‹ 上一页 1 2 3 10 下一页 ›