English
Related papers

Related papers: Learning a Gaussian Mixture Model from Imperfect T…

200 papers

We consider maximum likelihood estimation for Gaussian Mixture Models (Gmms). This task is almost invariably solved (in theory and practice) via the Expectation Maximization (EM) algorithm. EM owes its success to various factors, of which…

Machine Learning · Statistics 2018-06-04 Reshad Hosseini , Suvrit Sra

Retraining a model using its own predictions together with the original, potentially noisy labels is a well-known strategy for improving the model performance. While prior works have demonstrated the benefits of specific heuristic…

Machine Learning · Computer Science 2025-05-22 Adel Javanmard , Rudrajit Das , Alessandro Epasto , Vahab Mirrokni

A comparative study of the application of Gaussian Mixture Model (GMM) and Radial Basis Function (RBF) in biometric recognition of voice has been carried out and presented. The application of machine learning techniques to biometric…

Machine Learning · Computer Science 2012-11-13 Fatai Adesina Anifowose

Channel estimation is essential to massive multiple-input multiple-output (MIMO) systems. While recent generative model-based approaches using lightweight diffusion models (DMs) have achieved superior performance, they typically rely on a…

Signal Processing · Electrical Eng. & Systems 2026-05-19 Zhuorui Jiang , Jun Fang , Boyu Ning , Hongbin Li , Ying-Chang Liang

We take a new look at parameter estimation for Gaussian Mixture Models (GMMs). In particular, we propose using \emph{Riemannian manifold optimization} as a powerful counterpart to Expectation Maximization (EM). An out-of-the-box invocation…

Machine Learning · Statistics 2015-06-26 Reshad Hosseini , Suvrit Sra

Programming a robot manipulator should be as intuitive as possible. To achieve that, the paradigm of teaching motion skills by providing few demonstrations has become widely popular in recent years. Probabilistic versions thereof take into…

Robotics · Computer Science 2023-12-07 Julian Richter , João Oliveira , Christian Scheurer , Jochen Steil , Niels Dehio

We derive an asymptotic expansion for the log likelihood of Gaussian mixture models (GMMs) with equal covariance matrices in the low signal-to-noise regime. The expansion reveals an intimate connection between two types of algorithms for…

Statistics Theory · Mathematics 2020-06-30 Anya Katsevich , Afonso Bandeira

Wireless channel models are a commonly used tool for the development of wireless telecommunication systems and standards. The currently prevailing geometry-based stochastic channel models (GSCMs) were manually specified for certain…

Information Theory · Computer Science 2024-03-11 Florian Euchner , Janina Sanzi , Marcus Henninger , Stephan ten Brink

In this paper, we provide a novel method for the estimation of unknown parameters of the Gaussian Mixture Model (GMM) in Positron Emission Tomography (PET). A vast majority of PET imaging methods are based on reconstruction model that is…

Signal Processing · Electrical Eng. & Systems 2023-06-30 Tomislav Matulić , Damir Seršić

Contextual optimization enhances decision quality by leveraging side information to improve predictions of uncertain parameters. However, existing approaches face significant challenges when dealing with multimodal or mixtures of…

Optimization and Control · Mathematics 2025-09-19 YoungChul Yoon , Grani A. Hanasusanto , Yijie Wang

In this letter, we revisit the problem of maximum likelihood estimation (MLE) of parameters of Gaussian Mixture Model (GMM) and show a new derivation for its parameters. The new derivation, unlike the classical approach employing the…

Signal Processing · Electrical Eng. & Systems 2020-01-10 Nitesh Sahu , Prabhu Babu

Hyperspectral unmixing while considering endmember variability is usually performed by the normal compositional model (NCM), where the endmembers for each pixel are assumed to be sampled from unimodal Gaussian distributions. However, in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-14 Yuan Zhou , Anand Rangarajan , Paul D. Gader

We present an approach for continual learning (CL) that is based on fully probabilistic (or generative) models of machine learning. In contrast to, e.g., GANs that are "generative" in the sense that they can generate samples, fully…

Machine Learning · Computer Science 2021-04-20 Benedikt Pfülb , Alexander Gepperth , Benedikt Bagus

This paper establishes a novel role for Gaussian-mixture models (GMMs) as functional approximators of Q-function losses in reinforcement learning (RL). Unlike the existing RL literature, where GMMs play their typical role as estimates of…

Machine Learning · Computer Science 2024-09-11 Minh Vu , Konstantinos Slavakis

We consider the problem of estimating an input signal from noisy measurements in both parallel scalar Gaussian channels and linear mixing systems. The performance of the estimation process is quantified by the $\ell_\infty$ norm error…

Information Theory · Computer Science 2013-04-23 Jin Tan , Dror Baron , Liyi Dai

Variational inference with Gaussian mixture models (GMMs) enables learning of highly tractable yet multi-modal approximations of intractable target distributions with up to a few hundred dimensions. The two currently most effective methods…

Machine Learning · Computer Science 2023-07-19 Oleg Arenz , Philipp Dahlinger , Zihan Ye , Michael Volpp , Gerhard Neumann

We propose a method for estimating channel parameters from RSSI measurements and the lost packet count, which can work in the presence of losses due to both interference and signal attenuation below the noise floor. This is especially…

Machine Learning · Computer Science 2015-04-07 Silvija Kokalj-Filipovic , Larry Greenstein

Accurate channel estimation is critical for realizing the performance gains of massive multiple-input multiple-output (MIMO) systems. Traditional approaches to channel estimation typically assume ideal receiver hardware and linear signal…

Signal Processing · Electrical Eng. & Systems 2026-02-20 Arttu Arjas , Italo Atzeni

Generalised linear models for multi-class classification problems are one of the fundamental building blocks of modern machine learning tasks. In this manuscript, we characterise the learning of a mixture of $K$ Gaussians with generic means…

In order to cluster or partition data, we often use Expectation-and-Maximization (EM) or Variational approximation with a Gaussian Mixture Model (GMM), which is a parametric probability density function represented as a weighted sum of…

Machine Learning · Computer Science 2013-07-04 Ji Won Yoon