English
Related papers

Related papers: An Efficient 1 Iteration Learning Algorithm for Ga…

200 papers

We present an approach for continual learning (CL) that is based on fully probabilistic (or generative) models of machine learning. In contrast to, e.g., GANs that are "generative" in the sense that they can generate samples, fully…

Machine Learning · Computer Science 2021-04-20 Benedikt Pfülb , Alexander Gepperth , Benedikt Bagus

In this letter, we propose a Gaussian mixture model (GMM)-based channel estimator which is learned on imperfect training data, i.e., the training data are solely comprised of noisy and sparsely allocated pilot observations. In a practical…

Signal Processing · Electrical Eng. & Systems 2023-02-14 Benedikt Fesl , Nurettin Turan , Michael Joham , Wolfgang Utschick

This work introduces a novel probabilistic deep learning technique called deep Gaussian mixture ensembles (DGMEs), which enables accurate quantification of both epistemic and aleatoric uncertainty. By assuming the data generating process…

Machine Learning · Statistics 2023-06-13 Yousef El-Laham , Niccolò Dalmasso , Elizabeth Fons , Svitlana Vyetrenko

We introduce a Gaussian Prototype Layer for gradient-based prototype learning and demonstrate two novel network architectures for explainable segmentation one of which relies on region proposals. Both models are evaluated on agricultural…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Michael Gerstenberger , Steffen Maaß , Peter Eisert , Sebastian Bosse

Gaussian Mixture Models (GMMs) range among the most frequently used models in machine learning. However, training large, general GMMs becomes computationally prohibitive for datasets that have many data points $N$ of high-dimensionality…

Machine Learning · Statistics 2025-12-12 Sebastian Salwig , Till Kahlke , Florian Hirschberger , Dennis Forster , Jörg Lücke

Gaussian mixture models (GMMs) are ubiquitous in statistical learning, particularly for unsupervised problems. While full GMMs suffer from the overparameterization of their covariance matrices in high-dimensional spaces, spherical GMMs…

Machine Learning · Statistics 2025-11-10 Tom Szwagier , Pierre-Alexandre Mattei , Charles Bouveyron , Xavier Pennec

This work presents a novel algorithm that integrates a data-efficient function approximator with reinforcement learning in continuous state spaces. An online and incremental algorithm capable of learning from a single pass through data,…

Machine Learning · Computer Science 2020-11-03 Rafael Pinto

The learning of Gaussian Mixture Models (also referred to simply as GMMs) plays an important role in machine learning. Known for their expressiveness and interpretability, Gaussian mixture models have a wide range of applications, from…

Machine Learning · Computer Science 2023-07-14 Ruichong Zhang

Expectation-Maximization (EM) algorithm is a widely used iterative algorithm for computing (local) maximum likelihood estimate (MLE). It can be used in an extensive range of problems, including the clustering of data based on the Gaussian…

Machine Learning · Statistics 2023-03-28 Pierre Houdouin , Esa Ollila , Frederic Pascal

The Expectation-Maximization (EM) algorithm is a widely used method for maximum likelihood estimation in models with latent variables. For estimating mixtures of Gaussians, its iteration can be viewed as a soft version of the k-means…

Machine Learning · Statistics 2017-06-06 Constantinos Daskalakis , Christos Tzamos , Manolis Zampetakis

We present a graph-regularized learning of Gaussian Mixture Models (GMMs) in distributed settings with heterogeneous and limited local data. The method exploits a provided similarity graph to guide parameter sharing among nodes, avoiding…

Machine Learning · Computer Science 2025-09-18 Shamsiiat Abdurakhmanova , Alex Jung

Unlike their conventional use as estimators of probability density functions in reinforcement learning (RL), this paper introduces a novel function-approximation role for Gaussian mixture models (GMMs) as direct surrogates for Q-function…

Machine Learning · Computer Science 2025-12-23 Minh Vu , Konstantinos Slavakis

This paper investigates Gaussian copula mixture models (GCMM), which are an extension of Gaussian mixture models (GMM) that incorporate copula concepts. The paper presents the mathematical definition of GCMM and explores the properties of…

Machine Learning · Computer Science 2023-05-25 Ke Wan , Alain Kornhauser

Gaussian Mixture Models are one of the most studied and mature models in unsupervised learning. However, outliers are often present in the data and could influence the cluster estimation. In this paper, we study a new model that assumes…

Machine Learning · Statistics 2020-03-24 Sida Liu , Adrian Barbu

We develop here a semiparametric Gaussian mixture model (SGMM) for unsupervised learning with valuable spatial information taken into consideration. Specifically, we assume for each instance a random location. Then, conditional on this…

Methodology · Statistics 2025-10-21 Baichen Yu , Jin Liu , Hansheng Wang

This paper considers the problem of networks reconstruction from heterogeneous data using a Gaussian Graphical Mixture Model (GGMM). It is well known that parameter estimation in this context is challenging due to large numbers of variables…

Machine Learning · Statistics 2013-10-08 Anani Lotsi , Ernst Wit

Gaussian Mixture Models are a powerful tool in Data Science and Statistics that are mainly used for clustering and density approximation. The task of estimating the model parameters is in practice often solved by the Expectation…

Machine Learning · Statistics 2022-08-25 Lena Sembach , Jan Pablo Burgard , Volker H. Schulz

Learning parameters from voluminous data can be prohibitive in terms of memory and computational requirements. We propose a "compressive learning" framework where we estimate model parameters from a sketch of the training data. This sketch…

Machine Learning · Computer Science 2017-05-08 Nicolas Keriven , Anthony Bourrier , Rémi Gribonval , Patrick Pérez

Learning Gaussian Mixture Models (GMMs) is a fundamental problem in machine learning, with the Expectation-Maximization (EM) algorithm and its popular variant gradient EM being arguably the most widely used algorithms in practice. In the…

Machine Learning · Computer Science 2025-06-10 Mo Zhou , Weihang Xu , Maryam Fazel , Simon S. Du

Channel estimation in quantized systems is challenging, particularly in low-resolution systems. In this work, we propose to leverage a Gaussian mixture model (GMM) as generative prior, capturing the channel distribution of the propagation…

Signal Processing · Electrical Eng. & Systems 2024-05-07 Benedikt Fesl , Aziz Banna , Wolfgang Utschick