English
Related papers

Related papers: A Stochastic Path-Integrated Differential Estimato…

200 papers

Many real-world problems, such as those with fairness constraints, involve complex expectation constraints and large datasets, necessitating the design of efficient stochastic methods to solve them. Most existing research focuses on cases…

Optimization and Control · Mathematics 2025-09-11 Wei Liu , Yangyang Xu

The Expectation--Maximization (EM) algorithm is a simple meta-algorithm that has been used for many years as a methodology for statistical inference when there are missing measurements in the observed data or when the data is composed of…

Machine Learning · Statistics 2022-11-15 Hideitsu Hino , Shotaro Akaho , Noboru Murata

Data assimilation methods aim at estimating the state of a system by combining observations with a physical model. When sequential data assimilation is considered, the joint distribution of the latent state and the observations is described…

Methodology · Statistics 2018-04-23 Thi Tuyet Trang Chau , Pierre Ailliot , Valérie Monbet , Pierre Tandeo

In this paper, we study the problem of estimating latent variable models with arbitrarily corrupted samples in high dimensional space ({\em i.e.,} $d\gg n$) where the underlying parameter is assumed to be sparse. Specifically, we propose a…

Machine Learning · Statistics 2020-10-20 Di Wang , Xiangyu Guo , Shi Li , Jinhui Xu

The expectation-maximization (EM) algorithm is an iterative computational method to calculate the maximum likelihood estimators (MLEs) from the sample data. It converts a complicated one-time calculation for the MLE of the incomplete data…

Computation · Statistics 2016-08-08 Lingyao Meng

Expectation-Maximization (EM) algorithm is a widely used iterative algorithm for computing maximum likelihood estimate when dealing with Gaussian Mixture Model (GMM). When the sample size is smaller than the data dimension, this could lead…

Machine Learning · Statistics 2023-07-06 Pierre Houdouin , Matthieu Jonkcheere , Frederic Pascal

We study estimation of large Dynamic Factor models implemented through the Expectation Maximization (EM) algorithm, jointly with the Kalman smoother. We prove that as both the cross-sectional dimension, $n$, and the sample size, $T$,…

Statistics Theory · Mathematics 2024-09-26 Matteo Barigozzi , Matteo Luciani

Expectation maximisation (EM) is usually thought of as an unsupervised learning method for estimating the parameters of a mixture distribution, however it can also be used for supervised learning when class labels are available. As such, EM…

Machine Learning · Computer Science 2022-06-01 Graham W. Pulford

The paper proposes a systematic framework for building data-driven stochastic differential equation (SDE) models from sparse, noisy observations. Unlike traditional parametric approaches, which assume a known functional form for the drift,…

Machine Learning · Statistics 2025-08-18 Arnab Ganguly , Riten Mitra , Jinpu Zhou

Expectation-Maximization (EM) is a prominent approach for parameter estimation of hidden (aka latent) variable models. Given the full batch of data, EM forms an upper-bound of the negative log-likelihood of the model at each iteration and…

Machine Learning · Computer Science 2020-02-24 Ehsan Amid , Manfred K. Warmuth

The Expectation-Maximisation (EM) algorithm is a central tool in statistics and machine learning, widely used for latent-variable models such as Gaussian Mixture Models (GMMs). Despite its ubiquity, EM is typically treated as a…

Machine Learning · Computer Science 2025-09-30 Samuel Boïté , Eloi Tanguy , Julie Delon , Agnès Desolneux , Rémi Flamary

Expectation Maximization (EM) algorithm is a parameter estimation method from incomplete observations. In this paper, an implementation of this method to the calibration of HKS spectrometer at Jefferson Lab is described. We show that the…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Lulin Yuan

We consider the problem of spherical Gaussian Mixture models with $k \geq 3$ components when the components are well separated. A fundamental previous result established that separation of $\Omega(\sqrt{\log k})$ is necessary and sufficient…

Machine Learning · Computer Science 2020-06-22 Jeongyeol Kwon , Constantine Caramanis

We study the convergence of the Expectation-Maximization (EM) algorithm for mixtures of linear regressions with an arbitrary number $k$ of components. We show that as long as signal-to-noise ratio (SNR) is $\tilde{\Omega}(k)$,…

Machine Learning · Computer Science 2019-11-27 Jeongyeol Kwon , Constantine Caramanis

SPIDER (Stochastic Path Integrated Differential EstimatoR) is an efficient gradient estimation technique developed for non-convex stochastic optimization. Although having been shown to attain nearly optimal computational complexity bounds,…

Optimization and Control · Mathematics 2018-11-27 Pan Zhou , Xiao-Tong Yuan , Jiashi Feng

In this paper, we firstly give a brief introduction of expectation maximization (EM) algorithm, and then discuss the initial value sensitivity of expectation maximization algorithm. Subsequently, we give a short proof of EM's convergence.…

Machine Learning · Computer Science 2013-05-06 Fuqiang Chen

In this paper, we propose a dynamical systems perspective of the Expectation-Maximization (EM) algorithm. More precisely, we can analyze the EM algorithm as a nonlinear state-space dynamical system. The EM algorithm is widely adopted for…

Optimization and Control · Mathematics 2018-10-05 Orlando Romero , Sarthak Chatterjee , Sérgio Pequito

The family of Expectation-Maximization (EM) algorithms provides a general approach to fitting flexible models for large and complex data. The expectation (E) step of EM-type algorithms is time-consuming in massive data applications because…

Computation · Statistics 2018-06-21 Sanvesh Srivastava , Glen DePalma , Chuanhai Liu

In this paper, we present the discrete-time unbiased extremum seeking (ES) algorithm for n-dimensional (nD) static quadratic maps in the presence of unknown time-varying measurement delays bounded by known constants which can be large. The…

Optimization and Control · Mathematics 2026-04-07 Adam Jbara , Emilia Fridman , Xuefei Yang

A maximum likelihood methodology for the parameters of models with an intractable likelihood is introduced. We produce a likelihood-free version of the stochastic approximation expectation-maximization (SAEM) algorithm to maximize the…

Methodology · Statistics 2018-01-17 Umberto Picchini