English
Related papers

Related papers: Convergence rate of EM algorithm for SDEs under in…

200 papers

In this paper, the discrete parameter expansion is adopted to investigate the estimation of heat kernel for Euler-Maruyama scheme of SDEs driven by {\alpha}-stable noise, which implies krylov's estimate and khasminskii's estimate. As an…

Probability · Mathematics 2022-08-02 Xing Huang , Yongqiang Suo , Chenggui Yuan

In this paper, we study convergence properties of the gradient Expectation-Maximization algorithm \cite{lange1995gradient} for Gaussian Mixture Models for general number of clusters and mixing coefficients. We derive the convergence rate…

Statistics Theory · Mathematics 2017-12-05 Bowei Yan , Mingzhang Yin , Purnamrita Sarkar

In this paper, the coupling by change of measure is constructed for a class of SDEs with integrable drift and additive noise, from which the Harnack and shift Harnack inequalities are derived. Finally, as applications, the gradient…

Probability · Mathematics 2018-05-16 Xing Huang

The Expectation-Maximization (EM) algorithm is an iterative method to maximize the log-likelihood function for parameter estimation. Previous works on the convergence analysis of the EM algorithm have established results on the asymptotic…

Statistics Theory · Mathematics 2017-05-31 Chong Wu , Can Yang , Hongyu Zhao , Ji Zhu

The directional mean shift (DMS) algorithm is a nonparametric method for pursuing local modes of densities defined by kernel density estimators on the unit hypersphere. In this paper, we show that any DMS iteration can be viewed as a…

Statistics Theory · Mathematics 2021-01-26 Yikun Zhang , Yen-Chi Chen

Applying Zvonkin's transform, the exponential convergence in Wasserstein distance for a class of functional SDEs with H\"older continuous drift is obtained. This combining with log-Harnack inequality implies the same convergence in the…

Probability · Mathematics 2018-11-06 Xing Huang

The Expectation-Maximization (EM) algorithm is a widely used method for maximum likelihood estimation in models with latent variables. For estimating mixtures of Gaussians, its iteration can be viewed as a soft version of the k-means…

Machine Learning · Statistics 2017-06-06 Constantinos Daskalakis , Christos Tzamos , Manolis Zampetakis

We study the convergence behavior of the Expectation Maximization (EM) algorithm on Gaussian mixture models with an arbitrary number of mixture components and mixing weights. We show that as long as the means of the components are separated…

Statistics Theory · Mathematics 2018-10-10 Ruofei Zhao , Yuanzhi Li , Yuekai Sun

The mean shift (MS) algorithm seeks a mode of the kernel density estimate (KDE). This study presents a convergence guarantee of the mode estimate sequence generated by the MS algorithm and an evaluation of the convergence rate, under fairly…

Machine Learning · Statistics 2023-11-08 Ryoya Yamasaki , Toshiyuki Tanaka

A numerical algorithm to calculate exact finite-temperature spectra of many-body lattice Hamiltonians is formulated by combining the typicality approach and the shifted Krylov subspace method. The combined algorithm, which we name…

Strongly Correlated Electrons · Physics 2018-02-09 Youhei Yamaji , Takafumi Suzuki , Mitsuaki Kawamura

In this paper we study the problem of semiparametric estimation for a class of McKean-Vlasov stochastic differential equations. Our aim is to estimate the drift coefficient of a MV-SDE based on observations of the corresponding particle…

Statistics Theory · Mathematics 2021-07-02 Denis Belomestny , Vytautė Pilipauskaitė , Mark Podolskij

We establish heat kernel and gradient estimates for the density of kinetic degenerate Kolmogorov stochastic differentia equations. Our results are established under somehow minimal assumptions that guarantee the SDE is weakly well posed.

Analysis of PDEs · Mathematics 2022-03-23 P Chaudru de Raynal , S Menozzi , A Pesce , X Zhang

This work establishes the weak convergence of Euler-Maruyama's approximation for stochastic differential equations (SDEs) with singular drifts under the integrability condition in lieu of the widely used growth condition. This method is…

Probability · Mathematics 2018-08-23 Jinghai Shao

Gaussian mixture models (GMMs) are fundamental statistical tools for modeling heterogeneous data. Due to the nonconcavity of the likelihood function, the Expectation-Maximization (EM) algorithm is widely used for parameter estimation of…

Statistics Theory · Mathematics 2025-11-10 Xin Bing , Dehan Kong , Bingqing Li

In this paper, we derive quantitative convergence rates for stochastic processes associated with resistance forms. While the qualitative convergence of heat kernels and semigroups under the Gromov-Hausdorff-vague convergence of underlying…

Probability · Mathematics 2026-05-25 Koyo Oishi

We investigate the convergence properties of the EM algorithm when applied to overspecified Gaussian mixture models -- that is, when the number of components in the fitted model exceeds that of the true underlying distribution. Focusing on…

Machine Learning · Statistics 2025-06-16 Zhenisbek Assylbekov , Alan Legg , Artur Pak

We present a new framework for analysing the Expectation Maximization (EM) algorithm. Drawing on recent advances in the theory of gradient flows over Euclidean-Wasserstein spaces, we extend techniques from alternating minimization in…

Machine Learning · Statistics 2025-11-21 Rocco Caprio , Adam M Johansen

We propose a novel algorithm based on inexact GMRES methods for linear response calculations in density functional theory. Such calculations require iteratively solving a nested linear problem $\mathcal{E} \delta\rho = b$ to obtain the…

Numerical Analysis · Mathematics 2025-10-30 Michael F. Herbst , Bonan Sun

We establish heat-kernel bounds and regularity estimates for the transition densities of the diffusion associated with the martingale problem corresponding to the generator of a formal multidimensional Brownian SDE with singular drift. As a…

Analysis of PDEs · Mathematics 2026-05-19 Stéphane Menozzi , Stefano Pagliarani

The minimally entangled typical thermal states algorithm is applied to fermionic systems using the Krylov-space approach to evolve the system in imaginary time. The convergence of local observables is studied in a tight-binding system with…

Strongly Correlated Electrons · Physics 2013-07-31 G. Alvarez
‹ Prev 1 2 3 10 Next ›