English
Related papers

Related papers: Convergence rate of EM algorithm for SDEs under in…

200 papers

In this paper, we derive explicit sharp two-sided estimates for the Dirichlet heat kernels of a large class of symmetric (but not necessarily rotationally symmetric) L\'evy processes on half spaces for all $t>0$. These L\'evy processes may…

Probability · Mathematics 2016-02-22 Zhen-Qing Chen , Panki Kim

In the present manuscript, we calculate the exponential rate of convergence of the heated string system (a mixed-type hyperbolic-parabolic system of PDEs) towards the equilibrium, independently of the initial data. As a by-product of our…

Analysis of PDEs · Mathematics 2025-10-15 Tomasz Cieślak , Jacek Jendrej , Christian Stinner

The convergence of expectation-maximization (EM)-based algorithms typically requires continuity of the likelihood function with respect to all the unknown parameters (optimization variables). The requirement is not met when parameters…

Signal Processing · Electrical Eng. & Systems 2024-04-18 Geethu Joseph

The rate of convergence of weighted kernel herding (WKH) and sequential Bayesian quadrature (SBQ), two kernel-based sampling algorithms for estimating integrals with respect to some target probability measure, is investigated. Under…

Machine Learning · Statistics 2021-11-02 Rajiv Khanna , Liam Hodgkinson , Michael W. Mahoney

We examine the performance of the density matrix embedding theory (DMET) recently proposed in [G. Knizia and G. K.-L. Chan, Phys. Rev. Lett. 109, 186404 (2012)]. The core of this method is to find a proper one-body potential that generates…

Strongly Correlated Electrons · Physics 2020-12-07 Masataka Kawano , Chisa Hotta

This paper studies the problem of estimating the means $\pm\theta_{*}\in\mathbb{R}^{d}$ of a symmetric two-component Gaussian mixture $\delta_{*}\cdot N(\theta_{*},I)+(1-\delta_{*})\cdot N(-\theta_{*},I)$ where the weights $\delta_{*}$ and…

Statistics Theory · Mathematics 2021-03-30 Nir Weinberger , Guy Bresler

The Expectation Maximization (EM) algorithm is of key importance for inference in latent variable models including mixture of regressors and experts, missing observations. This paper introduces a novel EM algorithm, called…

Machine Learning · Computer Science 2020-12-04 Gersende Fort , Eric Moulines , Hoi-To Wai

Khasminski's \cite{chas1980stochastic} showed that many of the asymptotic stability and the integrability properties of the solutions to the Stochastic Differential Equations (SDEs) can be obtained using Lyapunov functions techniques. These…

Numerical Analysis · Mathematics 2016-08-11 Lukasz Szpruch , X\=ılíng Zhāng

The Expectation Maximization (EM) algorithm is a versatile tool for model parameter estimation in latent data models. When processing large data sets or data stream however, EM becomes intractable since it requires the whole data set to be…

Statistics Theory · Mathematics 2012-10-18 Sylvain Le Corff , Gersende Fort

By using the heat kernel parameter expansion with respect to the frozen SDEs, the intrinsic derivative is estimated for the law of Mckean-Vlasov SDEs with respect to the initial distribution. As an application, the total variation distance…

Probability · Mathematics 2020-07-01 Xing Huang , Feng-Yu Wang

Building on the well-posedness of the backward Kolmogorov partial differential equation in the Wasserstein space, we analyze the strong and weak convergence rates for approximating the unique solution of a class of McKean-Vlasov stochastic…

Probability · Mathematics 2025-03-31 Noufel Frikha , Xuanye Song

We study the convergence properties of a general inertial first-order proximal splitting algorithm for solving nonconvex nonsmooth optimization problems. Using the Kurdyka--\L ojaziewicz (KL) inequality we establish new convergence rates…

Optimization and Control · Mathematics 2016-09-14 Patrick R. Johnstone , Pierre Moulin

Expectation-Maximization (EM) algorithm is a widely used iterative algorithm for computing (local) maximum likelihood estimate (MLE). It can be used in an extensive range of problems, including the clustering of data based on the Gaussian…

Machine Learning · Statistics 2023-03-28 Pierre Houdouin , Esa Ollila , Frederic Pascal

In this paper, we propose a dynamical systems perspective of the Expectation-Maximization (EM) algorithm. More precisely, we can analyze the EM algorithm as a nonlinear state-space dynamical system. The EM algorithm is widely adopted for…

Optimization and Control · Mathematics 2018-10-05 Orlando Romero , Sarthak Chatterjee , Sérgio Pequito

Expectation maximization (EM) is the default algorithm for fitting probabilistic models with missing or latent variables, yet we lack a full understanding of its non-asymptotic convergence properties. Previous works show results along the…

Machine Learning · Computer Science 2022-03-01 Frederik Kunstner , Raunak Kumar , Mark Schmidt

The Markov entropy decomposition (MED) is a recently-proposed, cluster-based simulation method for finite temperature quantum systems with arbitrary geometry. In this paper, we detail numerical algorithms for performing the required steps…

Statistical Mechanics · Physics 2013-05-29 Andrew J. Ferris , David Poulin

We consider the formal SDE dX t = b(t, X t)dt + dZ t , X 0 = x $\in$ R d , (E) where b $\in$ L r ([0, T ], B $\beta$ p,q (R d , R d)) is a time-inhomogeneous Besov drift and Z t is a symmetric d-dimensional $\alpha$-stable process, $\alpha$…

Probability · Mathematics 2024-10-14 Mathis Fitoussi

In this paper we develop via Girsanov's transformation a perturbation argument to investigate weak convergence of Euler-Maruyama (EM) scheme for path-dependent SDEs with H\"older continuous drifts. This approach is available to other…

Probability · Mathematics 2018-09-11 Jianhai Bao , Jinghai Shao

We establish nearly optimal rates of convergence to self-similar solutions of Smoluchowski's coagulation equation with kernels $K = 2$, $x + y$, and $xy$. The method is a simple analogue of the Berry-Ess\'een theorem in classical…

Adaptation and Self-Organizing Systems · Physics 2011-04-26 Ravi Srinivasan

The speed of convergence of the Expectation Maximization (EM) algorithm for Gaussian mixture model fitting is known to be dependent on the amount of overlap among the mixture components. In this paper, we study the impact of mixing…

Machine Learning · Computer Science 2012-07-03 Iftekhar Naim , Daniel Gildea