English
Related papers

Related papers: Convergence rate of EM algorithm for SDEs under in…

200 papers

In this paper we investigate explicit numerical approximations for stochastic differential delay equations (SDDEs) under a local Lipschitz condition by employing the adaptive Euler-Maruyama (EM) method. Working in both finite and infinite…

Probability · Mathematics 2023-08-31 Ulises Botija-Munoz , Chenggui Yuan

We study a class of weakly identifiable location-scale mixture models for which the maximum likelihood estimates based on $n$ i.i.d. samples are known to have lower accuracy than the classical $n^{- \frac{1}{2}}$ error. We investigate…

Statistics Theory · Mathematics 2021-11-17 Raaz Dwivedi , Nhat Ho , Koulik Khamaru , Martin J. Wainwright , Michael I. Jordan , Bin Yu

The Expectation-Maximization algorithm is perhaps the most broadly used algorithm for inference of latent variable problems. A theoretical understanding of its performance, however, largely remains lacking. Recent results established that…

Machine Learning · Statistics 2019-05-30 Jeongyeol Kwon , Wei Qian , Constantine Caramanis , Yudong Chen , Damek Davis

In this paper, we study the transition densities of pure-jump symmetric Markov processes in $ {{\mathbb R}}^d$, whose jumping kernels are comparable to radially symmetric functions with mixed polynomial growths. Under some mild assumptions…

Probability · Mathematics 2018-04-20 Joohak Bae , Jaehoon Kang , Panki Kim , Jaehun Lee

Recent advances in Bayesian learning with large-scale data have witnessed emergence of stochastic gradient MCMC algorithms (SG-MCMC), such as stochastic gradient Langevin dynamics (SGLD), stochastic gradient Hamiltonian MCMC (SGHMC), and…

Machine Learning · Statistics 2016-10-24 Changyou Chen , Nan Ding , Lawrence Carin

We analyze the classical EM algorithm for parameter estimation in the symmetric two-component Gaussian mixtures in $d$ dimensions. We show that, even in the absence of any separation between components, provided that the sample size…

Statistics Theory · Mathematics 2019-08-30 Yihong Wu , Harrison H. Zhou

We describe a rapidly converging algorithm for solving the Kohn--Sham equations and equations of similar structure that appear frequently in calculations of the structure of inhomogeneous electronic many--body systems. The algorithm has its…

Materials Science · Physics 2009-10-31 J. Auer , E. Krotscheck

We describe a numerical algorithm for approximating the equilibrium-reduced density matrix and the effective (mean force) Hamiltonian for a set of system spins coupled strongly to a set of bath spins when the total system (system+bath) is…

Quantum Physics · Physics 2023-01-25 Tyler Chen , Yu-Chen Cheng

In the context of density level set estimation, we study the convergence of general plug-in methods under two main assumptions on the density for a given level $\lambda$. More precisely, it is assumed that the density (i) is smooth in a…

Statistics Theory · Mathematics 2016-09-07 Philippe Rigollet , Régis Vert

Online variants of the Expectation Maximization (EM) algorithm have recently been proposed to perform parameter inference with large data sets or data streams, in independent latent models and in hidden Markov models. Nevertheless, the…

Statistics Theory · Mathematics 2012-06-01 Sylvain Le Corff , Gersende Fort

By making full use of heat kernel estimates, we establish the integral tests on the zero-one laws of upper and lower bounds for the sample path ranges of symmetric Markov processes. In particular, these results concerning on upper rate…

Probability · Mathematics 2015-09-01 Yuichi Shiozawa , Jian Wang

In this paper, we outline the use of Mixture Models in density estimation of large astronomical databases. This method of density estimation has been known in Statistics for some time but has not been implemented because of the large…

Astrophysics · Physics 2007-05-23 A. J. Connolly , C. Genovese , A. W. Moore , R. C. Nichol , J. Schneider , L. Wasserman

Finite mixture models are powerful tools for modelling and analyzing heterogeneous data. Parameter estimation is typically carried out using maximum likelihood estimation via the Expectation-Maximization (EM) algorithm. Recently, the…

Computation · Statistics 2020-05-15 Sharon X. Lee , Geoffrey J. McLachlan , Kaleb L. Leemaqz

We prove sharp pointwise heat kernel estimates for symmetric Markov processes associated with symmetric Dirichlet forms that are local with respect to some coordinates and nonlocal with respect to the remaining coordinates. The main theorem…

Probability · Mathematics 2024-04-12 Jaehoon Kang , Moritz Kassmann

We systematically study various network Expectation-Maximization (EM) algorithms for the Gaussian mixture model within the framework of decentralized federated learning. Our theoretical investigation reveals that directly extending the…

Machine Learning · Statistics 2024-11-11 Shuyuan Wu , Bin Du , Xuetong Li , Hansheng Wang

Data representation techniques have made a substantial contribution to advancing data processing and machine learning (ML). Improving predictive power was the focus of previous representation techniques, which unfortunately perform rather…

Machine Learning · Computer Science 2022-05-24 Qiyou Duan , Hadi Ghauch , Taejoon Kim

We investigate the dissipativity properties of a class of scalar second order parabolic partial differential equations with time-dependent coefficients. We provide explicit condition on the drift term which ensure that the relative entropy…

Probability · Mathematics 2007-05-23 Jean-François Collet , Florent Malrieu

We give a certain $L^{\infty}(\mathbb{R}^2)$-estimate for the heat semigroup $\{e^{t\Delta}\}_{t \ge 0}$ that is closely related to the fact $H^1(\mathbb{R}^2) \not\subset L^{\infty}(\mathbb{R}^2)$, i.e., the critical Sobolev…

Functional Analysis · Mathematics 2026-02-26 Yi C. Huang , Tohru Ozawa , Chenmin Sun , Taiki Takeuchi

The numerical solutions of stochastic differential delay equations (SDDEs) under the generalized Khasminskii-type condition were discussed by Mao [15], and the theory there showed that the Euler-Maruyama (EM) numerical solutions converge to…

Numerical Analysis · Mathematics 2019-07-16 Qian Guo , Xuerong Mao , Rongxian Yue

We prove a Nekhoroshev-type theorem for nearly integrable symplectic map. As an application of the theorem, we obtain the exponential stability symplectic algorithms. Meanwhile, we can get the bounds for the perturbation, the variation of…

Dynamical Systems · Mathematics 2018-05-10 Zhaodong Ding , Zaijiu Shang , Bo Xie