English
Related papers

Related papers: Interacting Particle Langevin Algorithm for Maximu…

200 papers

The Expectation-Maximization (EM) algorithm is routinely used for the maximum likelihood estimation in the latent class analysis. However, the EM algorithm comes with no guarantees of reaching the global optimum. We study the geometry of…

Optical micro-manipulation techniques has evolved into powerful tools to efficiently steer the motion of microscopical particles on periodic and quasi-periodic potentials, driven by the external electromagnetic field. Here, the dynamics of…

Atomic Physics · Physics 2018-11-13 Aliezer Martínez-Mesa , Llinersy Uranga Piña

We propose the particle dual averaging (PDA) method, which generalizes the dual averaging method in convex optimization to the optimization over probability distributions with quantitative runtime guarantee. The algorithm consists of an…

Machine Learning · Statistics 2022-01-25 Atsushi Nitanda , Denny Wu , Taiji Suzuki

Graphical models with bi-directed edges (<->) represent marginal independence: the absence of an edge between two vertices indicates that the corresponding variables are marginally independent. In this paper, we consider maximum likelihood…

Methodology · Statistics 2012-12-12 Mathias Drton , Thomas S. Richardson

We investigate the influence of a self-propelling, out-of-equilibrium active particle on generalized elastic systems, including flexible and semiflexible polymers, fluid membranes, and fluctuating interfaces, while accounting for…

Soft Condensed Matter · Physics 2024-01-25 Alessandro Taloni

The Metropolis-Adjusted Langevin Algorithm (MALA) is a widely used Markov Chain Monte Carlo (MCMC) method for sampling from high-dimensional distributions. However, MALA relies on differentiability assumptions that restrict its…

Methodology · Statistics 2025-07-10 Ning Ning

Combining discrete probability distributions and combinatorial optimization problems with neural network components has numerous applications but poses several challenges. We propose Implicit Maximum Likelihood Estimation (I-MLE), a…

Machine Learning · Computer Science 2021-10-28 Mathias Niepert , Pasquale Minervini , Luca Franceschi

Monte Carlo maximum likelihood (MCML) provides an elegant approach to find maximum likelihood estimators (MLEs) for latent variable models. However, MCML algorithms are computationally expensive when the latent variables are…

Computation · Statistics 2020-08-05 Jaewoo Park , Murali Haran

We investigate a weighted Multilevel Richardson-Romberg extrapolation for the ergodic approximation of invariant distributions of diffusions adapted from the one introduced in~[Lemaire-Pag\`es, 2013] for regular Monte Carlo simulation. In a…

Probability · Mathematics 2016-07-05 Gilles Pagès , Fabien Panloup

We investigate the maximum caliber variational principle as an inference algorithm used to predict dynamical properties of complex nonequilibrium, stationary, statistical systems in the presence of incomplete information. Specifically, we…

Statistical Mechanics · Physics 2016-12-28 Carlo Cafaro , Sean Alan Ali

We establish conditions under which Metropolis-Hastings (MH) algorithms with a position-dependent proposal covariance matrix will or will not have the geometric rate of convergence. Some of the diffusions based MH algorithms like the…

Methodology · Statistics 2022-08-23 Vivekananda Roy , Lijin Zhang

Markov chain Monte Carlo samplers based on discretizations of (overdamped) Langevin dynamics are commonly used in the Bayesian inference and computational statistical physics literature to estimate high-dimensional integrals. One can…

Numerical Analysis · Mathematics 2025-08-11 Tony Lelièvre , Régis Santet , Gabriel Stoltz

In this paper, we address the identification problem for the systems characterized by linear time-invariant dynamics with bilinear observation models. More precisely, we consider a suitable parametric description of the system and formulate…

Systems and Control · Electrical Eng. & Systems 2025-02-24 Diyou Liu , Mohammad Khosravi

A stochastic dynamics $({\bf X}(t))_{t\ge0}$ of a classical continuous system is a stochastic process which takes values in the space $\Gamma$ of all locally finite subsets (configurations) in $\Bbb R$ and which has a Gibbs measure $\mu$ as…

Probability · Mathematics 2007-05-23 Yuri Kondratiev , Eugene Lytvynov , Michael Röckner

For the first time, the energy diffusion approximation is confronted at the percent level with the exact numerical modeling of thermal decay of a metastable state. The latter is performed using the quasistationary decay rates resulting from…

Nuclear Theory · Physics 2019-08-13 Igor I. Gontchar , Maria V. Chushnyakova

We describe a new MCMC method optimized for the sampling of probability measures on Hilbert space which have a density with respect to a Gaussian; such measures arise in the Bayesian approach to inverse problems, and in conditioned…

Probability · Mathematics 2014-04-04 Michela Ottobre , Natesh S. Pillai , Frank J. Pinski , Andrew M. Stuart

Diffusion can be conceptualized, at microscopic scales, as the random hopping of particles between neighboring lattice sites. In the case of diffusion in inhomogeneous media, distinct spatial domains in the system may yield distinct…

Biological Physics · Physics 2017-10-02 Yiwei Li , Osman Kahraman , Christoph A. Haselwandter

Due to its heavy-tailed and fully parametric form, the multivariate generalized Gaussian distribution (MGGD) has been receiving much attention for modeling extreme events in signal and image processing applications. Considering the…

Applications · Statistics 2017-02-27 F. Pascal , L. Bombrun , J. Y. Tourneret , Y. Berthoumieu

In this article we consider static Bayesian parameter estimation for partially observed diffusions that are discretely observed. We work under the assumption that one must resort to discretizing the underlying diffusion process, for…

Computation · Statistics 2017-01-23 Ajay Jasra , Kengo Kamatani , Kody J. H. Law , Yan Zhou

Large-scale Gaussian process models are becoming increasingly important and widely used in many areas, such as, computer experiments, stochastic optimization via simulation, and machine learning using Gaussian processes. The standard…

Methodology · Statistics 2018-08-02 Yongxiang Li , Qiang Zhou , Kwok Leung Tsui , Javier Cabrera