English
Related papers

Related papers: Weak backward error analysis for overdamped Langev…

200 papers

This paper introduces algorithms for problems where a decision maker has to control a system composed of several components and has access to only partial information on the state of each component. Such problems are difficult because of…

Optimization and Control · Mathematics 2020-12-25 Victor Cohen , Axel Parmentier

We investigate a weighted Multilevel Richardson-Romberg extrapolation for the ergodic approximation of invariant distributions of diffusions adapted from the one introduced in~[Lemaire-Pag\`es, 2013] for regular Monte Carlo simulation. In a…

Probability · Mathematics 2016-07-05 Gilles Pagès , Fabien Panloup

A cumbersome operation in numerical analysis and linear algebra, optimization, machine learning and engineering algorithms; is inverting large full-rank matrices which appears in various processes and applications. This has both numerical…

Numerical Analysis · Mathematics 2022-06-24 Neophytos Charalambides , Mert Pilanci , Alfred O. Hero

This work develops new results for stochastic approximation algorithms. The emphases are on treating algorithms and limits with discontinuities. The main ingredients include the use of differential inclusions, set-valued analysis, and…

Probability · Mathematics 2021-08-31 Nhu Nguyen , George Yin

We introduce a novel and efficient algorithm called the stochastic approximate gradient descent (SAGD), as an alternative to the stochastic gradient descent for cases where unbiased stochastic gradients cannot be trivially obtained.…

Machine Learning · Computer Science 2020-02-14 Yixuan Qiu , Xiao Wang

Stochastic gradient descent procedures have gained popularity for parameter estimation from large data sets. However, their statistical properties are not well understood, in theory. And in practice, avoiding numerical instability requires…

Methodology · Statistics 2016-09-29 Panos Toulis , Edoardo M. Airoldi

Markov chain Monte Carlo (MCMC), such as Langevin dynamics, is valid for approximating intractable distributions. However, its usage is limited in the context of deep latent variable models owing to costly datapoint-wise sampling iterations…

Machine Learning · Computer Science 2022-10-12 Shohei Taniguchi , Yusuke Iwasawa , Wataru Kumagai , Yutaka Matsuo

Kinetic energy equipartition is a premise for many deterministic and stochastic molecular dynamics methods that aim at sampling a canonical ensemble. While this is expected for real systems, discretization errors introduced by the numerical…

Computational Physics · Physics 2019-04-29 Ana J. Silveira , Charlles R. A. Abreu

This paper proposes and analyzes an a posteriori error estimator for the finite element multi-scale discretization approximation of the Steklov eigenvalue problem. Based on the a posteriori error estimates, an adaptive algorithm of shifted…

Numerical Analysis · Mathematics 2016-01-08 Hai Bi , Hao Li , Yidu Yang

We analyze a semi-implicit finite volume scheme for the Gray--Scott system, a model for pattern formation in chemical and biological media. We prove unconditional well-posedness of the fully discrete problem and establish qualitative…

Numerical Analysis · Mathematics 2025-08-27 Tsiry Avisoa Randrianasolo

Stochastic thermostats based on the Langevin equation, in which a system is coupled to an external heat bath, are popular methods for temperature control in molecular dynamics simulations due to their ergodicity and their ease of…

Chemical Physics · Physics 2018-05-23 Mahdi Hijazi , David M. Wilkins , Michele Ceriotti

We study the implicit upwind finite volume scheme for numerically approximating the advection-diffusion equation with a vector field in the low regularity DiPerna-Lions setting. That is, we are concerned with advecting velocity fields that…

Analysis of PDEs · Mathematics 2023-05-04 Víctor Navarro-Fernández , André Schlichting

Approximate Thompson sampling with Langevin Monte Carlo broadens its reach from Gaussian posterior sampling to encompass more general smooth posteriors. However, it still encounters scalability issues in high-dimensional problems when…

Machine Learning · Statistics 2024-06-24 Haoyang Zheng , Wei Deng , Christian Moya , Guang Lin

Calculating averages with respect to multimodal probability distributions is often necessary in applications. Markov chain Monte Carlo (MCMC) methods to this end, which are based on time averages along a realization of a Markov process…

Methodology · Statistics 2023-07-24 M. Chak , T. Lelièvre , G. Stoltz , U. Vaes

Latent variable time-series models are among the most heavily used tools from machine learning and applied statistics. These models have the advantage of learning latent structure both from noisy observations and from the temporal ordering…

Machine Learning · Statistics 2015-11-24 Evan Archer , Il Memming Park , Lars Buesing , John Cunningham , Liam Paninski

In this paper, we provide a new scheme for approximating the weakly efficient solution set for a class of vector optimization problems with rational objectives over a feasible set defined by finitely many polynomial inequalities. More…

Optimization and Control · Mathematics 2022-05-26 Feng Guo , Liguo Jiao

We show that Langevin MCMC inference in an energy-based model with latent variables has the property that the early steps of inference, starting from a stationary point, correspond to propagating error gradients into internal layers,…

Machine Learning · Computer Science 2016-02-09 Yoshua Bengio , Asja Fischer

The numerical evaluation of statistics plays a crucial role in statistical physics and its applied fields. It is possible to evaluate the statistics for a stochastic differential equation with Gaussian white noise via the corresponding…

Numerical Analysis · Mathematics 2023-07-04 Jun Ohkubo

We revisit the problem of computing (robust) controlled invariant sets for discrete-time linear systems. Departing from previous approaches, we consider implicit, rather than explicit, representations for controlled invariant sets.…

Optimization and Control · Mathematics 2022-08-10 Tzanis Anevlavis , Zexiang Liu , Necmiye Ozay , Paulo Tabuada

In this work, we propose a subsystem decomposition approach and a distributed estimation scheme for a class of implicit two-time-scale nonlinear systems. Taking the advantage of the two-time-scale separation, these processes are decomposed…

Systems and Control · Electrical Eng. & Systems 2021-10-05 Sarupa Debnath , Soumya Ranjan Sahoo , Benjamin Decardi-Nelson , Jinfeng Liu