English
Related papers

Related papers: The strong convergence of operator-splitting metho…

200 papers

Finding a zero of a sum of maximally monotone operators is a fundamental problem in modern optimization and nonsmooth analysis. Assuming that resolvents of the operators are available, this problem can be tackled with the Douglas-Rachford…

Optimization and Control · Mathematics 2021-09-24 Heinz H. Bauschke , Shambhavi Singh , Xianfu Wang

Langevin simulation provides an effective way to study collisional effects in beams by reducing the six-dimensional Fokker-Planck equation to a group of stochastic ordinary differential equations. These resulting equations usually have…

Accelerator Physics · Physics 2007-05-23 Ji Qiang , Salman Habib

In this paper, we provide different splitting methods for solving distributionally robust optimization problems in cases where the uncertainties are described by discrete distributions. The first method involves computing the proximity…

Optimization and Control · Mathematics 2024-10-30 Luis Briceño-Arias , Sergio López-Rivera , Emilio Vilches

In this paper, we introduce a new simple approach to developing and establishing the convergence of splitting methods for a large class of stochastic differential equations (SDEs), including additive, diagonal and scalar noise types. The…

Numerical Analysis · Mathematics 2024-03-11 James Foster , Goncalo dos Reis , Calum Strange

Finding a zero of a sum of maximally monotone operators is a fundamental problem in modern optimization and nonsmooth analysis. Assuming that the resolvents of the operators are available, this problem can be tackled with the…

Optimization and Control · Mathematics 2025-07-31 Heinz H. Bauschke , Shambhavi Singh , Xianfu Wang

In this paper, we propose a new class of splitting methods to solve the stochastic Langevin equation, which can simultaneously preserve the ergodicity and exponential integrability of the original equation. The central idea is to extract a…

Numerical Analysis · Mathematics 2024-10-29 Chuchu Chen , Tonghe Dang , Jialin Hong , Fengshan Zhang

Projective splitting is a family of methods for solving inclusions involving sums of maximal monotone operators. First introduced by Eckstein and Svaiter in 2008, these methods have enjoyed significant innovation in recent years, becoming…

Optimization and Control · Mathematics 2020-02-19 Patrick R. Johnstone , Jonathan Eckstein

We study numerical methods for the generalized Langevin equation (GLE) with a positive Prony series memory kernel, in which case the GLE can be written in an extended variable Markovian formalism. We propose a new splitting method that is…

Computational Physics · Physics 2022-05-31 Manh Hong Duong , Xiaocheng Shang

The complex Langevin approach is a promising method for the numerical treatment of systems with a sign problem, for which conventional lattice field theory techniques based on importance sampling cannot be applied. However, complex Langevin…

High Energy Physics - Lattice · Physics 2026-04-15 Michael Mandl

The article is devoted to explicit one-step numerical methods with strong orders 1.0, 1.5, and 2.0 of convergence for Ito stochastic differential equations with multidimensional and non-commutative noise. For numerical modeling of iterated…

Probability · Mathematics 2022-09-13 Dmitriy F. Kuznetsov

Langevin algorithms are popular Markov chain Monte Carlo (MCMC) methods for large-scale sampling problems that often arise in data science. We propose Monte Carlo algorithms based on the discretizations of $P$-th order Langevin dynamics for…

Machine Learning · Statistics 2025-08-26 Thanh Dang , Mert Gurbuzbalaban , Mohammad Rafiqul Islam , Nian Yao , Lingjiong Zhu

We study parallel sampling from high-dimensional strongly log-concave distributions. Langevin-based samplers converge rapidly in continuous time, but their discretizations are typically sequential and often require polynomially many steps…

Statistics Theory · Mathematics 2026-05-11 Jaideep Mahajan , Kaihong Zhang , Feng Liang , Jingbo Liu

We propose a Markov chain Monte Carlo (MCMC) algorithm based on third-order Langevin dynamics for sampling from distributions with log-concave and smooth densities. The higher-order dynamics allow for more flexible discretization schemes,…

Machine Learning · Statistics 2020-05-27 Wenlong Mou , Yi-An Ma , Martin J. Wainwright , Peter L. Bartlett , Michael I. Jordan

We propose and analyze a second-order Strang splitting method for a class of stiff matrix differential equations with Sylvester-type structure. The method splits the dynamics into a stiff linear part, treated exactly via matrix…

Numerical Analysis · Mathematics 2026-02-10 Carmen Scalone , Nicola Guglielmi

Langevin integrators based on operator splitting are widely used in molecular dynamics. This work examines Langevin splitting schemes from the perspective of their internal trajectories and observation points, complementing existing…

Statistical Mechanics · Physics 2026-02-03 Bettina G. Keller

We propose a method for efficiently incorporating constraints into a stochastic gradient Langevin framework for the training of deep neural networks. Constraints allow direct control of the parameter space of the model. Appropriately…

Machine Learning · Computer Science 2021-06-22 Benedict Leimkuhler , Timothée Pouchon , Tiffany Vlaar , Amos Storkey

We consider the numerical integration of non-autonomous separable parabolic equations using high order splitting methods with complex coefficients (methods with real coefficients of order greater than two necessarily have negative…

Numerical Analysis · Mathematics 2014-05-20 Muaz Seydaoğlu , Sergio Blanes

The stochastic gradient Langevin Dynamics is one of the most fundamental algorithms to solve sampling problems and non-convex optimization appearing in several machine learning applications. Especially, its variance reduced versions have…

Machine Learning · Computer Science 2022-11-22 Yuri Kinoshita , Taiji Suzuki

The complex Langevin method is a promising approach to the complex-action problem based on a fictitious time evolution of complexified dynamical variables under the influence of a Gaussian noise. Although it is known to have a restricted…

High Energy Physics - Lattice · Physics 2017-01-04 Keitaro Nagata , Jun Nishimura , Shinji Shimasaki

In this work we propose a new splitting technique, namely Asymmetric Forward-Backward-Adjoint splitting, for solving monotone inclusions involving three terms, a maximally monotone, a cocoercive and a bounded linear operator. Classical…

Optimization and Control · Mathematics 2016-10-17 Puya Latafat , Panagiotis Patrinos