English
Related papers

Related papers: The strong convergence of operator-splitting metho…

200 papers

This work presents a new three-operator splitting method to handle monotone inclusion and convex optimization problems. The proposed splitting serves as another natural extension of the Douglas-Rachford splitting technique to problems…

Optimization and Control · Mathematics 2025-10-03 Anshika Anshika , Jiaxing Li , Debdas Ghosh , Xiangxiong Zhang

We propose a methodology for studying the performance of common splitting methods through semidefinite programming. We prove tightness of the methodology and demonstrate its value by presenting two applications of it. First, we use the…

Optimization and Control · Mathematics 2020-05-01 Ernest K. Ryu , Adrien B. Taylor , Carolina Bergeling , Pontus Giselsson

In this paper we study the convergence of a Lie-Trotter operator splitting for stochastic semi-linear evolution equations in a Hilbert space. The abstract Hilbert space setting allows for the consideration of convergence of the…

Numerical Analysis · Mathematics 2024-12-20 Joshua L Padgett , Qin Sheng

Langevin algorithms are popular Markov chain Monte Carlo methods that are often used to solve high-dimensional large-scale sampling problems in machine learning. The most classical Langevin Monte Carlo algorithm is based on the overdamped…

Probability · Mathematics 2026-05-21 Nian Yao , Pervez Ali , Xihua Tao , Lingjiong Zhu

This overview is devoted to splitting methods, a class of numerical integrators intended for differential equations that can be subdivided into different problems easier to solve than the original system. Closely connected with this class…

Numerical Analysis · Mathematics 2024-05-08 Sergio Blanes , Fernando Casas , Ander Murua

Splitting methods have emerged as powerful tools to address complex problems by decomposing them into smaller solvable components. In this work, we develop a general approach to forward-backward splitting methods for solving monotone…

Optimization and Control · Mathematics 2026-04-20 Minh N. Dao , Matthew K. Tam , Thang D. Truong

For sampling from a log-concave density, we study implicit integrators resulting from $\theta$-method discretization of the overdamped Langevin diffusion stochastic differential equation. Theoretical and algorithmic properties of the…

Machine Learning · Statistics 2021-07-13 Liam Hodgkinson , Robert Salomone , Fred Roosta

Convex nonsmooth optimization problems, whose solutions live in very high dimensional spaces, have become ubiquitous. To solve them, the class of first-order algorithms known as proximal splitting algorithms is particularly adequate: they…

Optimization and Control · Mathematics 2023-02-27 Laurent Condat , Daichi Kitahara , Andrés Contreras , Akira Hirabayashi

In the following paper we present a new type of optimization algorithms adapted for neural network training. These algorithms are based upon sequential operator splitting technique for some associated dynamical systems. Furthermore, we…

Machine Learning · Computer Science 2020-03-24 Cristian Daniel Alecsa , Titus Pinta , Imre Boros

In this work, we explore the use of operator splitting algorithms for solving regularized structural topology optimization problems. The context is the classical structural design problems (e.g., compliance minimization and compliant…

Optimization and Control · Mathematics 2013-07-22 Cameron Talischi , Glaucio H. Paulino

This paper considers the strong error analysis of the Euler and fast Euler methods for nonlinear overdamped generalized Langevin equations driven by the fractional noise. The main difficulty lies in handling the interaction between the…

Numerical Analysis · Mathematics 2023-02-21 Xinjie Dai , Jialin Hong , Derui Sheng , Tau Zhou

We present a unified convergence analysis for first order convex optimization methods using the concept of strong Lyapunov conditions. Combining this with suitable time scaling factors, we are able to handle both convex and strong convex…

Optimization and Control · Mathematics 2021-08-03 Long Chen , Hao Luo

Efficient numerical algorithm for stochastic differential equation has been an important object in the research of statistical physics and mathematics for a long time. In this paper we study the highly accurate numerical algorithm of the…

Statistical Mechanics · Physics 2023-08-28 De-Zhang Li , Xiao-Bao Yang

Langevin models are frequently used to model various stochastic processes in different fields of natural and social sciences. They are adapted to measured data by estimation techniques such as maximum likelihood estimation, Markov chain…

Data Analysis, Statistics and Probability · Physics 2021-08-04 Clemens Willers , Oliver Kamps

Operator splitting techniques have recently gained popularity in convex optimization problems arising in various control fields. Being fixed-point iterations of nonexpansive operators, such methods suffer many well known downsides, which…

Optimization and Control · Mathematics 2020-04-01 Andreas Themelis , Panagiotis Patrinos

The article is devoted to the construction of explicit one-step numerical methods with the strong orders of convergence 2.0, 2,5, and 3.0 for Ito stochastic differential equations with multidimensional non-commutative noise. We consider the…

Probability · Mathematics 2022-08-18 Dmitriy F. Kuznetsov

In this paper, we introduce three novel splitting algorithms for solving structured monotone inclusion problems involving the sum of a maximally monotone operator, a monotone and Lipschitz continuous operator and a cocoercive operator. Each…

Optimization and Control · Mathematics 2025-11-19 Liqian Qin , Aviv Gibali , Cuijie Zhang , Yuchao Tang

We develop a fourth order simulation algorithm for solving the stochastic Langevin equation. The method consists of identifying solvable operators in the Fokker-Planck equation, factorizing the evolution operator for small time steps to…

Nuclear Theory · Physics 2009-11-06 Harald A. Forbert , Siu A. Chin

We consider the problem of solving dual monotone inclusions involving sums of composite parallel-sum type operators. A feature of this work is to exploit explicitly the cocoercivity of some of the operators appearing in the model. Several…

Optimization and Control · Mathematics 2011-10-11 Bang Cong Vu

Complex Langevin dynamics can be used to perform numerical simulations of theories with a complex action. In order to justify the procedure, it is important to understand the properties of the real and positive distribution, which is…

High Energy Physics - Lattice · Physics 2013-09-13 Pietro Giudice , Gert Aarts , Erhard Seiler