English
Related papers

Related papers: The strong convergence of operator-splitting metho…

200 papers

It is well known that the Euler method for a random ordinary differential equation $\mathrm{d}X_t/\mathrm{d}t = f(t, X_t, Y_t)$ driven by a stochastic process $\{Y_t\}_t$ with $\theta$-H\"older sample paths is estimated to be of strong…

Probability · Mathematics 2025-10-21 Peter E. Kloeden , Ricardo M. S. Rosa

Standard first-order Langevin algorithms such as the unadjusted Langevin algorithm (ULA) are obtained by discretizing the Langevin diffusion and are widely used for sampling in machine learning because they scale to high dimensions and…

Machine Learning · Statistics 2025-09-25 Mert Gurbuzbalaban , Hoang M. Nguyen , Xicheng Zhang , Lingjiong Zhu

Recently, various high-order methods have been developed to solve the convex optimization problem. The auxiliary problem of these methods shares the general form that is the same as the high-order proximal operator proposed by Nesterov. In…

Optimization and Control · Mathematics 2023-09-06 Jingyu Gao , Xiurui Geng

In this paper we consider splitting methods for the time integration of parabolic and certain classes of hyperbolic partial differential equations, where one partial flow can not be computed exactly. Instead, we use a numerical…

Numerical Analysis · Mathematics 2017-01-06 Lukas Einkemmer , Alexander Ostermann

A class of monotone operator equations, which can be decomposed into sum of the gradient of a strongly convex function and a linear and skew-symmetric operator, is considered in this work. Based on discretization of the generalized gradient…

Optimization and Control · Mathematics 2025-01-22 Long Chen , Jingrong Wei

We are concerned with the numerical solution obtained by splitting methods of certain parabolic partial differential equations. Splitting schemes of order higher than two with real coefficients necessarily involve negative coefficients. It…

Numerical Analysis · Mathematics 2015-04-10 Sergio Blanes , Fernando Casas , Philippe Chartier , Ander Murua

The success of quantum physics in description of various physical interaction phenomena relies primarily on the accuracy of analytical methods used. In quantum mechanics, many of such interactions such as those found in quantum…

Quantum Physics · Physics 2019-08-15 Sina Khorasani

Explicit stabilized methods are an efficient alternative to implicit schemes for the time integration of stiff systems of differential equations in large dimension. In this paper, we derive explicit stabilized integrators of orders one and…

Numerical Analysis · Mathematics 2023-06-09 Ibrahim Almuslimani , Gilles Vilmart

A lot of effort has been invested into characterizing the convergence rates of gradient based algorithms for non-linear convex optimization. Recently, motivated by large datasets and problems in machine learning, the interest has shifted…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-07-23 Konstantinos I. Tsianos , Michael G. Rabbat

In this work, we propose a new splitting algorithm for solving structured monotone inclusion problems composed of a maximally monotone operator, a maximally monotone and Lipschitz continuous operator and a cocoercive operator. Our method…

Optimization and Control · Mathematics 2025-11-07 Liqian Qin , Yuchao Tang , Jigen Peng

Recently, there has been significant progress in the development of distributed first order methods. (At least) two different types of methods, designed from very different perspectives, have been proposed that achieve both exact and linear…

Information Theory · Computer Science 2017-12-27 Dusan Jakovetic

This note is devoted to the splitting algorithm proposed by Davis and Yin in 2017 for computing a zero of the sum of three maximally monotone operators, with one of them being cocoercive. We provide a direct proof that guarantees its…

Optimization and Control · Mathematics 2022-01-19 Francisco J. Aragón-Artacho , David Torregrosa-Belén

Sampling from a high-dimensional distribution is a fundamental task in statistics, engineering, and the sciences. A canonical approach is the Langevin Algorithm, i.e., the Markov chain for the discretized Langevin Diffusion. This is the…

Statistics Theory · Mathematics 2022-11-01 Jason M. Altschuler , Kunal Talwar

Mesoscopic models in the reaction-diffusion framework have gained recognition as a viable approach to describing chemical processes in cell biology. The resulting computational problem is a continuous-time Markov chain on a discrete and…

Numerical Analysis · Mathematics 2016-01-13 Stefan Engblom

Discretizations of Langevin diffusions provide a powerful method for sampling and Bayesian inference. However, such discretizations require evaluation of the gradient of the potential function. In several real-world scenarios, obtaining…

Statistics Theory · Mathematics 2021-01-19 Abhishek Roy , Lingqing Shen , Krishnakumar Balasubramanian , Saeed Ghadimi

In this paper we develop a statistical theory and an implementation of deep learning models. We show that an elegant variable splitting scheme for the alternating direction method of multipliers optimises a deep learning objective. We allow…

Machine Learning · Statistics 2015-09-22 Nicholas G. Polson , Brandon T. Willard , Massoud Heidari

We propose a solution for linear inverse problems based on higher-order Langevin diffusion. More precisely, we propose pre-conditioned second-order and third-order Langevin dynamics that provably sample from the posterior distribution of…

Machine Learning · Statistics 2023-12-08 Nicolas Zilberstein , Ashutosh Sabharwal , Santiago Segarra

Sampling with Markov chain Monte Carlo methods often amounts to discretizing some continuous-time dynamics with numerical integration. In this paper, we establish the convergence rate of sampling algorithms obtained by discretizing smooth…

Machine Learning · Statistics 2020-02-04 Xuechen Li , Denny Wu , Lester Mackey , Murat A. Erdogdu

Proximal splitting algorithms for monotone inclusions (and convex optimization problems) in Hilbert spaces share the common feature to guarantee for the generated sequences in general weak convergence to a solution. In order to achieve…

Optimization and Control · Mathematics 2017-11-21 Radu Ioan Bot , Ernö Robert Csetnek , Dennis Meier

We propose a third order dynamical system for solving a nonlinear equation in Hilbert spaces where the operator is cocoercive with respect to the solutions set. Under mild conditions on the parameters, we establish the existence and…

Optimization and Control · Mathematics 2024-06-04 Pham Viet Hai , Phan Tu Vuong