English
Related papers

Related papers: The strong convergence of operator-splitting metho…

200 papers

Splitting methods are widely used for solving initial value problems (IVPs) due to their ability to simplify complicated evolutions into more manageable subproblems which can be solved efficiently and accurately. Traditionally, these…

Numerical Analysis · Mathematics 2024-11-15 L. M. Kreusser , H. E. Lockyer , E. H. Müller , P. Singh

We propose and study a novel stochastic inertial primal-dual approach to solve composite optimization problems. These latter problems arise naturally when learning with penalized regularization schemes. Our analysis provide convergence…

Optimization and Control · Mathematics 2015-07-06 Lorenzo Rosasco , Silvia Villa , Bang Cong Vu

In a recent paper by Kamrani et al. (2024), exponential Euler method for stiff stochastic differential equations with additive fractional Brownian noise was discussed, and the convergence order close to the Hurst parameter H was proved.…

Probability · Mathematics 2024-07-08 Haozhe Chen , Zhaotong Shen , Qian Yu

An extension and generalization of a recently presented approach for the analysis of Langevin-type stochastic processes in the presence of strong measurement noise is presented. For a stochastic process in N dimensions which is superimposed…

Data Analysis, Statistics and Probability · Physics 2012-10-23 B. Lehle

In this paper, we introduce some adaptive methods for solving variational inequalities with relatively strongly monotone operators. Firstly, we focus on the modification of the recently proposed, in smooth case [1], adaptive numerical…

Optimization and Control · Mathematics 2022-11-01 A. A. Titov , S. S. Ablaev , M. S. Alkousa , F. S. Stonyakin , A. V. Gasnikov

Periodic orbit theory allows calculations of long time properties of chaotic systems from traces, dynamical zeta functions and spectral determinants of deterministic evolution operators, which are in turn evaluated in terms of periodic…

chao-dyn · Physics 2009-10-31 C. P. Dettmann

The concept of effective order is a popular methodology in the deterministic literature for the construction of efficient and accurate integrators for differential equations over long times. The idea is to enhance the accuracy of a…

Numerical Analysis · Mathematics 2016-08-18 Gilles Vilmart

Stochastic Gradient Descent Langevin Dynamics (SGLD) algorithms, which add noise to the classic gradient descent, are known to improve the training of neural networks in some cases where the neural network is very deep. In this paper we…

Computational Finance · Quantitative Finance 2023-01-16 Pierre Bras , Gilles Pagès

Efficient Boltzmann-sampling using first-principles methods is challenging for extended systems due to the steep scaling of electronic structure methods with the system size. Stochastic approaches provide a gentler system-size dependency at…

Computational Physics · Physics 2020-05-20 Eitam Arnon , Eran Rabani , Daniel Neuhauser , Roi Baer

Most work on supervised learning research has focused on marginal predictions. In decision problems, joint predictive distributions are essential for good performance. Previous work has developed methods for assessing low-order predictive…

Machine Learning · Statistics 2022-03-01 Ian Osband , Zheng Wen , Seyed Mohammad Asghari , Vikranth Dwaracherla , Xiuyuan Lu , Benjamin Van Roy

In the framework of a real Hilbert space, we address the problem of finding the zeros of the sum of a maximally monotone operator $A$ and a cocoercive operator $B$. We study the asymptotic behaviour of the trajectories generated by a second…

Optimization and Control · Mathematics 2022-01-05 Radu Ioan Bot , David Alexander Hulett

We develop a novel class of MCMC algorithms based on a stochastized Nesterov scheme. With an appropriate addition of noise, the result is a time-inhomogeneous underdamped Langevin equation, which we prove emits a specified target…

Computational Engineering, Finance, and Science · Computer Science 2023-11-29 Duy H. Thai , Alexander L. Young , David B. Dunson

Second-order methods for convex optimization outperform first-order methods in terms of theoretical iteration convergence, achieving rates up to $O(k^{-5})$ for highly-smooth functions. However, their practical performance and applications…

Optimization and Control · Mathematics 2024-10-15 Dmitry Kamzolov , Dmitry Pasechnyuk , Artem Agafonov , Alexander Gasnikov , Martin Takáč

We study operator-splitting schemes for approximating Koopman generators of linear semigroups induced by nonlinear flows, a framework originating with Dorroh and Neuberger. Building on ideas of Lie, Kowalewski, and Gr\"{o}bner, we analyze…

Numerical Analysis · Mathematics 2025-12-17 A. Banjara , I. AlJabea , T. Papamarkou , F. Neubrander

We study differentiable strongly quasiconvex functions for providing new properties for algorithmic and monotonicity purposes. Furthemore, we provide insights into the decreasing behaviour of strongly quasiconvex functions, applying this…

Optimization and Control · Mathematics 2024-10-07 Felipe Lara , Raúl T. Marcavillaca , Phan T. Vuong

Classical convergence theory of Runge-Kutta methods assumes that the time step is small relative to the Lipschitz constant of the ordinary differential equation (ODE). For stiff problems, that assumption is often violated, and a problematic…

Numerical Analysis · Mathematics 2026-05-05 Steven B. Roberts , David Shirokoff , Abhijit Biswas , Benjamin Seibold

We review some of the techniques used to study the dynamics of disordered systems subject to both quenched and fast (thermal) noise. Starting from the Martin-Siggia-Rose path integral formalism for a single variable stochastic dynamics, we…

Disordered Systems and Neural Networks · Physics 2017-01-26 John A. Hertz , Yasser Roudi , Peter Sollich

We present in this paper two different classes of general $K$-splitting algorithms for solving finite-dimensional convex optimization problems. Under the assumption that the function being minimized has a Lipschitz continuous gradient, we…

Optimization and Control · Mathematics 2015-03-13 Donald Goldfarb , Shiqian Ma

We consider the numerical approximation of the stochastic complex Ginzburg-Landau equation with additive noise on the one dimensional torus. The complex nature of the equation means that many of the standard approaches developed for…

Numerical Analysis · Mathematics 2024-12-12 Marvin Jans , Gabriel J. Lord , Mariya Ptashnyk

The complex Langevin method is a leading candidate for solving the sign problem occurring in various physical situations, notably QCD at finite chemical potential. Its most vexing problem is `convergence to the wrong limit', where the…

High Energy Physics - Lattice · Physics 2011-10-27 Gert Aarts , Frank A. James , Erhard Seiler , Ion-Olimpiu Stamatescu