中文
相关论文

相关论文: The strong convergence of operator-splitting metho…

200 篇论文

It is well known that the Euler method for a random ordinary differential equation $\mathrm{d}X_t/\mathrm{d}t = f(t, X_t, Y_t)$ driven by a stochastic process $\{Y_t\}_t$ with $\theta$-H\"older sample paths is estimated to be of strong…

概率论 · 数学 2025-10-21 Peter E. Kloeden , Ricardo M. S. Rosa

Standard first-order Langevin algorithms such as the unadjusted Langevin algorithm (ULA) are obtained by discretizing the Langevin diffusion and are widely used for sampling in machine learning because they scale to high dimensions and…

机器学习 · 统计学 2025-09-25 Mert Gurbuzbalaban , Hoang M. Nguyen , Xicheng Zhang , Lingjiong Zhu

Recently, various high-order methods have been developed to solve the convex optimization problem. The auxiliary problem of these methods shares the general form that is the same as the high-order proximal operator proposed by Nesterov. In…

最优化与控制 · 数学 2023-09-06 Jingyu Gao , Xiurui Geng

In this paper we consider splitting methods for the time integration of parabolic and certain classes of hyperbolic partial differential equations, where one partial flow can not be computed exactly. Instead, we use a numerical…

数值分析 · 数学 2017-01-06 Lukas Einkemmer , Alexander Ostermann

A class of monotone operator equations, which can be decomposed into sum of the gradient of a strongly convex function and a linear and skew-symmetric operator, is considered in this work. Based on discretization of the generalized gradient…

最优化与控制 · 数学 2025-01-22 Long Chen , Jingrong Wei

We are concerned with the numerical solution obtained by splitting methods of certain parabolic partial differential equations. Splitting schemes of order higher than two with real coefficients necessarily involve negative coefficients. It…

数值分析 · 数学 2015-04-10 Sergio Blanes , Fernando Casas , Philippe Chartier , Ander Murua

The success of quantum physics in description of various physical interaction phenomena relies primarily on the accuracy of analytical methods used. In quantum mechanics, many of such interactions such as those found in quantum…

量子物理 · 物理学 2019-08-15 Sina Khorasani

Explicit stabilized methods are an efficient alternative to implicit schemes for the time integration of stiff systems of differential equations in large dimension. In this paper, we derive explicit stabilized integrators of orders one and…

数值分析 · 数学 2023-06-09 Ibrahim Almuslimani , Gilles Vilmart

A lot of effort has been invested into characterizing the convergence rates of gradient based algorithms for non-linear convex optimization. Recently, motivated by large datasets and problems in machine learning, the interest has shifted…

分布式、并行与集群计算 · 计算机科学 2012-07-23 Konstantinos I. Tsianos , Michael G. Rabbat

In this work, we propose a new splitting algorithm for solving structured monotone inclusion problems composed of a maximally monotone operator, a maximally monotone and Lipschitz continuous operator and a cocoercive operator. Our method…

最优化与控制 · 数学 2025-11-07 Liqian Qin , Yuchao Tang , Jigen Peng

Recently, there has been significant progress in the development of distributed first order methods. (At least) two different types of methods, designed from very different perspectives, have been proposed that achieve both exact and linear…

信息论 · 计算机科学 2017-12-27 Dusan Jakovetic

This note is devoted to the splitting algorithm proposed by Davis and Yin in 2017 for computing a zero of the sum of three maximally monotone operators, with one of them being cocoercive. We provide a direct proof that guarantees its…

最优化与控制 · 数学 2022-01-19 Francisco J. Aragón-Artacho , David Torregrosa-Belén

Sampling from a high-dimensional distribution is a fundamental task in statistics, engineering, and the sciences. A canonical approach is the Langevin Algorithm, i.e., the Markov chain for the discretized Langevin Diffusion. This is the…

统计理论 · 数学 2022-11-01 Jason M. Altschuler , Kunal Talwar

Mesoscopic models in the reaction-diffusion framework have gained recognition as a viable approach to describing chemical processes in cell biology. The resulting computational problem is a continuous-time Markov chain on a discrete and…

数值分析 · 数学 2016-01-13 Stefan Engblom

Discretizations of Langevin diffusions provide a powerful method for sampling and Bayesian inference. However, such discretizations require evaluation of the gradient of the potential function. In several real-world scenarios, obtaining…

统计理论 · 数学 2021-01-19 Abhishek Roy , Lingqing Shen , Krishnakumar Balasubramanian , Saeed Ghadimi

In this paper we develop a statistical theory and an implementation of deep learning models. We show that an elegant variable splitting scheme for the alternating direction method of multipliers optimises a deep learning objective. We allow…

机器学习 · 统计学 2015-09-22 Nicholas G. Polson , Brandon T. Willard , Massoud Heidari

We propose a solution for linear inverse problems based on higher-order Langevin diffusion. More precisely, we propose pre-conditioned second-order and third-order Langevin dynamics that provably sample from the posterior distribution of…

机器学习 · 统计学 2023-12-08 Nicolas Zilberstein , Ashutosh Sabharwal , Santiago Segarra

Sampling with Markov chain Monte Carlo methods often amounts to discretizing some continuous-time dynamics with numerical integration. In this paper, we establish the convergence rate of sampling algorithms obtained by discretizing smooth…

机器学习 · 统计学 2020-02-04 Xuechen Li , Denny Wu , Lester Mackey , Murat A. Erdogdu

Proximal splitting algorithms for monotone inclusions (and convex optimization problems) in Hilbert spaces share the common feature to guarantee for the generated sequences in general weak convergence to a solution. In order to achieve…

最优化与控制 · 数学 2017-11-21 Radu Ioan Bot , Ernö Robert Csetnek , Dennis Meier

We propose a third order dynamical system for solving a nonlinear equation in Hilbert spaces where the operator is cocoercive with respect to the solutions set. Under mild conditions on the parameters, we establish the existence and…

最优化与控制 · 数学 2024-06-04 Pham Viet Hai , Phan Tu Vuong