中文
相关论文

相关论文: Forward-backward-forward methods with variance red…

200 篇论文

We propose a new method for the numerical solution of backward stochastic differential equations (BSDEs) which finds its roots in Fourier analysis. The method consists of an Euler time discretization of the BSDE with certain conditional…

概率论 · 数学 2015-06-25 Cody Blaine Hyndman , Polynice Oyono Ngou

In this work, we concern with the high order numerical methods for coupled forward-backward stochastic differential equations (FBSDEs). Based on the FBSDEs theory, we derive two reference ordinary differential equations (ODEs) from the…

数值分析 · 数学 2014-03-27 Weidong Zhao , Yu Fu , Tao Zhou

We study stochastic Nash equilibrium problems with expected valued cost functions whose pseudogradient satisfies restricted monotonicity properties which hold only with respect to the solution. We propose a forward-backward algorithm and…

最优化与控制 · 数学 2021-11-05 Barbara Franci , Sergio Grammatico

In this paper we study stochastic quasi-Newton methods for nonconvex stochastic optimization, where we assume that only stochastic information of the gradients of the objective function is available via a stochastic first-order oracle…

最优化与控制 · 数学 2014-12-05 Xiao Wang , Shiqian Ma , Wei Liu

The Nonlinear Forward-Backward (NFB) algorithm, also known as warped resolvent iterations, is a splitting method for finding zeros of sums of monotone operators. In particular cases, NFB reduces to well-known algorithms such as…

最优化与控制 · 数学 2025-12-03 Juan José Maulén , Fernando Roldán , Cristian Vega

In this paper we study stochastic quasi-Newton methods for nonconvex stochastic optimization, where we assume that noisy information about the gradients of the objective function is available via a stochastic first-order oracle (SFO). We…

最优化与控制 · 数学 2017-05-23 Xiao Wang , Shiqian Ma , Donald Goldfarb , Wei Liu

We propose an accelerated algorithm with a Frank-Wolfe method as an oracle for solving strongly monotone variational inequality problems. While standard solution approaches, such as projected gradient descent (aka value iteration), involve…

最优化与控制 · 数学 2025-10-07 Reza Rahimi Baghbadorani , Peyman Mohajerin Esfahani , Sergio Grammatico

In this paper, we present a stochastic forward-backward-half forward splitting algorithm with variance reduction for solving the structured monotone inclusion problem composed of a maximally monotone operator, a maximally monotone operator…

最优化与控制 · 数学 2025-06-10 Liqian Qin , Yaxuan Zhang , Qiao-Li Dong , Michael Th. Rassias

In this work, we apply the Stochastic Grid Bundling Method (SGBM) to numerically solve backward stochastic differential equations (BSDEs). The SGBM algorithm is based on conditional expectations approximation by means of bundling of Monte…

数值分析 · 数学 2019-08-26 Ki Wai Chau , Cornelis W. Oosterlee

The Forward-Forward (FF) algorithm presents a compelling, bio-inspired alternative to backpropagation. However, while efficient in training, it has a computationally prohibitive inference process that requires a separate forward pass for…

机器学习 · 计算机科学 2026-05-04 Shalini Sarode , Brian Moser , Joachim Folz , Federico Raue , Tobias Nauen , Stanislav Frolov , Andreas Dengel

This paper presents an approach for obtaining approximate solutions to quasi-variational inequalities in a real Hilbert space by modifying Tseng's scheme, which was originally designed for variational inequalities. The study explores the…

最优化与控制 · 数学 2025-05-08 Lkhamsuren Altangerel

We study in this paper a forward-backward-forward dynamical system for solving a mixed variational inequality problem in a real Hilbert space. For the convergence analysis of our proposed system, we apply the Lyapunov analysis to obtain the…

最优化与控制 · 数学 2025-11-25 Chidi Elijah Nwakpa , Chinedu Izuchukwu , Chibueze Christian Okeke

We present a new Progressive Hedging Algorithm to solve Stochastic Variational Inequalities in the formulation introduced by Rockafellar and Wets in 2017, allowing the generated subproblems to be approximately solved with an implementable…

最优化与控制 · 数学 2023-01-25 Emelin L. Buscaglia , Pablo A. Lotito , Lisandro A. Parente

In this paper, by using tools of second-order variational analysis, we study the popular forward-backward splitting method with Beck-Teboulle's line-search for solving convex optimization problem where the objective function can be split…

最优化与控制 · 数学 2018-06-19 Yunier Bello-Cruz , G. Li , T. T. A. Nghia

Novel multi-step predictor-corrector numerical schemes have been derived for approximating decoupled forward-backward stochastic differential equations (FBSDEs). The stability and high order rate of convergence of the schemes are rigorously…

数值分析 · 数学 2021-02-12 Qiang Han , Shaolin Ji

Forward-backward stochastic differential equations (FBSDEs) have attracted significant attention since they were introduced almost 30 years ago, due to their wide range of applications, from solving non-linear PDEs to pricing American-type…

概率论 · 数学 2022-09-21 Elena Issoglio , Shuai Jing

We propose a new stochastic L-BFGS algorithm and prove a linear convergence rate for strongly convex and smooth functions. Our algorithm draws heavily from a recent stochastic variant of L-BFGS proposed in Byrd et al. (2014) as well as a…

最优化与控制 · 数学 2016-04-15 Philipp Moritz , Robert Nishihara , Michael I. Jordan

In this paper, we provide a generalization of the forward-backward splitting algorithm for minimizing the sum of a proper convex lower semicontinuous function and a differentiable convex function whose gradient satisfies a locally…

最优化与控制 · 数学 2023-06-29 Luis M. Briceno-Arias , Francisco José Silva , Xianjin Yang

The Forward-Forward (FF) learning algorithm provides a bottom-up alternative to backpropagation (BP) for training neural networks, relying on a layer-wise "goodness" function with well-designed negative samples for contrastive learning.…

机器学习 · 计算机科学 2025-11-11 Zhichao Zhu , Yang Qi , Hengyuan Ma , Wenlian Lu , Jianfeng Feng

We present two stochastic descent algorithms that apply to unconstrained optimization and are particularly efficient when the objective function is slow to evaluate and gradients are not easily obtained, as in some PDE-constrained…

最优化与控制 · 数学 2019-04-30 David Kozak , Stephen Becker , Alireza Doostan , Luis Tenorio