English
Related papers

Related papers: A Modified Method of Successive Approximations for…

200 papers

We a controlled system driven by a coupled forward-backward stochastic differential equation (FBSDE) with a non degenerate diffusion matrix. The cost functional is defined by the solution of the controlled backward stochastic differential…

Optimization and Control · Mathematics 2017-02-02 Khaled Bahlali , Omar Kebiri , Brahim Mezerdi , Ahmed Mtiraoui

Sample-based Bayesian inference provides a route to uncertainty quantification in the geosciences, and inverse problems in general, though is very computationally demanding in the naive form that requires simulating an accurate computer…

Computation · Statistics 2019-04-12 Tiangang Cui , Colin Fox , Michael J O'Sullivan

This paper investigates the near optimal control for a kind of linear stochastic control systems governed by the forward backward stochastic differential equations, where both the drift and diffusion terms are allowed to depend on controls…

Optimization and Control · Mathematics 2015-01-23 Liangquan Zhang , Jianhui Huang , Xun Li

Machine learning algorithms in high-dimensional settings are highly susceptible to the influence of even a small fraction of structured outliers, making robust optimization techniques essential. In particular, within the…

Machine Learning · Computer Science 2025-04-25 Changyu Gao , Andrew Lowy , Xingyu Zhou , Stephen J. Wright

Bayesian inference for models that have an intractable partition function is known as a doubly intractable problem, where standard Monte Carlo methods are not applicable. The past decade has seen the development of auxiliary variable Monte…

Computation · Statistics 2017-10-13 Richard G. Everitt , Dennis Prangle , Philip Maybank , Mark Bell

Stochastic approximation (SA) that involves multiple coupled sequences, known as multiple-sequence SA (MSSA), finds diverse applications in the fields of signal processing and machine learning. However, existing theoretical understandings…

Machine Learning · Computer Science 2024-10-18 Yue Huang , Zhaoxian Wu , Shiqian Ma , Qing Ling

Memory-limited partially observable stochastic control (ML-POSC) is the stochastic optimal control problem under incomplete information and memory limitation. In order to obtain the optimal control function of ML-POSC, a system of the…

Optimization and Control · Mathematics 2023-02-08 Takehiro Tottori , Tetsuya J. Kobayashi

In this paper, we consider a class of stochastic control problems for stochastic differential equations with random coefficients. The control domain need not to be convex but the control process is not allowed to enter in diffusion term.…

Optimization and Control · Mathematics 2020-08-06 Ishak Alia , Mohamed Sofiane Alia

Stochastic gradient descent type methods are ubiquitous in machine learning, but they are only applicable to the optimization of differentiable functions. Proximal algorithms are more general and applicable to nonsmooth functions. We…

Optimization and Control · Mathematics 2025-05-20 Laurent Condat , Elnur Gasanov , Peter Richtárik

In this paper, we investigate an optimal control problem with terminal stochastic linear complementarity constraints (SLCC), and its discrete approximation using the relaxation, the sample average approximation (SAA) and the implicit Euler…

Optimization and Control · Mathematics 2022-08-17 Jianfeng Luo , Xiaojun Chen

This paper is concerned with a kind of risk-sensitive optimal control problem for fully coupled forward-backward stochastic systems. The control variable enters the diffusion term of the state equation and the control domain is not…

Optimization and Control · Mathematics 2023-04-11 Jingtao Lin , Jingtao Shi

We study the unconstrained and the minimax saddle point variants of the convex multi-stage stochastic programming problem, where consecutive decisions are coupled through the objective functions, rather than through the constraints. We…

Optimization and Control · Mathematics 2026-03-02 Junhui Zhang , Patrick Jaillet

The Robbins-Monro stochastic approximation algorithm is a foundation of many algorithmic frameworks for reinforcement learning (RL), and often an efficient approach to solving (or approximating the solution to) complex optimal control…

Optimization and Control · Mathematics 2019-03-19 Andrey Bernstein , Yue Chen , Marcello Colombino , Emiliano Dall'Anese , Prashant Mehta , Sean Meyn

Motivated by emerging applications in machine learning, we consider an optimization problem in a general form where the gradient of the objective function is available through a biased stochastic oracle. We assume a bias-control parameter…

Optimization and Control · Mathematics 2026-02-10 Yin Liu , Sam Davanloo Tajbakhsh

A challenging problem in decentralized optimization is to develop algorithms with fast convergence on random and time varying topologies under unreliable and bandwidth-constrained communication network. This paper studies a stochastic…

Optimization and Control · Mathematics 2025-05-29 Chung-Yiu Yau , Haoming Liu , Hoi-To Wai

Stochastic approximation (SA) is a classical approach for stochastic convex optimization. Previous studies have demonstrated that the convergence rate of SA can be improved by introducing either smoothness or strong convexity condition. In…

Machine Learning · Computer Science 2019-01-29 Lijun Zhang , Zhi-Hua Zhou

Least squares Monte Carlo methods are a popular numerical approximation method for solving stochastic control problems. Based on dynamic programming, their key feature is the approximation of the conditional expectation of future rewards by…

Optimization and Control · Mathematics 2022-03-28 Christian Bayer , Denis Belomestny , Paul Hager , Paolo Pigato , John Schoenmakers , Vladimir Spokoiny

This paper studies consensus-based decentralized stochastic optimization for minimizing possibly non-convex expected objectives with convex non-smooth regularizers and nonlinear functional inequality constraints. We reformulate the…

Optimization and Control · Mathematics 2026-01-29 Shivangi Dubey Sharma , Basil M. Idrees , Lavish Arora , Ketan Rajawat

We consider stochastic convex optimization problems with affine constraints and develop several methods using either primal or dual approach to solve it. In the primal case, we use a special penalization technique to make the initial…

Optimization and Control · Mathematics 2020-11-13 Eduard Gorbunov , Darina Dvinskikh , Alexander Gasnikov

This paper investigates the optimal control problem for a class of nonlinear fully coupled forward-backward stochastic difference equations (FBS$\Delta$Es). Under the convexity assumption of the control domain, we establish a variational…

Optimization and Control · Mathematics 2025-12-02 Zhipeng Niu , Jun Moon , Qingxin Meng