English
Related papers

Related papers: A Modified Method of Successive Approximations for…

200 papers

We study a class of nonconvex nonsmooth optimization problems in which the objective is a sum of two functions: One function is the average of a large number of differentiable functions, while the other function is proper, lower…

Optimization and Control · Mathematics 2023-05-12 Duy-Nhat Phan , Sedi Bartz , Nilabja Guha , Hung M. Phan

This article presents a constrained policy optimization approach for the optimal control of systems under nonstationary uncertainties. We introduce an assumption that we call Markov embeddability that allows us to cast the stochastic…

Optimization and Control · Mathematics 2026-05-11 Sungho Shin , François Pacaud , Emil Contantinescu , Mihai Anitescu

A basic simulation-based reinforcement learning algorithm is the Monte Carlo Exploring States (MCES) method, also known as optimistic policy iteration, in which the value function is approximated by simulated returns and a greedy policy is…

Optimization and Control · Mathematics 2020-07-22 Jun Liu

In this paper, we study the generalized mean-field stochastic control problem when the usual stochastic maximum principle (SMP) is not applicable due to the singularity of the Hamiltonian function. In this case, we derive a second order…

Optimization and Control · Mathematics 2017-04-27 Hancheng Guo , Jie Xiong

The entropy regularization is inspired by information entropy from machine learning and the ideas of exploration and exploitation in reinforcement learning, which appears in the control problem to design an approximating algorithm for the…

Optimization and Control · Mathematics 2024-11-21 Ziyue Chen , Qi Zhang

The considered optimal control problem of a stochastic power system, is to select the set of power supply vectors which infimizes the probability that the phase-angle differences of any power flow of the network, endangers the transient…

Optimization and Control · Mathematics 2024-01-31 Zhen Wang , Kaihua Xi , Aijie Cheng , Hai Xiang Lin , Jan H. van Schuppen

The stochastic simulation algorithm (SSA) is widely used to perform exact forward simulation of discrete stochastic processes in biology. However, the computational cost, driven by sequential event-by-event sampling across large ensembles,…

Quantitative Methods · Quantitative Biology 2026-05-04 Tom Kimpson , Mark B. Flegg , Jennifer A. Flegg

In this paper, we study a delayed forward-backward stochastic control system in which all the coefficients depend on the state and control terms, and the control domain is not necessarily convex. A global stochastic maximum principle is…

Optimization and Control · Mathematics 2026-01-21 Feng Li

Majorization-minimization algorithms consist of iteratively minimizing a majorizing surrogate of an objective function. Because of its simplicity and its wide applicability, this principle has been very popular in statistics and in signal…

Machine Learning · Statistics 2013-09-11 Julien Mairal

In this paper, we consider the mixed optimal control of a linear stochastic system with a quadratic cost functional, with two controllers-one can choose only deterministic time functions, called the deterministic controller, while the other…

Optimization and Control · Mathematics 2017-08-23 Ying Hu , Shanjian Tang

In this paper, we introduce a new stochastic approximation (SA) type algorithm, namely the randomized stochastic gradient (RSG) method, for solving an important class of nonlinear (possibly nonconvex) stochastic programming (SP) problems.…

Optimization and Control · Mathematics 2015-10-27 Saeed Ghadimi , Guanghui Lan

This work develops a stochastic model predictive controller~(SMPC) for uncertain linear systems with additive Gaussian noise subject to state and control constraints. The proposed approach is based on the recently developed finite-horizon…

Optimization and Control · Mathematics 2019-11-26 Kazuhide Okamoto , Panagiotis Tsiotras

This paper is devoted to a global stochastic maximum principle for conditional mean-field forward-backward stochastic differential equations (FBSDEs, for short) with regime switching. The control domain is unnecessarily convex and the…

Optimization and Control · Mathematics 2022-12-06 Tao Hao , Jiaqiang Wen , Jie Xiong

We consider control constrained optimal control problems governed by parameterized stationary Maxwell's system with the Gauss's law. The parameters enter through dielectric, magnetic permeability, and charge density. Moreover, the parameter…

Optimization and Control · Mathematics 2020-04-20 Harbir Antil , Tran Nhan Tam Quyen

For obtaining optimal first-order convergence guarantee for stochastic optimization, it is necessary to use a recurrent data sampling algorithm that samples every data point with sufficient frequency. Most commonly used data sampling…

Optimization and Control · Mathematics 2024-07-23 William G. Powell , Hanbaek Lyu

We propose a stochastic approximation method for approximating the efficient frontier of chance-constrained nonlinear programs. Our approach is based on a bi-objective viewpoint of chance-constrained programs that seeks solutions on the…

Optimization and Control · Mathematics 2020-05-29 Rohit Kannan , James Luedtke

We consider the optimal control problem of stochastic evolution equations in a Hilbert space under a recursive utility, which is described as the solution of a backward stochastic differential equation (BSDE). A very general maximum…

Optimization and Control · Mathematics 2024-02-06 Guomin Liu , Shanjian Tang

We study PCA as a stochastic optimization problem and propose a novel stochastic approximation algorithm which we refer to as "Matrix Stochastic Gradient" (MSG), as well as a practical variant, Capped MSG. We study the method both…

Machine Learning · Statistics 2013-07-08 Raman Arora , Andrew Cotter , Nathan Srebro

The optimal control problem of stochastic systems is commonly solved via robust or scenario-based optimization methods, which are both challenging to scale to long optimization horizons. We cast the optimal control problem of a stochastic…

Machine Learning · Computer Science 2025-09-17 Etienne Buehrle , Christoph Stiller

The Alternating Direction Method of Multipliers (ADMM) has been studied for years. The traditional ADMM algorithm needs to compute, at each iteration, an (empirical) expected loss function on all training examples, resulting in a…

Machine Learning · Statistics 2014-06-10 Peilin Zhao , Jinwei Yang , Tong Zhang , Ping Li