English
Related papers

Related papers: Deep $\mathcal{L}^1$ Stochastic Optimal Control Po…

200 papers

This paper presents an algorithm to solve non-convex optimal control problems, where non-convexity can arise from nonlinear dynamics, and non-convex state and control constraints. This paper assumes that the state and control constraints…

Optimization and Control · Mathematics 2017-05-05 Yuanqi Mao , Michael Szmuk , Behcet Acikmese

Tasks for autonomous robotic systems commonly require stabilization to a desired region while maintaining safety specifications. However, solving this multi-objective problem is challenging when the dynamics are nonlinear and…

Robotics · Computer Science 2023-05-24 Oswin So , Chuchu Fan

This paper develops algorithms for high-dimensional stochastic control problems based on deep learning and dynamic programming. Unlike classical approximate dynamic programming approaches, we first approximate the optimal policy by means of…

Probability · Mathematics 2021-09-21 Côme Huré , Huyên Pham , Achref Bachouch , Nicolas Langrené

The Projected Gradient Descent (PGD) algorithm is a widely used and efficient first-order method for solving constrained optimization problems due to its simplicity and scalability in large design spaces. Building on recent advancements in…

Optimization and Control · Mathematics 2025-06-18 Lucka Barbeau , Marc-Étienne Lamarche-Gagnon , Florin Ilinca

We investigate the problem of finding second-order stationary points (SOSP) in differentially private (DP) stochastic non-convex optimization. Existing methods suffer from two key limitations: (i) inaccurate convergence error rate due to…

Machine Learning · Computer Science 2026-01-21 Youming Tao , Zuyuan Zhang , Dongxiao Yu , Xiuzhen Cheng , Falko Dressler , Di Wang

Reinforcement learning (RL) has shown promise in solving various combinatorial optimization problems. However, conventional RL faces challenges when dealing with complex, real-world constraints, especially when action space feasibility is…

Machine Learning · Computer Science 2025-08-12 Jaike van Twiller , Yossiri Adulyasak , Erick Delage , Djordje Grbic , Rune Møller Jensen

In centralized settings, it is well known that stochastic gradient descent (SGD) avoids saddle points and converges to local minima in nonconvex problems. However, similar guarantees are lacking for distributed first-order algorithms. The…

Optimization and Control · Mathematics 2022-03-07 Brian Swenson , Ryan Murray , H. Vincent Poor , Soummya Kar

Gradient descent (GD) and stochastic gradient descent (SGD) are the workhorses of large-scale machine learning. While classical theory focused on analyzing the performance of these methods in convex optimization problems, the most notable…

Machine Learning · Computer Science 2019-09-05 Chi Jin , Praneeth Netrapalli , Rong Ge , Sham M. Kakade , Michael I. Jordan

Direct policy search has achieved great empirical success in reinforcement learning. Many recent studies have revisited its theoretical foundation for continuous control, which reveals elegant nonconvex geometry in various benchmark…

Optimization and Control · Mathematics 2023-12-27 Yang Zheng , Chih-fan Pai , Yujie Tang

We study the problem of computing deterministic optimal policies for constrained Markov decision processes (MDPs) with continuous state and action spaces, which are widely encountered in constrained dynamical systems. Designing…

Artificial Intelligence · Computer Science 2025-04-07 Sergio Rozada , Dongsheng Ding , Antonio G. Marques , Alejandro Ribeiro

Stochastic gradient descent (SGD) algorithm and its variations have been effectively used to optimize neural network models. However, with the rapid growth of big data and deep learning, SGD is no longer the most suitable choice due to its…

Machine Learning · Computer Science 2024-02-13 Anuraganand Sharma

Load balancing and auto scaling are at the core of scalable, contemporary systems, addressing dynamic resource allocation and service rate adjustments in response to workload changes. This paper introduces a novel model and algorithms for…

Systems and Control · Electrical Eng. & Systems 2024-06-21 S. R. Eshwar , Lucas Lopes Felipe , Alexandre Reiffers-Masson , Daniel Sadoc Menasché , Gugan Thoppe

Deep neural networks are increasingly used as an effective parameterization of control policies in various learning-based control paradigms. For continuous-time optimal control problems (OCPs), which are central to many decision-making…

Machine Learning · Computer Science 2025-11-04 Joshua Hang Sai Ip , Georgios Makrygiorgos , Ali Mesbah

Steering a system towards a desired target in a very short amount of time is challenging from a computational standpoint. Indeed, the intrinsically iterative nature of optimal control problems requires multiple simulations of the physical…

Optimization and Control · Mathematics 2025-05-16 Matteo Tomasetto , Andrea Manzoni , Francesco Braghin

This paper proposes a data-driven control framework to regulate an unknown, stochastic linear dynamical system to the solution of a (stochastic) convex optimization problem. Despite the centrality of this problem, most of the available…

Optimization and Control · Mathematics 2021-08-31 Gianluca Bianchin , Miguel Vaquero , Jorge Cortes , Emiliano Dall'Anese

In this paper we apply guided policy search (GPS) based reinforcement learning framework for a high dimensional optimal control problem arising in an additive manufacturing process. The problem comprises of controlling the process…

Machine Learning · Computer Science 2020-09-15 Amit Surana , Kishore Reddy , Matthew Siopis

Stochastic gradient descent (SGD) still is the workhorse for many practical problems. However, it converges slow, and can be difficult to tune. It is possible to precondition SGD to accelerate its convergence remarkably. But many attempts…

Machine Learning · Statistics 2017-02-23 Xi-Lin Li

The optimal control problem of stochastic systems is commonly solved via robust or scenario-based optimization methods, which are both challenging to scale to long optimization horizons. We cast the optimal control problem of a stochastic…

Machine Learning · Computer Science 2025-09-17 Etienne Buehrle , Christoph Stiller

In this article, we show that learned policies can be applied to solve legged locomotion control tasks with extensive flight phases, such as those encountered in space exploration. Using an off-the-shelf deep reinforcement learning…

Robotics · Computer Science 2021-06-18 Nikita Rudin , Hendrik Kolvenbach , Vassilios Tsounis , Marco Hutter

Large-scale nonconvex optimization problems are ubiquitous in modern machine learning, and among practitioners interested in solving them, Stochastic Gradient Descent (SGD) reigns supreme. We revisit the analysis of SGD in the nonconvex…

Optimization and Control · Mathematics 2020-07-27 Ahmed Khaled , Peter Richtárik