English
Related papers

Related papers: Optimistic Online Non-stochastic Control via FTRL

200 papers

This paper studies online nonstochastic control problems with adversarial and static constraints. We propose online nonstochastic control algorithms that achieve both sublinear regret and sublinear adversarial constraint violation while…

Machine Learning · Computer Science 2023-02-07 Xin Liu , Zixian Yang , Lei Ying

We study the problem of adaptively controlling a known discrete-time nonlinear system subject to unmodeled disturbances. We prove the first finite-time regret bounds for adaptive nonlinear control with matched uncertainty in the stochastic…

Machine Learning · Computer Science 2020-11-30 Nicholas M. Boffi , Stephen Tu , Jean-Jacques E. Slotine

In this paper we design a novel class of online distributed optimization algorithms leveraging control theoretical techniques. We start by focusing on quadratic costs, and assuming to know an internal model of their variation. In this…

Optimization and Control · Mathematics 2026-01-21 Wouter J. A. van Weerelt , Nicola Bastianello

We study how to safely control nonlinear control-affine systems that are corrupted with bounded non-stochastic noise, i.e., noise that is unknown a priori and that is not necessarily governed by a stochastic model. We focus on safety…

Systems and Control · Electrical Eng. & Systems 2024-12-11 Hongyu Zhou , Yichen Song , Vasileios Tzoumas

We study the problem of distributed online control of networked systems with time-varying cost functions and disturbances, where each node only has local information of the states and forecasts of the costs and disturbances. We develop a…

Optimization and Control · Mathematics 2025-07-18 Eric Xu , Soummya Kar , Guannan Qu

We investigate the problem of stochastic network optimization in the presence of imperfect state prediction and non-stationarity. Based on a novel distribution-accuracy curve prediction model, we develop the predictive learning-aided…

Optimization and Control · Mathematics 2018-07-09 Longbo Huang , Minghua Chen , Yunxin Liu

In this paper, we propose an online learning-based predictive control (LPC) approach designed for nonlinear systems that lack explicit system dynamics. Unlike traditional model predictive control (MPC) algorithms that rely on known system…

Optimization and Control · Mathematics 2025-03-17 Yuanqing Zhang , Huanshui Zhang

In this paper, we propose a learning approach to analyze dynamic systems with asymmetric information structure. Instead of adopting a game theoretic setting, we investigate an online quadratic optimization problem driven by system noises…

Optimization and Control · Mathematics 2018-11-05 Cheng Tan , Wing Shing Wong

We propose a novel Stochastic Model Predictive Control (MPC) for uncertain linear systems subject to probabilistic constraints. The proposed approach leverages offline learning to extract key features of affine disturbance feedback…

Systems and Control · Electrical Eng. & Systems 2024-11-22 Hotae Lee , Francesco Borrelli

In this paper, we investigate the power of online learning in stochastic network optimization with unknown system statistics {\it a priori}. We are interested in understanding how information and learning can be efficiently incorporated…

Optimization and Control · Mathematics 2014-07-30 Longbo Huang , Xin Liu , Xiaohong Hao

Optimistic concurrency control (OCC) can exploit the strengths of parallel hardware to provide excellent performance for uncontended transactions, and is popular in high-performance in-memory databases and transactional systems. But at high…

Databases · Computer Science 2018-11-14 Yihe Huang , Hao Bai , Eddie Kohler , Barbara Liskov , Liuba Shrira

Recently, much work has been done on extending the scope of online learning and incremental stochastic optimization algorithms. In this paper we contribute to this effort in two ways: First, based on a new regret decomposition and a…

Machine Learning · Computer Science 2017-09-12 Pooria Joulani , András György , Csaba Szepesvári

In real-world problems, uncertainties (e.g., errors in the measurement, precision errors) often lead to poor performance of numerical algorithms when not explicitly taken into account. This is also the case for control problems, where…

Optimization and Control · Mathematics 2020-12-18 Carlos Ignacio Hernández Castellanos , Sina Ober-Blöbaum , Sebastian Peitz

Online learning algorithms for dynamical systems provide finite time guarantees for control in the presence of sequentially revealed cost functions. We pose the classical linear quadratic tracking problem in the framework of online…

Systems and Control · Electrical Eng. & Systems 2024-10-18 Aren Karapetyan , Diego Bolliger , Anastasios Tsiamis , Efe C. Balta , John Lygeros

Optimal control problems (OCPs) involve finding a control function for a dynamical system such that a cost functional is optimized. It is central to physical systems in both academia and industry. In this paper, we propose a novel…

Systems and Control · Electrical Eng. & Systems 2024-12-18 Mingquan Feng , Zhijie Chen , Yixin Huang , Yizhou Liu , Junchi Yan

We propose a formulation for approximate constrained nonlinear output-feedback stochastic model predictive control. Starting from the ideal but intractable stochastic optimal control problem (OCP), which involves the optimization over…

Optimization and Control · Mathematics 2023-01-10 Florian Messerer , Katrin Baumgärtner , Moritz Diehl

We propose a novel unsupervised learning framework for solving nonlinear optimal control problems (OCPs) with input constraints in real-time. In this framework, a neural network (NN) learns to predict the optimal co-state trajectory that…

Systems and Control · Electrical Eng. & Systems 2025-07-17 Lihan Lian , Yuxin Tong , Uduak Inyang-Udoh

Robust Optimization has traditionally taken a pessimistic, or worst-case viewpoint of uncertainty which is motivated by a desire to find sets of optimal policies that maintain feasibility under a variety of operating conditions. In this…

Machine Learning · Statistics 2017-11-22 Matthew Norton , Akiko Takeda , Alexander Mafusalov

In this paper we focus on the solution of online problems with time-varying, linear equality and inequality constraints. Our approach is to design a novel online algorithm by leveraging the tools of control theory. In particular, for the…

Optimization and Control · Mathematics 2025-09-04 Umberto Casti , Nicola Bastianello , Ruggero Carli , Sandro Zampieri

AI/ML-based tools are at the forefront of resource management solutions for communication networks. Deep learning, in particular, is highly effective in facilitating fast and high-performing decision-making whenever representative training…

Networking and Internet Architecture · Computer Science 2025-04-07 George Iosifidis , Naram Mhaisen , Douglas J. Leith