English
Related papers

Related papers: Optimistic Safety for Online Convex Optimization w…

200 papers

In this paper, we study adaptive online convex optimization, and aim to design a universal algorithm that achieves optimal regret bounds for multiple common types of loss functions. Existing universal methods are limited in the sense that…

Machine Learning · Computer Science 2019-05-16 Guanghui Wang , Shiyin Lu , Lijun Zhang

We consider the problem of online convex optimization against an arbitrary adversary with bandit feedback, known as bandit convex optimization. We give the first $\tilde{O}(\sqrt{T})$-regret algorithm for this setting based on a novel…

Machine Learning · Computer Science 2016-03-16 Elad Hazan , Yuanzhi Li

In online inverse linear optimization, a learner observes time-varying sets of feasible actions and an agent's optimal actions, selected by solving linear optimization over the feasible actions. The learner sequentially makes predictions of…

Machine Learning · Computer Science 2025-05-23 Shinsaku Sakaue , Taira Tsuchiya , Han Bao , Taihei Oki

Online learning algorithms for dynamical systems provide finite time guarantees for control in the presence of sequentially revealed cost functions. We pose the classical linear quadratic tracking problem in the framework of online…

Systems and Control · Electrical Eng. & Systems 2024-10-18 Aren Karapetyan , Diego Bolliger , Anastasios Tsiamis , Efe C. Balta , John Lygeros

We consider the problem of the Zinkevich (2003)-style dynamic regret minimization in online learning with exp-concave losses. We show that whenever improper learning is allowed, a Strongly Adaptive online learner achieves the dynamic regret…

Machine Learning · Computer Science 2021-07-06 Dheeraj Baby , Yu-Xiang Wang

We study online learning problems in which a decision maker has to take a sequence of decisions subject to $m$ long-term constraints. The goal of the decision maker is to maximize their total reward, while at the same time achieving small…

Machine Learning · Computer Science 2022-09-16 Matteo Castiglioni , Andrea Celli , Alberto Marchesi , Giulia Romano , Nicola Gatti

Disturbance rejection in high-precision control applications can be significantly improved upon via online convex optimization (OCO). This includes classical techniques such as recursive least squares (RLS) and more recent, regret-based…

Systems and Control · Electrical Eng. & Systems 2025-04-08 Joyce Lai , Peter Seiler

We consider the online sparse linear regression problem, which is the problem of sequentially making predictions observing only a limited number of features in each round, to minimize regret with respect to the best sparse linear regressor,…

Machine Learning · Computer Science 2016-03-08 Dean Foster , Satyen Kale , Howard Karloff

We study Smoothed Online Convex Optimization, a version of online convex optimization where the learner incurs a penalty for changing her actions between rounds. Given a $\Omega(\sqrt{d})$ lower bound on the competitive ratio of any online…

Machine Learning · Computer Science 2018-07-10 Niangjun Chen , Gautam Goel , Adam Wierman

We study a variant of the stochastic linear bandit problem wherein we optimize a linear objective function but rewards are accrued only orthogonal to an unknown subspace (which we interpret as a \textit{protected space}) given only…

Machine Learning · Computer Science 2021-03-03 Advait Parulekar , Soumya Basu , Aditya Gopalan , Karthikeyan Shanmugam , Sanjay Shakkottai

This paper considers online optimal control with affine constraints on the states and actions under linear dynamics with bounded random disturbances. The system dynamics and constraints are assumed to be known and time-invariant but the…

Systems and Control · Electrical Eng. & Systems 2021-07-14 Yingying Li , Subhro Das , Na Li

We study the problem of online learning in predictive control of an unknown linear dynamical system with time varying cost functions which are unknown apriori. Specifically, we study the online learning problem where the control algorithm…

Machine Learning · Computer Science 2022-11-01 Deepan Muthirayan , Jianjun Yuan , Dileep Kalathil , Pramod P. Khargonekar

We investigate constrained online convex optimization, in which decisions must belong to a fixed and typically complicated domain, and are required to approximately satisfy additional time-varying constraints over the long term. In this…

Machine Learning · Computer Science 2025-01-28 Yibo Wang , Yuanyu Wan , Lijun Zhang

Projection operations are a typical computation bottleneck in online learning. In this paper, we enable projection-free online learning within the framework of Online Convex Optimization with Memory (OCO-M) -- OCO-M captures how the history…

Machine Learning · Computer Science 2023-04-03 Hongyu Zhou , Zirui Xu , Vasileios Tzoumas

We consider the classic problem of online convex optimisation. Whereas the notion of static regret is relevant for stationary problems, the notion of switching regret is more appropriate for non-stationary problems. A switching regret is…

Machine Learning · Computer Science 2025-03-07 Stephen Pasteris , Chris Hicks , Vasilios Mavroudis , Mark Herbster

This paper proposes a modular approach that combines the online convex optimization framework and reference governors to solve a constrained control problem featuring time-varying and a priori unknown cost functions. Compared to existing…

Systems and Control · Electrical Eng. & Systems 2025-07-14 Marko Nonhoff , Johannes Köhler , Matthias A. Müller

Follow-the-Regularized-Leader (FTRL) algorithms are a popular class of learning algorithms for online linear optimization (OLO) that guarantee sub-linear regret, but the choice of regularizer can significantly impact dimension-dependent…

Machine Learning · Computer Science 2024-10-24 Khashayar Gatmiry , Jon Schneider , Stefanie Jegelka

We introduce a new online convex optimization algorithm that adaptively chooses its regularization function based on the loss functions observed so far. This is in contrast to previous algorithms that use a fixed regularization function…

Machine Learning · Computer Science 2010-07-08 H. Brendan McMahan , Matthew Streeter

In many sequential decision making applications, the change of decision would bring an additional cost, such as the wear-and-tear cost associated with changing server status. To control the switching cost, we introduce the problem of online…

Machine Learning · Computer Science 2021-03-23 Guanghui Wang , Yuanyu Wan , Tianbao Yang , Lijun Zhang

This paper considers the distributed online convex-concave optimization with constraint sets over a multiagent network, in which each agent autonomously generates a series of decision pairs through a designable mechanism to cooperatively…

Optimization and Control · Mathematics 2025-08-14 Wentao Zhang , Baoyong Zhang , Deming Yuan , Shengyuan Xu , Vincent K. N. Lau