English
Related papers

Related papers: Optimal Anytime Algorithms for Online Convex Optim…

200 papers

This paper proposes a modular approach that combines the online convex optimization framework and reference governors to solve a constrained control problem featuring time-varying and a priori unknown cost functions. Compared to existing…

Systems and Control · Electrical Eng. & Systems 2025-07-14 Marko Nonhoff , Johannes Köhler , Matthias A. Müller

In this paper, we study adaptive online convex optimization, and aim to design a universal algorithm that achieves optimal regret bounds for multiple common types of loss functions. Existing universal methods are limited in the sense that…

Machine Learning · Computer Science 2019-05-16 Guanghui Wang , Shiyin Lu , Lijun Zhang

First-order methods are often analyzed via their continuous-time models, where their worst-case convergence properties are usually approached via Lyapunov functions. In this work, we provide a systematic and principled approach to find and…

Numerical Analysis · Mathematics 2024-03-12 Céline Moucer , Adrien Taylor , Francis Bach

In this paper, the online variants of the classical Frank-Wolfe algorithm are considered. We consider minimizing the regret with a stochastic cost. The online algorithms only require simple iterative updates and a non-adaptive step size…

Machine Learning · Statistics 2016-08-16 Jean Lafond , Hoi-To Wai , Eric Moulines

One of the main strengths of online algorithms is their ability to adapt to arbitrary data sequences. This is especially important in nonparametric settings, where performance is measured against rich classes of comparator functions that…

Machine Learning · Computer Science 2020-11-03 Ilja Kuzborskij , Nicolò Cesa-Bianchi

Online safe reinforcement learning (RL) plays a key role in dynamic environments, with applications in autonomous driving, robotics, and cybersecurity. The objective is to learn optimal policies that maximize rewards while satisfying safety…

Machine Learning · Computer Science 2025-06-03 Jiahui Zhu , Kihyun Yu , Dabeen Lee , Xin Liu , Honghao Wei

First-order methods underpin most large-scale learning algorithms, yet their classical convergence guarantees hinge on carefully scheduled step-sizes that depend on the total horizon $T$, which is rarely known in advance. The Schedule-Free…

Machine Learning · Computer Science 2025-08-12 Connor Brown

We study the problem of online non-stochastic control (ONC), which is the control of a linear system under adversarial disturbances and adversarial cost functions, with the aim of minimizing the total cost incurred. A recent line of…

Optimization and Control · Mathematics 2026-04-21 Vijeth Hebbar , Spencer Hutchinson , Mahnoosh Alizadeh , Cédric Langbort

A novel Follow-the-Perturbed-Leader type algorithm is proposed and analyzed for solving general long-term constrained optimization problems in an online manner, where the target and constraint functions are oblivious adversarially generated…

Optimization and Control · Mathematics 2025-10-02 Shijie Pan , Jianyu Xu , Wenjie Huang

We study Online Convex Optimization with adversarial constraints (COCO). At each round a learner selects an action from a convex decision set and then an adversary reveals a convex cost and a convex constraint function. The goal of the…

Machine Learning · Computer Science 2025-11-17 Abhishek Sinha , Rahul Vaze

We study the problems of distributed online and bandit convex optimization against an adaptive adversary. We aim to minimize the average regret on $M$ machines working in parallel over $T$ rounds with $R$ intermittent communications.…

Machine Learning · Computer Science 2023-11-30 Kumar Kshitij Patel , Lingxiao Wang , Aadirupa Saha , Nati Sebro

In this paper we focus on the solution of online problems with time-varying, linear equality and inequality constraints. Our approach is to design a novel online algorithm by leveraging the tools of control theory. In particular, for the…

Optimization and Control · Mathematics 2025-09-04 Umberto Casti , Nicola Bastianello , Ruggero Carli , Sandro Zampieri

In this work, we develop a framework aiming at designing quantum algorithms for combinatorial optimization problems while providing theoretical guarantees on their approximation ratios. The principal innovative aspect of our work is the…

Quantum Physics · Physics 2025-12-29 Shengminjie Chen , Ziyang Li , Hongyi Zhou , Jialin Zhang , Wenguo Yang , Xiaoming Sun

Given any increasing sequence of norms $\|\cdot\|_0,\dots,\|\cdot\|_{T-1}$, we provide an online convex optimization algorithm that outputs points $w_t$ in some domain $W$ in response to convex losses $\ell_t:W\to \mathbb{R}$ that…

Machine Learning · Computer Science 2020-02-11 Ashok Cutkosky

We revisit multi-agent asynchronous online optimization with delays, where only one of the agents becomes active for making the decision at each round, and the corresponding feedback is received by all the agents after unknown delays.…

Machine Learning · Computer Science 2026-02-05 Lingchan Bao , Tong Wei , Yuanyu Wan

We study online reinforcement learning in linear Markov decision processes with adversarial losses and bandit feedback, without prior knowledge on transitions or access to simulators. We introduce two algorithms that achieve improved regret…

Machine Learning · Computer Science 2023-10-19 Haolin Liu , Chen-Yu Wei , Julian Zimmert

Recently, several universal methods have been proposed for online convex optimization which can handle convex, strongly convex and exponentially concave cost functions simultaneously. However, most of these algorithms have been designed…

Machine Learning · Computer Science 2023-02-14 Arnold Salas

This paper proposes a set of novel optimization algorithms for solving a class of convex optimization problems with time-varying streaming cost function. We develop an approach to track the optimal solution with a bounded error. Unlike the…

Optimization and Control · Mathematics 2023-10-13 M. Rostami , H. Moradian , S. S. Kia

We present a new algorithm based on posterior sampling for learning in Constrained Markov Decision Processes (CMDP) in the infinite-horizon undiscounted setting. The algorithm achieves near-optimal regret bounds while being advantageous…

Machine Learning · Computer Science 2024-05-30 Danil Provodin , Maurits Kaptein , Mykola Pechenizkiy

We study numerical optimisation algorithms that use zeroth-order information to minimise time-varying geodesically-convex cost functions on Riemannian manifolds. In the Euclidean setting, zeroth-order algorithms have received a lot of…

Optimization and Control · Mathematics 2022-02-15 Alejandro I. Maass , Chris Manzie , Dragan Nesic , Jonathan H. Manton , Iman Shames