English
Related papers

Related papers: Gradient-Variation Regret Bounds for Unconstrained…

200 papers

We consider the setting of online linear regression for arbitrary deterministic sequences, with the square loss. We are interested in the aim set by Bartlett et al. (2015): obtain regret bounds that hold uniformly over all competitor…

Machine Learning · Statistics 2019-02-26 Pierre Gaillard , Sébastien Gerchinovitz , Malo Huard , Gilles Stoltz

Maintaining predictive accuracy in non-stationary environments requires online model selection to adapt autonomously to unknown distribution shifts. However, existing tuning-free algorithms face a fundamental trade-off between robustness…

Machine Learning · Computer Science 2026-05-27 Kei Takemura , Ryuta Matsuno , Keita Sakuma

In this paper, we revisit the problem of smoothed online learning, in which the online learner suffers both a hitting cost and a switching cost, and target two performance metrics: competitive ratio and dynamic regret with switching cost.…

Machine Learning · Computer Science 2021-05-19 Lijun Zhang , Wei Jiang , Shiyin Lu , Tianbao Yang

Projection-free online learning has drawn increasing interest due to its efficiency in solving high-dimensional problems with complicated constraints. However, most existing projection-free online methods focus on minimizing the static…

Machine Learning · Computer Science 2023-05-22 Yibo Wang , Wenhao Yang , Wei Jiang , Shiyin Lu , Bing Wang , Haihong Tang , Yuanyu Wan , Lijun Zhang

Recently, much work has been done on extending the scope of online learning and incremental stochastic optimization algorithms. In this paper we contribute to this effort in two ways: First, based on a new regret decomposition and a…

Machine Learning · Computer Science 2017-09-12 Pooria Joulani , András György , Csaba Szepesvári

We study the problem of online learning (OL) from revealed preferences: a learner wishes to learn a non-strategic agent's private utility function through observing the agent's utility-maximizing actions in a changing environment. We adopt…

Optimization and Control · Mathematics 2021-06-07 Violet Xinying Chen , Fatma Kılınç-Karzan

We study online reinforcement learning in linear Markov decision processes with adversarial losses and bandit feedback, without prior knowledge on transitions or access to simulators. We introduce two algorithms that achieve improved regret…

Machine Learning · Computer Science 2023-10-19 Haolin Liu , Chen-Yu Wei , Julian Zimmert

We develop algorithms for online linear regression which achieve optimal static and dynamic regret guarantees \emph{even in the complete absence of prior knowledge}. We present a novel analysis showing that a discounted variant of the…

Machine Learning · Computer Science 2024-05-30 Andrew Jacobsen , Ashok Cutkosky

We study online maximization of non-monotone Diminishing-Return(DR)-submodular functions over down-closed convex sets, a regime where existing projection-free online methods suffer from suboptimal regret and limited feedback guarantees. Our…

Machine Learning · Computer Science 2026-02-25 Yiyang Lu , Haresh Jadav , Mohammad Pedramfar , Ranveer Singh , Vaneet Aggarwal

As application demands for online convex optimization accelerate, the need for designing new methods that simultaneously cover a large class of convex functions and impose the lowest possible regret is highly rising. Known online…

Machine Learning · Computer Science 2019-06-04 Saeed Masoudian , Ali Arabzadeh , Mahdi Jafari Siavoshani , Milad Jalal , Alireza Amouzad

We consider online optimization with binary decision variables and convex loss functions. We design a new algorithm, binary online gradient descent (bOGD) and bound its expected dynamic regret. We provide a regret bound that holds for any…

Optimization and Control · Mathematics 2022-01-21 Antoine Lesage-Landry , Joshua A. Taylor , Duncan S. Callaway

We study the problem of safe online convex optimization, where the action at each time step must satisfy a set of linear safety constraints. The goal is to select a sequence of actions to minimize the regret without violating the safety…

Machine Learning · Computer Science 2021-11-16 Sapana Chaudhary , Dileep Kalathil

In this paper we propose a framework for solving constrained online convex optimization problem. Our motivation stems from the observation that most algorithms proposed for online convex optimization require a projection onto the convex set…

Machine Learning · Computer Science 2012-10-01 Mehrdad Mahdavi , Rong Jin , Tianbao Yang

We study the problem of expert advice under partial bandit feedback setting and create a sequential minimax optimal algorithm. Our algorithm works with a more general partial monitoring setting, where, in contrast to the classical bandit…

Machine Learning · Computer Science 2022-04-15 Kaan Gokcesu , Hakan Gokcesu

We examine the problem of regret minimization when the learner is involved in a continuous game with other optimizing agents: in this case, if all players follow a no-regret algorithm, it is possible to achieve significantly lower regret…

Computer Science and Game Theory · Computer Science 2023-03-20 Yu-Guan Hsieh , Kimon Antonakopoulos , Volkan Cevher , Panayotis Mertikopoulos

We consider the problem of universal dynamic regret minimization under exp-concave and smooth losses. We show that appropriately designed Strongly Adaptive algorithms achieve a dynamic regret of $\tilde O(d^2 n^{1/5} C_n^{2/5} \vee d^2)$,…

Machine Learning · Computer Science 2023-02-28 Dheeraj Baby , Yu-Xiang Wang

We study the adversarial online learning problem and create a completely online algorithmic framework that has data dependent regret guarantees in both full expert feedback and bandit feedback settings. We study the expected performance of…

Machine Learning · Computer Science 2023-03-14 Kaan Gokcesu , Hakan Gokcesu

We consider the online control problem with an unknown linear dynamical system in the presence of adversarial perturbations and adversarial convex loss functions. Although the problem is widely studied in model-based control, it remains…

Systems and Control · Electrical Eng. & Systems 2024-03-12 Zishun Liu , Yongxin Chen

We consider the task of learning to control a linear dynamical system under fixed quadratic costs, known as the Linear Quadratic Regulator (LQR) problem. While model-free approaches are often favorable in practice, thus far only model-based…

Machine Learning · Computer Science 2021-02-26 Asaf Cassel , Tomer Koren

We address the problem of simultaneously learning and control in an online receding horizon control setting. We consider the control of an unknown linear dynamical system with general cost functions and affine constraints on the control…

Optimization and Control · Mathematics 2022-11-02 Deepan Muthirayan , Jianjun Yuan , Pramod P. Khargonekar