English
Related papers

Related papers: Understand Dynamic Regret with Switching Cost for …

200 papers

We study an online learning problem on dynamic pricing and resource allocation, where we make joint pricing and inventory decisions to maximize the overall net profit. We consider the stochastic dependence of demands on the price, which…

Machine Learning · Computer Science 2025-05-23 Jianyu Xu , Xuan Wang , Yu-Xiang Wang , Jiashuo Jiang

We propose and study an online version of min-max optimization based on cumulative saddle points under a variety of performance measures beyond convex-concave settings. After first observing the incompatibility of (static) Nash equilibrium…

Machine Learning · Computer Science 2026-02-12 Abhijeet Vyas , Brian Bullins

The dueling bandit is a learning framework wherein the feedback information in the learning process is restricted to a noisy comparison between a pair of actions. In this research, we address a dueling bandit problem based on a cost…

Machine Learning · Statistics 2017-12-13 Wataru Kumagai

We revisit the Follow the Regularized Leader (FTRL) framework for Online Convex Optimization (OCO) over compact sets, focusing on achieving dynamic regret guarantees. Prior work has highlighted the framework's limitations in dynamic…

Machine Learning · Computer Science 2026-03-19 Naram Mhaisen , George Iosifidis

Nowadays, online learning is an appealing learning paradigm, which is of great interest in practice due to the recent emergence of large scale applications such as online advertising placement and online web ranking. Standard online…

Machine Learning · Computer Science 2019-11-27 Biyi Fang , Diego Klabjan

We study the problem of private online learning, specifically, online prediction from experts (OPE) and online convex optimization (OCO). We propose a new transformation that transforms lazy online learning algorithms into private…

Machine Learning · Computer Science 2025-02-25 Hilal Asi , Tomer Koren , Daogao Liu , Kunal Talwar

We provide an online convex optimization algorithm with regret that interpolates between the regret of an algorithm using an optimal preconditioning matrix and one using a diagonal preconditioning matrix. Our regret bound is never worse…

Machine Learning · Computer Science 2019-05-31 Ashok Cutkosky , Tamas Sarlos

We study the impact of predictions in online Linear Quadratic Regulator control with both stochastic and adversarial disturbances in the dynamics. In both settings, we characterize the optimal policy and derive tight bounds on the minimum…

Optimization and Control · Mathematics 2021-01-11 Chenkai Yu , Guanya Shi , Soon-Jo Chung , Yisong Yue , Adam Wierman

We study the problems of offline and online contextual optimization with feedback information, where instead of observing the loss, we observe, after-the-fact, the optimal action an oracle with full knowledge of the objective function would…

Machine Learning · Computer Science 2023-07-04 Omar Besbes , Yuri Fonseca , Ilan Lobel

Online optimization has emerged as powerful tool in large scale optimization. In this paper, we introduce efficient online algorithms based on the alternating directions method (ADM). We introduce a new proof technique for ADM in the batch…

Machine Learning · Computer Science 2012-07-03 Huahua Wang , Arindam Banerjee

We study a bi-level online provisioning and scheduling problem motivated by network resource allocation, where provisioning decisions are made at a slow time scale while queue-/state-dependent scheduling is performed at a fast time scale.…

Machine Learning · Computer Science 2026-02-24 Jialei Liu , C. Emre Koksal , Ming Shi

This paper considers distributed online convex constrained optimization, in which various agents in a multi-agent system cooperate to minimize a global cost function through communicating with neighbors over a time-varying network. When the…

Optimization and Control · Mathematics 2023-02-02 Wentao Zhang , Yang Shi , Baoyong Zhang , Deming Yuan

Online bilevel optimization (OBO) has emerged as a powerful framework for many machine learning problems. Prior works have developed several algorithms that minimize the standard bilevel local regret or the window-averaged bilevel local…

Machine Learning · Computer Science 2026-05-12 Tingkai Jia , Haiguang Wang , Cheng Chen

Non-stationary online learning has drawn much attention in recent years. Despite considerable progress, dynamic regret minimization has primarily focused on convex functions, leaving the functions with stronger curvature (e.g., squared or…

Machine Learning · Computer Science 2025-06-13 Yu-Jie Zhang , Peng Zhao , Masashi Sugiyama

We study an online mixed discrete and continuous optimization problem where a decision maker interacts with an unknown environment for a number of $T$ rounds. At each round, the decision maker needs to first jointly choose a discrete and a…

Optimization and Control · Mathematics 2024-08-27 Lintao Ye , Ming Chi , Zhi-Wei Liu , Xiaoling Wang , Vijay Gupta

In this paper, we develop new efficient projection-free algorithms for Online Convex Optimization (OCO). Online Gradient Descent (OGD) is an example of a classical OCO algorithm that guarantees the optimal $O(\sqrt{T})$ regret bound.…

Machine Learning · Computer Science 2022-05-24 Zakaria Mhammedi

This paper considers distributed online optimization with time-varying coupled inequality constraints. The global objective function is composed of local convex cost and regularization functions and the coupled constraint function is the…

Optimization and Control · Mathematics 2019-06-06 Xinlei Yi , Xiuxian Li , Lihua Xie , Karl H. Johansson

In citep{Hazan-2008-extract}, the authors showed that the regret of online linear optimization can be bounded by the total variation of the cost vectors. In this paper, we extend this result to general online convex optimization. We first…

Machine Learning · Computer Science 2012-06-15 Tianbao Yang , Mehrdad Mahdavi , Rong Jin , Shenghuo Zhu

We study dynamic pricing where a seller repeatedly interacts with a strategic, non-myopic buyer who has a fixed private valuation and discounts future utility. Prior work focused exclusively on posted-price mechanisms, which only extract…

Computer Science and Game Theory · Computer Science 2026-04-28 Shiliang Zuo

We study dynamic regret in federated online decision-making with stateful incurred costs under block-based synchronization and partial client participation. In this setting, sparse communication affects not only the pointwise update quality…

Systems and Control · Electrical Eng. & Systems 2026-05-18 Yiwei Liu , Luwei Yang , Shunbo Lei