English
Related papers

Related papers: Artificial Constraints and Lipschitz Hints for Unc…

200 papers

We consider an adversarial variant of the classic $K$-armed linear contextual bandit problem where the sequence of loss functions associated with each arm are allowed to change without restriction over time. Under the assumption that the…

Machine Learning · Computer Science 2022-05-25 Gergely Neu , Julia Olkhovskaya

We consider online convex optimization with a zero-order oracle feedback. In particular, the decision maker does not know the explicit representation of the time-varying cost functions, or their gradients. At each time step, she observes…

Optimization and Control · Mathematics 2020-05-05 Tatiana Tatarenko , Maryam Kamgarpour

In online inverse linear optimization, a learner observes time-varying sets of feasible actions and an agent's optimal actions, selected by solving linear optimization over the feasible actions. The learner sequentially makes predictions of…

Machine Learning · Computer Science 2025-05-23 Shinsaku Sakaue , Taira Tsuchiya , Han Bao , Taihei Oki

We study optimal regret bounds for control in linear dynamical systems under adversarially changing strongly convex cost functions, given the knowledge of transition dynamics. This includes several well studied and fundamental frameworks…

Machine Learning · Computer Science 2019-09-12 Naman Agarwal , Elad Hazan , Karan Singh

We study various discrete nonlinear combinatorial optimization problems in an online learning framework. In the first part, we address the question of whether there are negative results showing that getting a vanishing (or even vanishing…

Data Structures and Algorithms · Computer Science 2020-06-24 Evripidis Bampis , Dimitris Christou , Bruno Escoffier , Nguyen Kim Thang

We study the online calibration of multi-dimensional forecasts over an arbitrary convex set $\mathcal{P} \subset \mathbb{R}^d$ relative to an arbitrary norm $\Vert\cdot\Vert$. We connect this with the problem of external regret minimization…

Machine Learning · Computer Science 2025-05-28 Maxwell Fishelson , Noah Golowich , Mehryar Mohri , Jon Schneider

We propose an anytime online algorithm for the problem of learning a sequence of adversarial convex cost functions while approximately satisfying another sequence of adversarial online convex constraints. A sequential algorithm is called…

Machine Learning · Computer Science 2025-10-28 Dhruv Sarkar , Abhishek Sinha

In this work, we study online convex optimization with a fixed constraint function $g : \mathbb{R}^d \rightarrow \mathbb{R}$. Prior work on this problem has shown $O(\sqrt{T})$ regret and cumulative constraint satisfaction $\sum_{t=1}^{T}…

Machine Learning · Computer Science 2025-07-16 Spencer Hutchinson , Mahnoosh Alizadeh

Automated bidding to optimize online advertising with various constraints, e.g. ROI constraints and budget constraints, is widely adopted by advertisers. A key challenge lies in designing algorithms for non-truthful mechanisms with ROI…

Computer Science and Game Theory · Computer Science 2025-10-21 Yuan Deng , Yilin Li , Wei Tang , Hanrui Zhang

We study the problem of safe online convex optimization, where the action at each time step must satisfy a set of linear safety constraints. The goal is to select a sequence of actions to minimize the regret without violating the safety…

Machine Learning · Computer Science 2021-11-16 Sapana Chaudhary , Dileep Kalathil

We introduce algorithms for online, full-information prediction that are competitive with contextual tree experts of unknown complexity, in both probabilistic and adversarial settings. We show that by incorporating a probabilistic framework…

Machine Learning · Computer Science 2018-05-23 Vidya Muthukumar , Mitas Ray , Anant Sahai , Peter L. Bartlett

Recently the online advertising market has exhibited a gradual shift from second-price auctions to first-price auctions. Although there has been a line of works concerning online bidding strategies in first-price auctions, it still remains…

Computer Science and Game Theory · Computer Science 2022-05-31 Rui Ai , Chang Wang , Chenchen Li , Jinshan Zhang , Wenhan Huang , Xiaotie Deng

Recently, there were introduced important classes of relatively smooth, relatively continuous, and relatively strongly convex optimization problems. These concepts have significantly expanded the class of problems for which optimal…

Optimization and Control · Mathematics 2023-03-07 Oleg Savchuk , Fedor Stonyakin , Mohammad Alkousa , Rida Zabirova , Alexander Titov , Alexander Gasnikov

Gradient-variation online learning aims to achieve regret guarantees that scale with variations in the gradients of online functions, which has been shown to be crucial for attaining fast convergence in games and robustness in stochastic…

Machine Learning · Computer Science 2024-11-05 Yan-Feng Xie , Peng Zhao , Zhi-Hua Zhou

We propose a new partial-observability model for online learning problems where the learner, besides its own loss, also observes some noisy feedback about the other actions, depending on the underlying structure of the problem. We represent…

Machine Learning · Computer Science 2026-04-16 Tomáš Kocák , Gergely Neu , Michal Valko

We consider online optimization with binary decision variables and convex loss functions. We design a new algorithm, binary online gradient descent (bOGD) and bound its expected dynamic regret. We provide a regret bound that holds for any…

Optimization and Control · Mathematics 2022-01-21 Antoine Lesage-Landry , Joshua A. Taylor , Duncan S. Callaway

We consider the classic online learning and stochastic multi-armed bandit (MAB) problems, when at each step, the online policy can probe and find out which of a small number ($k$) of choices has better reward (or loss) before making its…

Data Structures and Algorithms · Computer Science 2022-11-08 Aditya Bhaskara , Sreenivas Gollapudi , Sungjin Im , Kostas Kollias , Kamesh Munagala

This paper develops projection-free algorithms for online convex optimization with stochastic constraints. We design an online primal-dual projection-free framework that can take any projection-free algorithms developed for online convex…

Optimization and Control · Mathematics 2023-05-17 Duksang Lee , Nam Ho-Nguyen , Dabeen Lee

Predicting the output of a dynamical system from streaming data is fundamental to real-time feedback control and decision-making. We first derive an autoregressive representation that relates future local outputs to asynchronous past…

Systems and Control · Electrical Eng. & Systems 2026-03-09 Jiachen Qian , Yang Zheng

Online linear programming plays an important role in both revenue management and resource allocation, and recent research has focused on developing efficient first-order online learning algorithms. Despite the empirical success of…

Machine Learning · Computer Science 2025-01-08 Wenzhi Gao , Chunlin Sun , Chenyu Xue , Dongdong Ge , Yinyu Ye