English
Related papers

Related papers: Beyond $\mathcal{O}(\sqrt{T})$ Regret: Decoupling …

200 papers

We study the well-known coded caching problem in an online learning framework, wherein requests arrive sequentially, and an online policy can update the cache contents based on the history of requests seen thus far. We introduce a caching…

Information Theory · Computer Science 2024-09-20 Anupam Nayak , Kota Srinivas Reddy , Nikhil Karamchandani

We provide an online convex optimization algorithm with regret that interpolates between the regret of an algorithm using an optimal preconditioning matrix and one using a diagonal preconditioning matrix. Our regret bound is never worse…

Machine Learning · Computer Science 2019-05-31 Ashok Cutkosky , Tamas Sarlos

In online learning, a decision maker repeatedly selects one of a set of actions, with the goal of minimizing the overall loss incurred. Following the recent line of research on algorithms endowed with additional predictive features, we…

In this paper, we study the problem of learning Kalman filtering with unknown system model in partially observed linear dynamical systems. We propose a unified algorithmic framework based on online optimization that can be used to solve…

Machine Learning · Computer Science 2026-03-31 Lintao Ye , Ankang Zhang , Ming Chi , Bin Du , Jianghai Hu

To efficiently solve online problems with complicated constraints, projection-free algorithms including online frank-wolfe (OFW) and its variants have received significant interest recently. However, in the general case, existing efficient…

Machine Learning · Computer Science 2024-06-25 Yuanyu Wan , Lijun Zhang

In this paper, we revisit the online non-monotone continuous DR-submodular maximization problem over a down-closed convex set, which finds wide real-world applications in the domain of machine learning, economics, and operations research.…

Machine Learning · Computer Science 2022-08-17 Qixin Zhang , Zengde Deng , Zaiyi Chen , Kuangqi Zhou , Haoyuan Hu , Yu Yang

The problem of constrained online convex optimization is considered, where at each round, once a learner commits to an action $x_t \in \mathcal{X} \subset \mathbb{R}^d$, a convex loss function $f_t$ and a convex constraint function $g_t$…

Machine Learning · Computer Science 2026-03-24 Haricharan Balasundaram , Karthick Krishna Mahendran , Rahul Vaze

Regularized online learning is widely used in machine learning applications. In online learning, performing exact minimization ($i.e.,$ implicit update) is known to be beneficial to the numerical stability and structure of solution. In this…

Machine Learning · Computer Science 2019-02-08 Chaobing Song , Ji Liu , Han Liu , Yong Jiang , Tong Zhang

We study the framework of a dynamic decision-making scenario with resource constraints. In this framework, an agent, whose target is to maximize the total reward under the initial inventory, selects an action in each round upon observing a…

Machine Learning · Computer Science 2024-12-19 Zhaohua Chen , Rui Ai , Mingwei Yang , Yuqi Pan , Chang Wang , Xiaotie Deng

Obtaining first-order regret bounds -- regret bounds scaling not as the worst-case but with some measure of the performance of the optimal policy on a given instance -- is a core question in sequential decision-making. While such bounds…

Machine Learning · Computer Science 2022-10-24 Andrew Wagenmaker , Yifang Chen , Max Simchowitz , Simon S. Du , Kevin Jamieson

We provide the first sub-linear space and sub-linear regret algorithm for online learning with expert advice (against an oblivious adversary), addressing an open question raised recently by Srinivas, Woodruff, Xu and Zhou (STOC 2022). We…

Data Structures and Algorithms · Computer Science 2022-11-09 Binghui Peng , Fred Zhang

This paper considers online convex optimization with long term constraints, where constraints can be violated in intermediate rounds, but need to be satisfied in the long run. The cumulative constraint violation is used as the metric to…

Machine Learning · Computer Science 2021-06-10 Xinlei Yi , Xiuxian Li , Tao Yang , Lihua Xie , Tianyou Chai , Karl H. Johansson

We study online learning in the random-order model, where the multiset of loss functions is chosen adversarially but revealed in a uniformly random order. By extending the batch-to-online transformation of Dong and Yoshida (2023), we show…

Machine Learning · Statistics 2026-05-11 Shinsaku Sakaue , Yuichi Yoshida

It is widely agreed that when AI models assist decision-makers in high-stakes domains by predicting an outcome of interest, they should communicate the confidence of their predictions. However, empirical evidence suggests that…

Machine Learning · Computer Science 2026-05-14 Nina Corvelo Benz , Eleni Straitouri , Manuel Gomez-Rodriguez

We consider the task of learning to control a linear dynamical system under fixed quadratic costs, known as the Linear Quadratic Regulator (LQR) problem. While model-free approaches are often favorable in practice, thus far only model-based…

Machine Learning · Computer Science 2021-02-26 Asaf Cassel , Tomer Koren

We study a novel variant of online finite-horizon Markov Decision Processes with adversarially changing loss functions and initially unknown dynamics. In each episode, the learner suffers the loss accumulated along the trajectory realized…

Machine Learning · Computer Science 2021-02-02 Alon Cohen , Haim Kaplan , Tomer Koren , Yishay Mansour

We study stochastic decision-theoretic online learning with full information and event-level pure differential privacy. A COLT open problem of Hu and Mehta asks to determine the optimal gap-dependent regret rate for stochastic…

Machine Learning · Computer Science 2026-05-29 Tommaso Cesari , Roberto Colomboni

We study the adaptive control of an unknown linear system with a quadratic cost function subject to safety constraints on both the states and actions. The challenges of this problem arise from the tension among safety, exploration,…

Systems and Control · Electrical Eng. & Systems 2021-11-02 Yingying Li , Subhro Das , Jeff Shamma , Na Li

We study the problem of online prediction, in which at each time step $t$, an individual $x_t$ arrives, whose label we must predict. Each individual is associated with various groups, defined based on their features such as age, sex, race…

Machine Learning · Computer Science 2023-10-10 Krishna Acharya , Eshwar Ram Arunachaleswaran , Sampath Kannan , Aaron Roth , Juba Ziani

This paper studies online convex optimization with unknown linear budget constraints, where only the gradient information of the objective and the bandit feedback of constraint functions are observed. We propose a safe and efficient…

Optimization and Control · Mathematics 2025-03-10 Shanqi Liu , Xin Liu
‹ Prev 1 8 9 10 Next ›