English
Related papers

Related papers: Online optimization and regret guarantees for non-…

200 papers

We consider the fundamental problem of online control of a linear dynamical system from two different viewpoints: regret minimization and competitive analysis. We prove that the optimal competitive policy is well-approximated by a convex…

Machine Learning · Computer Science 2022-11-22 Gautam Goel , Naman Agarwal , Karan Singh , Elad Hazan

We introduce algorithms that achieve state-of-the-art \emph{dynamic regret} bounds for non-stationary linear stochastic bandit setting. It captures natural applications such as dynamic pricing and ads allocation in a changing environment.…

Machine Learning · Computer Science 2021-07-20 Wang Chi Cheung , David Simchi-Levi , Ruihao Zhu

A well-studied generalization of the standard online convex optimization (OCO) framework is constrained online convex optimization (COCO). In COCO, on every round, a convex cost function and a convex constraint function are revealed to the…

Machine Learning · Computer Science 2024-10-29 Abhishek Sinha , Rahul Vaze

We study the impact of predictions in online Linear Quadratic Regulator control with both stochastic and adversarial disturbances in the dynamics. In both settings, we characterize the optimal policy and derive tight bounds on the minimum…

Optimization and Control · Mathematics 2021-01-11 Chenkai Yu , Guanya Shi , Soon-Jo Chung , Yisong Yue , Adam Wierman

Regret has been widely adopted as the metric of choice for evaluating the performance of online optimization algorithms for distributed, multi-agent systems. However, data/model variations associated with agents can significantly impact…

Machine Learning · Computer Science 2022-09-22 Zhanhong Jiang , Aditya Balu , Xian Yeow Lee , Young M. Lee , Chinmay Hegde , Soumik Sarkar

In this paper, the online variants of the classical Frank-Wolfe algorithm are considered. We consider minimizing the regret with a stochastic cost. The online algorithms only require simple iterative updates and a non-adaptive step size…

Machine Learning · Statistics 2016-08-16 Jean Lafond , Hoi-To Wai , Eric Moulines

In this paper, we develop a novel virtual-queue-based online algorithm for online convex optimization (OCO) problems with long-term and time-varying constraints and conduct a performance analysis with respect to the dynamic regret and…

Optimization and Control · Mathematics 2021-11-16 Qingsong Liu , Wenfei Wu , Longbo Huang , Zhixuan Fang

Online-learning literature has focused on designing algorithms that ensure sub-linear growth of the cumulative long-term constraint violations. The drawback of this guarantee is that strictly feasible actions may cancel out constraint…

Optimization and Control · Mathematics 2019-10-22 Ezra Tampubolon , Holger Boche

We present new algorithms for online convex optimization over unbounded domains that obtain parameter-free regret in high-probability given access only to potentially heavy-tailed subgradient estimates. Previous work in unbounded domains…

Machine Learning · Statistics 2023-02-28 Jiujia Zhang , Ashok Cutkosky

Projection-free online learning has drawn increasing interest due to its efficiency in solving high-dimensional problems with complicated constraints. However, most existing projection-free online methods focus on minimizing the static…

Machine Learning · Computer Science 2023-05-22 Yibo Wang , Wenhao Yang , Wei Jiang , Shiyin Lu , Bing Wang , Haihong Tang , Yuanyu Wan , Lijun Zhang

This paper studies online convex optimization with unknown linear budget constraints, where only the gradient information of the objective and the bandit feedback of constraint functions are observed. We propose a safe and efficient…

Optimization and Control · Mathematics 2025-03-10 Shanqi Liu , Xin Liu

This paper considers the stability of online learning algorithms and its implications for learnability (bounded regret). We introduce a novel quantity called {\em forward regret} that intuitively measures how good an online learning…

Machine Learning · Computer Science 2012-11-28 Ankan Saha , Prateek Jain , Ambuj Tewari

In this paper, we consider a distributed online convex optimization problem over a time-varying multi-agent network. The goal of this network is to minimize a global loss function through local computation and communication with neighbors.…

Optimization and Control · Mathematics 2024-06-17 Wentao Zhang , Yang Shi , Baoyong Zhang , Deming Yuan

We consider online convex optimization when a number k of data points are outliers that may be corrupted. We model this by introducing the notion of robust regret, which measures the regret only on rounds that are not outliers. The aim for…

Machine Learning · Computer Science 2021-08-31 Tim van Erven , Sarah Sachs , Wouter M. Koolen , Wojciech Kotłowski

Matching problems have been widely studied in the research community, especially Ad-Auctions with many applications ranging from network design to advertising. Following the various advancements in machine learning, one natural question is…

Data Structures and Algorithms · Computer Science 2024-02-15 Eniko Kevi , Nguyen Kim Thang

Centered around solving the Online Saddle Point problem, this paper introduces the Online Convex-Concave Optimization (OCCO) framework, which involves a sequence of two-player time-varying convex-concave games. We propose the generalized…

Machine Learning · Computer Science 2023-12-18 Qing-xin Meng , Jian-wei Liu

We study online learning problems in which a decision maker has to make a sequence of costly decisions, with the goal of maximizing their expected reward while adhering to budget and return-on-investment (ROI) constraints. Existing…

Computer Science and Game Theory · Computer Science 2024-03-05 Matteo Castiglioni , Andrea Celli , Christian Kroer

This study considers online learning with general directed feedback graphs. For this problem, we present best-of-both-worlds algorithms that achieve nearly tight regret bounds for adversarial environments as well as poly-logarithmic regret…

Machine Learning · Computer Science 2022-12-29 Shinji Ito , Taira Tsuchiya , Junya Honda

We consider online convex optimization with stochastic constraints where the objective functions are arbitrarily time-varying and the constraint functions are independent and identically distributed (i.i.d.) over time. Both the objective…

Optimization and Control · Mathematics 2019-08-02 Xiaohan Wei , Hao Yu , Michael J. Neely

Online optimisation studies the convergence of optimisation methods as the data embedded in the problem changes. Based on this idea, we propose a primal dual online method for nonlinear time-discrete inverse problems. We analyse the method…

Optimization and Control · Mathematics 2025-03-18 Neil Dizon , Jyrki Jauhiainen , Tuomo Valkonen