English
Related papers

Related papers: Adaptive Composite Online Optimization: Prediction…

200 papers

This paper considers online convex optimization with time-varying constraint functions. Specifically, we have a sequence of convex objective functions $\{f_t(x)\}_{t=0}^{\infty}$ and convex constraint functions…

Optimization and Control · Mathematics 2017-02-20 Michael J. Neely , Hao Yu

In many dynamic systems, decisions on system operation are updated over time, and the decision maker requires an online learning approach to optimize its strategy in response to the changing environment. When the loss and constraint…

Information Theory · Computer Science 2021-07-13 Juncheng Wang , Min Dong , Ben Liang , Gary Boudreau

In this paper, we propose an online convex optimization approach with two different levels of adaptivity. On a higher level, our approach is agnostic to the unknown types and curvatures of the online functions, while at a lower level, it…

Machine Learning · Computer Science 2024-04-17 Yu-Hu Yan , Peng Zhao , Zhi-Hua Zhou

This paper considers online convex optimization with long term constraints, where constraints can be violated in intermediate rounds, but need to be satisfied in the long run. The cumulative constraint violation is used as the metric to…

Machine Learning · Computer Science 2021-06-10 Xinlei Yi , Xiuxian Li , Tao Yang , Lihua Xie , Tianyou Chai , Karl H. Johansson

This paper describes a new online convex optimization method which incorporates a family of candidate dynamical models and establishes novel tracking regret bounds that scale with the comparator's deviation from the best dynamical model in…

Machine Learning · Statistics 2013-01-08 Eric C. Hall , Rebecca M. Willett

We study Smoothed Online Convex Optimization, a version of online convex optimization where the learner incurs a penalty for changing her actions between rounds. Given a $\Omega(\sqrt{d})$ lower bound on the competitive ratio of any online…

Machine Learning · Computer Science 2018-07-10 Niangjun Chen , Gautam Goel , Adam Wierman

The dynamic competition between radar and jammer systems presents a significant challenge for modern Electronic Warfare (EW), as current active learning approaches still lack sample efficiency and fail to exploit jammer's characteristics.…

Signal Processing · Electrical Eng. & Systems 2024-07-12 Liangqi Liu , Wenqiang Pu , Yingru Li , Bo Jiu , Zhi-Quan Luo

We consider distributed online convex optimization problems, where the distributed system consists of various computing units connected through a time-varying communication graph. In each time step, each computing unit selects a constrained…

Machine Learning · Computer Science 2019-12-23 Deming Yuan , Alexandre Proutiere , Guodong Shi

This paper considers online convex optimization (OCO) problems - the paramount framework for online learning algorithm design. The loss function of learning task in OCO setting is based on streaming data so that OCO is a powerful tool to…

Machine Learning · Computer Science 2019-11-26 Wenye Ma

An online non-convex optimization problem is considered where the goal is to minimize the flow time (total delay) of a set of jobs by modulating the number of active servers, but with a switching cost associated with changing the number of…

Data Structures and Algorithms · Computer Science 2024-07-02 Rahul Vaze , Jayakrishnan Nair

This paper focuses on projection-free methods for solving smooth Online Convex Optimization (OCO) problems. Existing projection-free methods either achieve suboptimal regret bounds or have high per-iteration computational costs. To fill…

Machine Learning · Computer Science 2019-10-25 Jiahao Xie , Zebang Shen , Chao Zhang , Boyu Wang , Hui Qian

We extend the regret analysis of the online distributed weighted dual averaging (DWDA) algorithm [1] to the dynamic setting and provide the tightest dynamic regret bound known to date with respect to the time horizon for a distributed…

Optimization and Control · Mathematics 2020-12-11 Antoine Lesage-Landry , Duncan S. Callaway

The dynamic competition against intelligent jammer systems presents a significant challenge to modern radar. Traditional active anti-jamming strategy learning methods often suffer from low sample efficiency and fail to fully exploit the…

Signal Processing · Electrical Eng. & Systems 2026-04-14 Liangqi Liu , Wenqiang Pu , Yingru Li , Zhi-Quan Luo

This paper studies the online optimal control problem with time-varying convex stage costs for a time-invariant linear dynamical system, where a finite lookahead window of accurate predictions of the stage costs are available at each time.…

Optimization and Control · Mathematics 2019-10-23 Yingying Li , Xin Chen , Na Li

Distributionally-robust optimization is often studied for a fixed set of distributions rather than time-varying distributions that can drift significantly over time (which is, for instance, the case in finance and sociology due to…

Optimization and Control · Mathematics 2020-10-01 Iman Shames , Farhad Farokhi

We consider the general problem of online convex optimization with time-varying additive constraints in the presence of predictions for the next cost and constraint functions. A novel primal-dual algorithm is designed by combining a…

Machine Learning · Computer Science 2022-01-11 Daron Anderson , George Iosifidis , Douglas J. Leith

Making use of predictions is a crucial, but under-explored, area of online algorithms. This paper studies a class of online optimization problems where we have external noisy predictions available. We propose a stochastic prediction error…

Machine Learning · Computer Science 2015-04-28 Niangjun Chen , Anish Agarwal , Adam Wierman , Siddharth Barman , Lachlan L. H. Andrew

We propose accelerated randomized coordinate descent algorithms for stochastic optimization and online learning. Our algorithms have significantly less per-iteration complexity than the known accelerated gradient algorithms. The proposed…

Machine Learning · Computer Science 2018-07-17 Akshita Bhandari , Chandramani Singh

We consider the problem of controlling an unknown linear dynamical system under adversarially changing convex costs and full feedback of both the state and cost function. We present the first computationally-efficient algorithm that attains…

Machine Learning · Computer Science 2022-06-06 Asaf Cassel , Alon Cohen , Tomer Koren

We study online convex optimization under stochastic sub-gradient observation faults, where we introduce adaptive algorithms with minimax optimal regret guarantees. We specifically study scenarios where our sub-gradient observations can be…

Machine Learning · Computer Science 2019-04-23 Hakan Gokcesu , Suleyman S. Kozat
‹ Prev 1 4 5 6 7 8 10 Next ›