English
Related papers

Related papers: Periodic Updates for Constrained OCO with Applicat…

200 papers

We study a generalization of the Online Convex Optimization (OCO) framework with time-varying adversarial constraints. In this setting, at each round, the learner selects an action from a convex decision set $X$, after which both a convex…

Machine Learning · Computer Science 2026-03-30 Dhruv Sarkar , Aprameyo Chakrabartty , Subhamon Supantha , Palash Dey , Abhishek Sinha

We consider Online Convex Optimization (OCO) in the setting where the costs are $m$-strongly convex and the online learner pays a switching cost for changing decisions between rounds. We show that the recently proposed Online Balanced…

Machine Learning · Computer Science 2019-04-05 Gautam Goel , Adam Wierman

This paper investigates online composite optimization in dynamic environments, where each objective or loss function contains a time-varying nondifferentiable regularizer. To resolve it, an online proximal gradient algorithm is studied for…

Optimization and Control · Mathematics 2023-03-24 Ruijie Hou , Xiuxian Li , Yang Shi

We investigate distributed online convex optimization with compressed communication, where $n$ learners connected by a network collaboratively minimize a sequence of global loss functions using only local information and compressed data…

Machine Learning · Computer Science 2026-01-12 Sifan Yang , Wenhao Yang , Wei Jiang , Lijun Zhang

We investigate online convex optimization in non-stationary environments and choose the dynamic regret as the performance measure, defined as the difference between cumulative loss incurred by the online algorithm and that of any feasible…

Machine Learning · Computer Science 2020-12-01 Peng Zhao , Yu-Jie Zhang , Lijun Zhang , Zhi-Hua Zhou

This paper studies the problem of controlling linear dynamical systems subject to point-wise-in-time constraints. We present an algorithm similar to online gradient descent, that can handle time-varying and a priori unknown convex cost…

Optimization and Control · Mathematics 2021-11-03 Marko Nonhoff , Matthias A. Müller

In Online Convex Optimization (OCO), when the stochastic gradient has a finite variance, many algorithms provably work and guarantee a sublinear regret. However, limited results are known if the gradient estimate has a heavy tail, i.e., the…

Machine Learning · Computer Science 2026-03-20 Zijian Liu

Bandit Convex Optimization (BCO) is a fundamental framework for modeling sequential decision-making with partial information, where the only feedback available to the player is the one-point or two-point function values. In this paper, we…

Machine Learning · Computer Science 2020-07-07 Peng Zhao , Guanghui Wang , Lijun Zhang , Zhi-Hua Zhou

Motivated by alternating learning dynamics in two-player games, a recent work by Cevher et al.(2024) shows that $o(\sqrt{T})$ alternating regret is possible for any $T$-round adversarial Online Linear Optimization (OLO) problem, and left as…

Machine Learning · Computer Science 2025-06-19 Soumita Hait , Ping Li , Haipeng Luo , Mengxiao Zhang

We investigate decentralized online convex optimization (D-OCO), in which a set of local learners are required to minimize a sequence of global loss functions using only local computations and communications. Previous studies have…

Machine Learning · Computer Science 2024-12-12 Yuanyu Wan , Tong Wei , Bo Xue , Mingli Song , Lijun Zhang

This paper considers online convex optimization (OCO) problems - the paramount framework for online learning algorithm design. The loss function of learning task in OCO setting is based on streaming data so that OCO is a powerful tool to…

Machine Learning · Computer Science 2019-11-26 Wenye Ma

Bandit Convex Optimisation (BCO) is a powerful framework for sequential decision-making in non-stationary and partially observable environments. In a BCO problem, a decision-maker sequentially picks actions to minimize the cumulative cost…

Networking and Internet Architecture · Computer Science 2018-02-14 Cristina Cano , Gergely Neu

Making judicious channel access and transmission scheduling decisions is essential for improving performance as well as energy and spectral efficiency in multichannel wireless systems. This problem has been a subject of extensive study in…

Machine Learning · Computer Science 2015-04-07 Yang Liu , Mingyan Liu

We propose algorithms for cloud radio access networks that not only provide heterogeneous quality of-service (QoS) for rate- and, importantly, delay-sensitive applications, but also jointly optimize the frequency reuse pattern. Importantly,…

Networking and Internet Architecture · Computer Science 2018-01-29 Alirezan Sharifian , Raviraj Adve

Decentralized online convex optimization (D-OCO), where multiple agents within a network collaboratively learn optimal decisions in real-time, arises naturally in applications such as federated learning, sensor networks, and multi-agent…

Machine Learning · Statistics 2026-01-14 Hao Qiu , Mengxiao Zhang , Juliette Achddou

In this paper, we consider the problem of distributed online convex optimization, where a group of agents collaborate to track the global minimizers of a sum of time-varying objective functions in an online manner. Specifically, we propose…

Optimization and Control · Mathematics 2020-10-14 Yan Zhang , Robert J. Ravier , Vahid Tarokh , Michael M. Zavlanos

We consider online convex optimization (OCO) over a heterogeneous network with communication delay, where multiple workers together with a master execute a sequence of decisions to minimize the accumulation of time-varying global costs. The…

Information Theory · Computer Science 2021-07-15 Juncheng Wang , Ben Liang , Min Dong , Gary Boudreau , Hatem Abou-zeid

In this paper, we study online convex optimization in dynamic environments, and aim to bound the dynamic regret with respect to any sequence of comparators. Existing work have shown that online gradient descent enjoys an…

Machine Learning · Computer Science 2018-10-26 Lijun Zhang , Shiyin Lu , Zhi-Hua Zhou

Motivated by the challenge of nonstationarity in sequential decision making, we study Online Convex Optimization (OCO) under the coupling of two problem structures: the domain is unbounded, and the comparator sequence $u_1,\ldots,u_T$ is…

Machine Learning · Computer Science 2023-10-27 Zhiyu Zhang , Ashok Cutkosky , Ioannis Ch. Paschalidis

This paper considers online optimization of a renewal-reward system. A controller performs a sequence of tasks back-to-back. Each task has a random vector of parameters, called the task type vector, that affects the task processing options…

Optimization and Control · Mathematics 2021-06-01 Michael J. Neely