English
Related papers

Related papers: Online Convex Optimization with Switching Cost and…

200 papers

This paper proposes a set of novel optimization algorithms for solving a class of convex optimization problems with time-varying streaming cost function. We develop an approach to track the optimal solution with a bounded error. Unlike the…

Optimization and Control · Mathematics 2023-10-13 M. Rostami , H. Moradian , S. S. Kia

In this paper, we propose an online convex optimization approach with two different levels of adaptivity. On a higher level, our approach is agnostic to the unknown types and curvatures of the online functions, while at a lower level, it…

Machine Learning · Computer Science 2024-04-17 Yu-Hu Yan , Peng Zhao , Zhi-Hua Zhou

This paper studies minimax optimization problems $\min_x \max_y f(x,y)$, where $f(x,y)$ is $m_x$-strongly convex with respect to $x$, $m_y$-strongly concave with respect to $y$ and $(L_x,L_{xy},L_y)$-smooth. Zhang et al. provided the…

Machine Learning · Computer Science 2020-10-20 Yuanhao Wang , Jian Li

In the field of online sequential decision-making, we address the problem with delays utilizing the framework of online convex optimization (OCO), where the feedback of a decision can arrive with an unknown delay. Unlike previous research…

Machine Learning · Computer Science 2024-02-26 Ping Wu , Heyan Huang , Zhengyang Liu

We consider the general problem of online convex optimization with time-varying additive constraints in the presence of predictions for the next cost and constraint functions. A novel primal-dual algorithm is designed by combining a…

Machine Learning · Computer Science 2022-01-11 Daron Anderson , George Iosifidis , Douglas J. Leith

This paper considers the problem of online optimization where the objective function is time-varying. In particular, we extend coordinate descent type algorithms to the online case, where the objective function varies after a finite number…

Optimization and Control · Mathematics 2024-04-26 Yankai Lin , Iman Shames , Dragan Nešić

We study the problem of private online learning, specifically, online prediction from experts (OPE) and online convex optimization (OCO). We propose a new transformation that transforms lazy online learning algorithms into private…

Machine Learning · Computer Science 2025-02-25 Hilal Asi , Tomer Koren , Daogao Liu , Kunal Talwar

Motivated by alternating learning dynamics in two-player games, a recent work by Cevher et al.(2024) shows that $o(\sqrt{T})$ alternating regret is possible for any $T$-round adversarial Online Linear Optimization (OLO) problem, and left as…

Machine Learning · Computer Science 2025-06-19 Soumita Hait , Ping Li , Haipeng Luo , Mengxiao Zhang

This paper investigates online algorithms for smooth time-varying optimization problems, focusing first on methods with constant step-size, momentum, and extrapolation-length. Assuming strong convexity, precise results for the tracking…

Optimization and Control · Mathematics 2024-07-16 Liam Madden , Stephen Becker , Emiliano Dall'Anese

The dynamic competition against intelligent jammer systems presents a significant challenge to modern radar. Traditional active anti-jamming strategy learning methods often suffer from low sample efficiency and fail to fully exploit the…

Signal Processing · Electrical Eng. & Systems 2026-04-14 Liangqi Liu , Wenqiang Pu , Yingru Li , Zhi-Quan Luo

In this paper, we introduce a new projection-free algorithm for Online Convex Optimization (OCO) with a state-of-the-art regret guarantee among separation-based algorithms. Existing projection-free methods based on the classical Frank-Wolfe…

Machine Learning · Computer Science 2024-10-08 Zakaria Mhammedi

In this paper, we study the communication and (sub)gradient computation costs in distributed optimization and give a sharp complexity analysis for the proposed distributed accelerated gradient methods. We present two algorithms based on the…

Optimization and Control · Mathematics 2020-08-19 Huan Li , Cong Fang , Wotao Yin , Zhouchen Lin

In this paper, we consider an online optimization process, where the objective functions are not convex (nor concave) but instead belong to a broad class of continuous submodular functions. We first propose a variant of the Frank-Wolfe…

Machine Learning · Statistics 2018-02-19 Lin Chen , Hamed Hassani , Amin Karbasi

Motivated by the use of high speed circuit switches in large scale data centers, we consider the problem of circuit switch scheduling. In this problem we are given demands between pairs of servers and the goal is to schedule at every time…

Data Structures and Algorithms · Computer Science 2019-05-09 Roy Schwartz , Mohit Singh , Sina Yazdanbod

We study adversarial online learning with hidden-convex losses, i.e., nonconvex losses that become convex after a nonlinear reparameterization. Ghai, Lu and Hazan (2022) proved that, under geometric and smoothness assumptions, online…

Machine Learning · Computer Science 2026-05-27 Anas Barakat , Andreas Kontogiannis , Vasilis Pollatos , Ioannis Panageas , Antonios Varvitsiotis

We examine the problem of smoothed online optimization, where a decision maker must sequentially choose points in a normed vector space to minimize the sum of per-round, non-convex hitting costs and the costs of switching decisions between…

Machine Learning · Computer Science 2022-10-28 Daan Rutten , Nico Christianson , Debankur Mukherjee , Adam Wierman

Frequently, when dealing with many machine learning models, optimization problems appear to be challenging due to a limited understanding of the constructions and characterizations of the objective functions in these problems. Therefore,…

Optimization and Control · Mathematics 2024-11-27 A. V. Gasnikov , M. S. Alkousa , A. V. Lobanov , Y. V. Dorn , F. S. Stonyakin , I. A. Kuruzov , S. R. Singh

We study Online Convex Optimization with adversarial constraints (COCO). At each round a learner selects an action from a convex decision set and then an adversary reveals a convex cost and a convex constraint function. The goal of the…

Machine Learning · Computer Science 2025-11-17 Abhishek Sinha , Rahul Vaze

We consider the problem of Online Convex Optimization (OCO) with two-point bandit feedback. In this setting, a player attempts to minimize a sequence of adversarially generated convex loss functions, while only observing the value of each…

Machine Learning · Computer Science 2026-04-07 Haishan Ye

Online convex optimization (OCO) with time-varying constraints is a critical framework for sequential decision-making in dynamic networked systems, where learners must minimize cumulative loss while satisfying regions of feasibility that…

Machine Learning · Computer Science 2026-03-17 Xiufeng Liu , Qian Chen , Zhijin Wang , Ruyu Liu
‹ Prev 1 3 4 5 6 7 10 Next ›