中文
相关论文

相关论文: Online Multiserver Convex Chasing and Optimization

200 篇论文

Centered around solving the Online Saddle Point problem, this paper introduces the Online Convex-Concave Optimization (OCCO) framework, which involves a sequence of two-player time-varying convex-concave games. We propose the generalized…

机器学习 · 计算机科学 2023-12-18 Qing-xin Meng , Jian-wei Liu

We consider the problem of chasing convex functions, where functions arrive over time. The player takes actions after seeing the function, and the goal is to achieve a small function cost for these actions, as well as a small cost for…

数据结构与算法 · 计算机科学 2020-05-29 C. J. Argue , Anupam Gupta , Guru Guruganesh

Distributed online convex optimization (D-OCO) is a powerful paradigm for modeling distributed scenarios with streaming data. However, the communication cost between local learners and the central server is substantial in large-scale…

机器学习 · 计算机科学 2026-04-13 Sifan Yang , Dan-Yue Li , Lijun Zhang

To deal with changing environments, a new performance measure -- adaptive regret, defined as the maximum static regret over any interval, was proposed in online learning. Under the setting of online convex optimization, several algorithms…

机器学习 · 计算机科学 2025-08-04 Lijun Zhang , Wenhao Yang , Guanghui Wang , Wei Jiang , Zhi-Hua Zhou

We study adversarial online learning with hidden-convex losses, i.e., nonconvex losses that become convex after a nonlinear reparameterization. Ghai, Lu and Hazan (2022) proved that, under geometric and smoothness assumptions, online…

机器学习 · 计算机科学 2026-05-27 Anas Barakat , Andreas Kontogiannis , Vasilis Pollatos , Ioannis Panageas , Antonios Varvitsiotis

In this paper, the online variants of the classical Frank-Wolfe algorithm are considered. We consider minimizing the regret with a stochastic cost. The online algorithms only require simple iterative updates and a non-adaptive step size…

机器学习 · 统计学 2016-08-16 Jean Lafond , Hoi-To Wai , Eric Moulines

We study online convex optimization in the random order model, recently proposed by \citet{garber2020online}, where the loss functions may be chosen by an adversary, but are then presented to the online algorithm in a uniformly random…

机器学习 · 计算机科学 2021-06-30 Uri Sherman , Tomer Koren , Yishay Mansour

We investigate the contextual bandits with knapsack (CBwK) problem in a high-dimensional linear setting, where the feature dimension can be very large. Our goal is to harness sparsity to obtain sharper regret guarantees. To this end, we…

机器学习 · 计算机科学 2025-08-05 Wanteng Ma , Dong Xia , Jiashuo Jiang

This paper considers online convex optimization (OCO) with stochastic constraints, which generalizes Zinkevich's OCO over a known simple fixed set by introducing multiple stochastic functional constraints that are i.i.d. generated at each…

最优化与控制 · 数学 2017-08-15 Hao Yu , Michael J. Neely , Xiaohan Wei

We consider online convex optimization with time-varying constraints and conduct performance analysis using two stringent metrics: dynamic regret with respect to the online solution benchmark, and hard constraint violation that does not…

机器学习 · 计算机科学 2025-01-15 Juncheng Wang , Bingjie Yan , Yituo Liu

Recent research has shown that quasar-convexity can be found in applications such as identification of linear dynamical systems and generalized linear models. Such observations have in turn spurred exciting developments in design and…

最优化与控制 · 数学 2024-07-08 Yuen-Man Pun , Iman Shames

We analyze the minimax regret of the adversarial bandit convex optimization problem. Focusing on the one-dimensional case, we prove that the minimax regret is $\widetilde\Theta(\sqrt{T})$ and partially resolve a decade-old open problem. Our…

机器学习 · 计算机科学 2015-02-24 Sébastien Bubeck , Ofer Dekel , Tomer Koren , Yuval Peres

In this paper, we consider a distributed online convex optimization problem over a time-varying multi-agent network. The goal of this network is to minimize a global loss function through local computation and communication with neighbors.…

最优化与控制 · 数学 2024-06-17 Wentao Zhang , Yang Shi , Baoyong Zhang , Deming Yuan

This paper studies the problem of controlling linear dynamical systems subject to point-wise-in-time constraints. We present an algorithm similar to online gradient descent, that can handle time-varying and a priori unknown convex cost…

最优化与控制 · 数学 2021-11-03 Marko Nonhoff , Matthias A. Müller

We study Constrained Online Convex Optimization (COCO), where a learner chooses actions iteratively, observes both unanticipated convex loss and convex constraint, and accumulates loss while incurring penalties for constraint violations. We…

机器学习 · 计算机科学 2026-01-27 Ricardo N. Ferreira , João Xavier , Cláudia Soares

We study online learning with bandit feedback (i.e. learner has access to only zeroth-order oracle) where cost/reward functions $\f_t$ admit a "pseudo-1d" structure, i.e. $\f_t(\w) = \loss_t(\pred_t(\w))$ where the output of $\pred_t$ is…

机器学习 · 计算机科学 2021-02-16 Aadirupa Saha , Nagarajan Natarajan , Praneeth Netrapalli , Prateek Jain

In online convex optimization (OCO), Lipschitz continuity of the functions is commonly assumed in order to obtain sublinear regret. Moreover, many algorithms have only logarithmic regret when these functions are also strongly convex.…

机器学习 · 计算机科学 2021-01-01 Yihan Zhou , Victor S. Portella , Mark Schmidt , Nicholas J. A. Harvey

Nowadays, online learning is an appealing learning paradigm, which is of great interest in practice due to the recent emergence of large scale applications such as online advertising placement and online web ranking. Standard online…

机器学习 · 计算机科学 2019-11-27 Biyi Fang , Diego Klabjan

Non-stationary online learning has drawn much attention in recent years. In particular, dynamic regret and adaptive regret are proposed as two principled performance measures for online convex optimization in non-stationary environments. To…

机器学习 · 计算机科学 2025-09-10 Peng Zhao , Yan-Feng Xie , Lijun Zhang , Zhi-Hua Zhou

We give an algorithmic framework for minimizing general convex objectives (that are differentiable and monotone non-decreasing) over a set of covering constraints that arrive online. This substantially extends previous work on online…

数据结构与算法 · 计算机科学 2014-12-12 Yossi Azar , Ilan Reuven Cohen , Debmalya Panigrahi