中文
相关论文

相关论文: Online convex optimization for cumulative constrai…

200 篇论文

Given any increasing sequence of norms $\|\cdot\|_0,\dots,\|\cdot\|_{T-1}$, we provide an online convex optimization algorithm that outputs points $w_t$ in some domain $W$ in response to convex losses $\ell_t:W\to \mathbb{R}$ that…

机器学习 · 计算机科学 2020-02-11 Ashok Cutkosky

We investigate online convex optimization in non-stationary environments and choose the dynamic regret as the performance measure, defined as the difference between cumulative loss incurred by the online algorithm and that of any feasible…

机器学习 · 计算机科学 2020-12-01 Peng Zhao , Yu-Jie Zhang , Lijun Zhang , Zhi-Hua Zhou

In this paper, we consider an online optimization process, where the objective functions are not convex (nor concave) but instead belong to a broad class of continuous submodular functions. We first propose a variant of the Frank-Wolfe…

机器学习 · 统计学 2018-02-19 Lin Chen , Hamed Hassani , Amin Karbasi

We consider the online convex optimization problem. In the setting of arbitrary sequences and finite set of parameters, we establish a new fast-rate quantile regret bound. Then we investigate the optimization into the L1-ball by…

统计理论 · 数学 2018-05-24 Pierre Gaillard , Olivier Wintenberger

We study Smoothed Online Convex Optimization, a version of online convex optimization where the learner incurs a penalty for changing her actions between rounds. Given a $\Omega(\sqrt{d})$ lower bound on the competitive ratio of any online…

机器学习 · 计算机科学 2018-07-10 Niangjun Chen , Gautam Goel , Adam Wierman

In this work, we study the online convex optimization problem with curved losses and delayed feedback. When losses are strongly convex, existing approaches obtain regret bounds of order $d_{\max} \ln T$, where $d_{\max}$ is the maximum…

机器学习 · 计算机科学 2025-06-10 Hao Qiu , Emmanuel Esposito , Mengxiao Zhang

In this paper, we investigate the framework of Online Convex Optimization (OCO) for online learning. OCO offers a very powerful online learning framework for many applications. In this context, we study a specific framework of OCO called…

机器学习 · 计算机科学 2022-11-01 Deepan Muthirayan , Jianjun Yuan , Pramod P. Khargonekar

Online optimization has emerged as powerful tool in large scale optimization. In this pa- per, we introduce efficient online optimization algorithms based on the alternating direction method (ADM), which can solve online convex optimization…

机器学习 · 计算机科学 2013-07-11 Huahua Wang , Arindam Banerjee

In this paper, we propose an online convex optimization approach with two different levels of adaptivity. On a higher level, our approach is agnostic to the unknown types and curvatures of the online functions, while at a lower level, it…

机器学习 · 计算机科学 2024-04-17 Yu-Hu Yan , Peng Zhao , Zhi-Hua Zhou

This paper studies online nonstochastic control problems with adversarial and static constraints. We propose online nonstochastic control algorithms that achieve both sublinear regret and sublinear adversarial constraint violation while…

机器学习 · 计算机科学 2023-02-07 Xin Liu , Zixian Yang , Lei Ying

This paper addresses an online convex optimization problem where the cost function at each step depends on a history of past decisions (i.e., memory), and the decision maker has access to limited predictions of future cost values within a…

最优化与控制 · 数学 2025-12-29 Zhengmiao Wang , Zhi-Wei Liu , Ming Chi , Xiaoling Wang , Housheng Su , Lintao Ye

This paper considers the problem of distributed bandit online convex optimization with time-varying coupled inequality constraints. This problem can be defined as a repeated game between a group of learners and an adversary. The learners…

最优化与控制 · 数学 2019-12-10 Xinlei Yi , Xiuxian Li , Tao Yang , Lihua Xie , Karl H. Johansson , Tianyou Chai

This paper considers distributed online optimization with time-varying coupled inequality constraints. The global objective function is composed of local convex cost and regularization functions and the coupled constraint function is the…

最优化与控制 · 数学 2019-06-06 Xinlei Yi , Xiuxian Li , Lihua Xie , Karl H. Johansson

This paper introduces a new problem-dependent regret measure for online convex optimization with smooth losses. The notion, which we call the $G^\star$ regret, depends on the cumulative squared gradient norm evaluated at the decision in…

机器学习 · 统计学 2026-02-10 Wenzhi Gao , Chang He , Madeleine Udell

This paper considers distributed online nonconvex optimization with time-varying inequality constraints over a network of agents. For a time-varying graph, we propose a distributed online primal-dual algorithm with compressed communication…

最优化与控制 · 数学 2025-09-01 Kunpeng Zhang , Lei Xu , Xinlei Yi , Ming Cao , Karl H. Johansson , Tianyou Chai , Tao Yang

This paper studies online convex optimization with unknown linear budget constraints, where only the gradient information of the objective and the bandit feedback of constraint functions are observed. We propose a safe and efficient…

最优化与控制 · 数学 2025-03-10 Shanqi Liu , Xin Liu

In this paper, we investigate regrets of an online semi-proximal alternating direction method of multiplier (Online-spADMM) for solving online linearly constrained convex composite optimization problems. Under mild conditions, we establish…

最优化与控制 · 数学 2024-02-09 Yule Zhang , Zehao Xiao , Jia Wu , Liwei Zhang

We study monotone submodular maximization under general matroid constraints in the online setting. We prove that online optimization of a large class of submodular functions, namely, weighted threshold potential functions, reduces to online…

机器学习 · 计算机科学 2024-01-09 Tareq Si Salem , Gözde Özcan , Iasonas Nikolaou , Evimaria Terzi , Stratis Ioannidis

This paper considers the distributed online convex-concave optimization with constraint sets over a multiagent network, in which each agent autonomously generates a series of decision pairs through a designable mechanism to cooperatively…

最优化与控制 · 数学 2025-08-14 Wentao Zhang , Baoyong Zhang , Deming Yuan , Shengyuan Xu , Vincent K. N. Lau

We consider the problem of strongly-convex online optimization in presence of adversarial delays; in a T-iteration online game, the feedback of the player's query at time t is arbitrarily delayed by an adversary for d_t rounds and delivered…

机器学习 · 计算机科学 2019-09-12 Daniel Khashabi , Kent Quanrud , Amirhossein Taghvaei