中文
相关论文

相关论文: Improved Guarantees for Constrained Online Convex …

200 篇论文

Many techniques for online optimization problems involve making decisions based solely on presently available information: fewer works take advantage of potential predictions. In this paper, we discuss the problem of online convex…

最优化与控制 · 数学 2019-02-04 Robert Ravier , Vahid Tarokh

Motivated by the challenge of nonstationarity in sequential decision making, we study Online Convex Optimization (OCO) under the coupling of two problem structures: the domain is unbounded, and the comparator sequence $u_1,\ldots,u_T$ is…

机器学习 · 计算机科学 2023-10-27 Zhiyu Zhang , Ashok Cutkosky , Ioannis Ch. Paschalidis

We consider Online Convex Optimization (OCO) in the setting where the costs are $m$-strongly convex and the online learner pays a switching cost for changing decisions between rounds. We show that the recently proposed Online Balanced…

机器学习 · 计算机科学 2019-04-05 Gautam Goel , Adam Wierman

The online optimization problem with non-convex loss functions over a closed convex set, coupled with a set of inequality (possibly non-convex) constraints is a challenging online learning problem. A proximal method of multipliers with…

最优化与控制 · 数学 2022-04-26 Liwei Zhang , Haoyang Liu , Xiantao Xiao

We present the first theoretical guarantees for zero constraint violation in Online Convex Optimization (OCO) across all rounds, addressing dynamic constraint changes. Unlike existing approaches in constrained OCO, which allow for…

机器学习 · 计算机科学 2025-05-02 Bassel Hamoud , Ilnura Usmanova , Kfir Y. Levy

Hoffman's classical result gives a bound on the distance of a point from a convex and compact polytope in terms of the magnitude of violation of the constraints. Recently, several results showed that Hoffman's bound can be used to derive…

机器学习 · 计算机科学 2019-02-19 Dan Garber

We study the online calibration of multi-dimensional forecasts over an arbitrary convex set $\mathcal{P} \subset \mathbb{R}^d$ relative to an arbitrary norm $\Vert\cdot\Vert$. We connect this with the problem of external regret minimization…

机器学习 · 计算机科学 2025-05-28 Maxwell Fishelson , Noah Golowich , Mehryar Mohri , Jon Schneider

Stochastic and adversarial data are two widely studied settings in online learning. But many optimization tasks are neither i.i.d. nor fully adversarial, which makes it of fundamental interest to get a better theoretical understanding of…

机器学习 · 计算机科学 2025-11-03 Sarah Sachs , Hedi Hadiji , Tim van Erven , Cristobal Guzman

In citep{Hazan-2008-extract}, the authors showed that the regret of online linear optimization can be bounded by the total variation of the cost vectors. In this paper, we extend this result to general online convex optimization. We first…

机器学习 · 计算机科学 2012-06-15 Tianbao Yang , Mehrdad Mahdavi , Rong Jin , Shenghuo Zhu

We consider an online two-stage stochastic optimization with long-term constraints over a finite horizon of $T$ periods. At each period, we take the first-stage action, observe a model parameter realization and then take the second-stage…

机器学习 · 计算机科学 2024-05-21 Jiashuo Jiang

We propose and study an online version of min-max optimization based on cumulative saddle points under a variety of performance measures beyond convex-concave settings. After first observing the incompatibility of (static) Nash equilibrium…

机器学习 · 计算机科学 2026-02-12 Abhijeet Vyas , Brian Bullins

This paper considers the distributed bandit convex optimization problem with time-varying constraints. In this problem, the global loss function is the average of all the local convex loss functions, which are unknown beforehand. Each agent…

系统与控制 · 电气工程与系统科学 2025-04-25 Kunpeng Zhang , Lei Xu , Xinlei Yi , Guanghui Wen , Lihua Xie , Tianyou Chai , Tao Yang

This paper considers distributed online optimization with time-varying coupled inequality constraints. The global objective function is composed of local convex cost and regularization functions and the coupled constraint function is the…

最优化与控制 · 数学 2019-06-06 Xinlei Yi , Xiuxian Li , Lihua Xie , Karl H. Johansson

We consider the problem of the Zinkevich (2003)-style dynamic regret minimization in online learning with exp-concave losses. We show that whenever improper learning is allowed, a Strongly Adaptive online learner achieves the dynamic regret…

机器学习 · 计算机科学 2021-07-06 Dheeraj Baby , Yu-Xiang Wang

This paper investigates distributed online convex optimization in the presence of an aggregative variable without any global/central coordinators over a multi-agent network, where each individual agent is only able to access partial…

最优化与控制 · 数学 2020-07-15 Xiuxian Li , Xinlei Yi , Lihua Xie

In many applications, learning systems are required to process continuous non-stationary data streams. We study this problem in an online learning framework and propose an algorithm that can deal with adversarial time-varying and nonlinear…

机器学习 · 计算机科学 2023-10-16 Pavel Kolev , Georg Martius , Michael Muehlebach

We consider online convex optimization with stochastic constraints where the objective functions are arbitrarily time-varying and the constraint functions are independent and identically distributed (i.i.d.) over time. Both the objective…

最优化与控制 · 数学 2019-08-02 Xiaohan Wei , Hao Yu , Michael J. Neely

We consider the online convex optimization problem. In the setting of arbitrary sequences and finite set of parameters, we establish a new fast-rate quantile regret bound. Then we investigate the optimization into the L1-ball by…

统计理论 · 数学 2018-05-24 Pierre Gaillard , Olivier Wintenberger

We study Smoothed Online Convex Optimization, a version of online convex optimization where the learner incurs a penalty for changing her actions between rounds. Given a $\Omega(\sqrt{d})$ lower bound on the competitive ratio of any online…

机器学习 · 计算机科学 2018-07-10 Niangjun Chen , Gautam Goel , Adam Wierman

Recently, several universal methods have been proposed for online convex optimization which can handle convex, strongly convex and exponentially concave cost functions simultaneously. However, most of these algorithms have been designed…

机器学习 · 计算机科学 2023-02-14 Arnold Salas