中文
相关论文

相关论文: Dynamic Regret of Distributed Online Frank-Wolfe C…

200 篇论文

This paper presents a distributed optimization scheme over a network of agents in the presence of cost uncertainties and over switching communication topologies. Inspired by recent advances in distributed convex optimization, we propose a…

最优化与控制 · 数学 2016-11-15 Saghar Hosseini , Airlie Chapman , Mehran Mesbahi

This paper considers online convex optimization with long term constraints, where constraints can be violated in intermediate rounds, but need to be satisfied in the long run. The cumulative constraint violation is used as the metric to…

机器学习 · 计算机科学 2021-06-10 Xinlei Yi , Xiuxian Li , Tao Yang , Lihua Xie , Tianyou Chai , Karl H. Johansson

We consider online convex optimization with a zero-order oracle feedback. In particular, the decision maker does not know the explicit representation of the time-varying cost functions, or their gradients. At each time step, she observes…

最优化与控制 · 数学 2020-05-05 Tatiana Tatarenko , Maryam Kamgarpour

We consider the online convex optimization problem. In the setting of arbitrary sequences and finite set of parameters, we establish a new fast-rate quantile regret bound. Then we investigate the optimization into the L1-ball by…

统计理论 · 数学 2018-05-24 Pierre Gaillard , Olivier Wintenberger

A new algorithm for regret minimization in online convex optimization is described. The regret of the algorithm after $T$ time periods is $O(\sqrt{T \log T})$ - which is the minimum possible up to a logarithmic term. In addition, the new…

机器学习 · 计算机科学 2023-07-24 Elad Hazan , Nimrod Megiddo

We consider the problem of Online Convex Optimization (OCO) with two-point bandit feedback. In this setting, a player attempts to minimize a sequence of adversarially generated convex loss functions, while only observing the value of each…

机器学习 · 计算机科学 2026-04-07 Haishan Ye

In this paper, we consider an online optimization problem over $T$ rounds where at each step $t\in[T]$, the algorithm chooses an action $x_t$ from the fixed convex and compact domain set $\mathcal{K}$. A utility function $f_t(\cdot)$ is…

机器学习 · 计算机科学 2021-06-16 Omid Sadeghi , Prasanna Raut , Maryam Fazel

Many techniques for online optimization problems involve making decisions based solely on presently available information: fewer works take advantage of potential predictions. In this paper, we discuss the problem of online convex…

最优化与控制 · 数学 2019-02-04 Robert Ravier , Vahid Tarokh

In this paper, we study adaptive online convex optimization, and aim to design a universal algorithm that achieves optimal regret bounds for multiple common types of loss functions. Existing universal methods are limited in the sense that…

机器学习 · 计算机科学 2019-05-16 Guanghui Wang , Shiyin Lu , Lijun Zhang

We study Online Convex Optimization (OCO) with adversarial constraints, where an online algorithm must make sequential decisions to minimize both convex loss functions and cumulative constraint violations. We focus on a setting where the…

机器学习 · 统计学 2025-03-14 Jordan Lekeufack , Michael I. Jordan

This paper studies the online optimal control problem with time-varying convex stage costs for a time-invariant linear dynamical system, where a finite lookahead window of accurate predictions of the stage costs are available at each time.…

最优化与控制 · 数学 2019-10-23 Yingying Li , Xin Chen , Na Li

This paper studies a distributed online convex optimization problem, where agents in an unbalanced network cooperatively minimize the sum of their time-varying local cost functions subject to a coupled inequality constraint. To solve this…

最优化与控制 · 数学 2023-09-06 Dandan Wang , Daokuan Zhu , Kin Cheong Sou , Jie Lu

We consider the problem of online stochastic optimization in a distributed setting with $M$ clients connected through a central server. We develop a distributed online learning algorithm that achieves order-optimal cumulative regret with…

机器学习 · 计算机科学 2023-06-07 Sudeep Salgia , Qing Zhao , Tamir Gabay , Kobi Cohen

In this paper, the mixed equilibrium problem with coupled inequality constraints in dynamic environments is solved by employing a multi-agent system, where each agent only has access to its own bifunction, its own constraint function, and…

系统与控制 · 电气工程与系统科学 2024-12-30 Hang Xu , Kaihong Lu , Yu-Long Wang , Qixin Zhu

This paper focuses on convex constrained optimization problems, where the solution is subject to a convex inequality constraint. In particular, we aim at challenging problems for which both projection into the constrained domain and a…

最优化与控制 · 数学 2017-06-13 Tianbao Yang , Qihang Lin , Lijun Zhang

Recursive least-squares algorithms often use forgetting factors as a heuristic to adapt to non-stationary data streams. The first contribution of this paper rigorously characterizes the effect of forgetting factors for a class of online…

机器学习 · 计算机科学 2019-11-22 Jianjun Yuan , Andrew Lamperski

Projection operations are a typical computation bottleneck in online learning. In this paper, we enable projection-free online learning within the framework of Online Convex Optimization with Memory (OCO-M) -- OCO-M captures how the history…

机器学习 · 计算机科学 2023-04-03 Hongyu Zhou , Zirui Xu , Vasileios Tzoumas

Reflecting the greater significance of recent history over the distant past in non-stationary environments, $\lambda$-discounted regret has been introduced in online convex optimization (OCO) to gracefully forget past data as new…

机器学习 · 计算机科学 2025-05-27 Wenhao Yang , Sifan Yang , Lijun Zhang

We consider online optimization with binary decision variables and convex loss functions. We design a new algorithm, binary online gradient descent (bOGD) and bound its expected dynamic regret. We provide a regret bound that holds for any…

最优化与控制 · 数学 2022-01-21 Antoine Lesage-Landry , Joshua A. Taylor , Duncan S. Callaway

In this paper, we study a class of online optimization problems with long-term budget constraints where the objective functions are not necessarily concave (nor convex) but they instead satisfy the Diminishing Returns (DR) property.…

最优化与控制 · 数学 2019-07-02 Omid Sadeghi , Maryam Fazel