中文
相关论文

相关论文: Distributed Online Bandit Nonconvex Optimization w…

200 篇论文

We investigate online convex optimization in non-stationary environments and choose dynamic regret as the performance measure, defined as the difference between cumulative loss incurred by the online algorithm and that of any feasible…

机器学习 · 计算机科学 2024-04-09 Peng Zhao , Yu-Jie Zhang , Lijun Zhang , Zhi-Hua Zhou

This paper studies distributed online bandit learning of generalized Nash equilibria for online game, where cost functions of all players and coupled constraints are time-varying. The values rather than full information of cost and local…

最优化与控制 · 数学 2022-04-21 Min Meng , Xiuxian Li , Jie Chen

Saddle-point optimization problems are an important class of optimization problems with applications to game theory, multi-agent reinforcement learning and machine learning. A majority of the rich literature available for saddle-point…

最优化与控制 · 数学 2019-12-05 Abhishek Roy , Yifang Chen , Krishnakumar Balasubramanian , Prasant Mohapatra

This paper investigates online composite optimization in dynamic environments, where each objective or loss function contains a time-varying nondifferentiable regularizer. To resolve it, an online proximal gradient algorithm is studied for…

最优化与控制 · 数学 2023-03-24 Ruijie Hou , Xiuxian Li , Yang Shi

We consider online no-regret learning in unknown games with bandit feedback, where each player can only observe its reward at each time -- determined by all players' current joint action -- rather than its gradient. We focus on the class of…

机器学习 · 计算机科学 2024-04-01 Wenjia Ba , Tianyi Lin , Jiawei Zhang , Zhengyuan Zhou

We develop a reduction-based framework for online learning with delayed feedback that recovers and improves upon existing results for both first-order and bandit convex optimization. Our approach introduces a continuous-time model under…

机器学习 · 计算机科学 2026-02-04 Alexander Ryabchenko , Idan Attias , Daniel M. Roy

In this paper, we study a special bandit setting of online stochastic linear optimization, where only one-bit of information is revealed to the learner at each round. This problem has found many applications including online advertisement…

机器学习 · 计算机科学 2015-09-28 Lijun Zhang , Tianbao Yang , Rong Jin , Zhi-Hua Zhou

We investigate online convex optimization in non-stationary environments and choose the dynamic regret as the performance measure, defined as the difference between cumulative loss incurred by the online algorithm and that of any feasible…

机器学习 · 计算机科学 2020-12-01 Peng Zhao , Yu-Jie Zhang , Lijun Zhang , Zhi-Hua Zhou

We study the online saddle point problem, an online learning problem where at each iteration a pair of actions need to be chosen without knowledge of the current and future (convex-concave) payoff functions. The objective is to minimize the…

机器学习 · 统计学 2020-04-07 Adrian Rivera , He Wang , Huan Xu

Non-stationary online learning has drawn much attention in recent years. In particular, dynamic regret and adaptive regret are proposed as two principled performance measures for online convex optimization in non-stationary environments. To…

机器学习 · 计算机科学 2025-09-10 Peng Zhao , Yan-Feng Xie , Lijun Zhang , Zhi-Hua Zhou

This paper considers distributed online optimization with time-varying coupled inequality constraints. The global objective function is composed of local convex cost and regularization functions and the coupled constraint function is the…

最优化与控制 · 数学 2019-06-06 Xinlei Yi , Xiuxian Li , Lihua Xie , Karl H. Johansson

We consider the problem of online convex optimization against an arbitrary adversary with bandit feedback, known as bandit convex optimization. We give the first $\tilde{O}(\sqrt{T})$-regret algorithm for this setting based on a novel…

机器学习 · 计算机科学 2016-03-16 Elad Hazan , Yuanzhi Li

Although online convex optimization (OCO) under arbitrary delays has received increasing attention recently, previous studies focus on stationary environments with the goal of minimizing static regret. In this paper, we investigate the…

机器学习 · 计算机科学 2025-11-10 Yuanyu Wan , Chang Yao , Yitao Ma , Mingli Song , Lijun Zhang

We consider distributed online learning for joint regret with communication constraints. In this setting, there are multiple agents that are connected in a graph. Each round, an adversary first activates one of the agents to issue a…

机器学习 · 计算机科学 2021-10-26 Dirk van der Hoeven , Hédi Hadiji , Tim van Erven

This paper addresses the distributed online control problem over a network of linear time-invariant (LTI) systems (with possibly unknown dynamics) in the presence of adversarial perturbations. There exists a global network cost that is…

最优化与控制 · 数学 2023-10-06 Ting-Jui Chang , Shahin Shahrampour

This paper studies multi-stage systems with end-to-end bandit feedback. In such systems, each job needs to go through multiple stages, each managed by a different agent, before generating an outcome. Each agent can only control its own…

机器学习 · 计算机科学 2024-08-20 I-Hong Hou

In this paper, we consider an online distributed composite optimization problem over a time-varying multi-agent network that consists of multiple interacting nodes, where the objective function of each node consists of two parts: a loss…

最优化与控制 · 数学 2020-04-03 Deming Yuan , Yiguang Hong , Daniel W. C. Ho , Shengyuan Xu

This paper addresses two fundamental challenges in distributed online convex optimization: communication efficiency and optimization under limited feedback. We propose a unified framework named Online Compressed Gradient Tracking (OCGT),…

最优化与控制 · 数学 2025-12-08 Longkang Zhu , Xinli Shi , Xiangping Xu , Jinde Cao , Xiangyong Chen

In this paper we study the non-stationary stochastic optimization question with bandit feedback and dynamic regret measures. The seminal work of Besbes et al. (2015) shows that, when aggregated function changes is known a priori, a simple…

机器学习 · 统计学 2022-10-12 Yining Wang

Zeroth-order optimization (ZO) typically relies on two-point feedback to estimate the unknown gradient of the objective function. Nevertheless, two-point feedback can not be used for online optimization of time-varying objective functions,…

机器学习 · 计算机科学 2020-12-04 Yan Zhang , Yi Zhou , Kaiyi Ji , Michael M. Zavlanos