中文
相关论文

相关论文: Improved Dynamic Regret of Distributed Online Mult…

200 篇论文

This paper focuses on an online version of the emerging distributed constrained aggregative optimization framework, which is particularly suited for applications arising in cooperative robotics. Agents in a network want to minimize the sum…

最优化与控制 · 数学 2023-09-13 Guido Carnevale , Andrea Camisa , Giuseppe Notarstefano

We study the problem of non-constrained, discrete-time, online distributed optimization in a multi-agent system where some of the agents do not follow the prescribed update rule either due to failures or malicious intentions. None of the…

最优化与控制 · 数学 2022-04-12 Sourav Sahoo , Anand Gokhale , Rachel Kalpana Kalaimani

To deal with complicated constraints via locally light computations in distributed online learning, a recent study has presented a projection-free algorithm called distributed online conditional gradient (D-OCG), and achieved an…

机器学习 · 计算机科学 2022-06-15 Yuanyu Wan , Guanghui Wang , Wei-Wei Tu , Lijun Zhang

Recursive least-squares algorithms often use forgetting factors as a heuristic to adapt to non-stationary data streams. The first contribution of this paper rigorously characterizes the effect of forgetting factors for a class of online…

机器学习 · 计算机科学 2019-11-22 Jianjun Yuan , Andrew Lamperski

In this paper, we study a class of online optimization problems with long-term budget constraints where the objective functions are not necessarily concave (nor convex) but they instead satisfy the Diminishing Returns (DR) property.…

最优化与控制 · 数学 2019-07-02 Omid Sadeghi , Maryam Fazel

The performance of online convex optimization algorithms in a dynamic environment is often expressed in terms of the dynamic regret, which measures the decision maker's performance against a sequence of time-varying comparators. In the…

机器学习 · 计算机科学 2022-02-28 Nima Eshraghi , Ben Liang

This paper studies distributed online convex optimization with time-varying coupled constraints, motivated by distributed online control in network systems. Most prior work assumes a separability condition: the global objective and coupled…

最优化与控制 · 数学 2026-02-18 Zhaoye Pan , Haozhe Lei , Fan Zuo , Zilin Bian , Tao Li

We propose a novel approach for analyzing dynamic regret of first-order constrained online convex optimization algorithms for strongly convex and Lipschitz-smooth objectives. Crucially, we provide a general analysis that is applicable to a…

最优化与控制 · 数学 2025-08-22 Fabian Jakob , Andrea Iannelli

Many techniques for online optimization problems involve making decisions based solely on presently available information: fewer works take advantage of potential predictions. In this paper, we discuss the problem of online convex…

最优化与控制 · 数学 2019-02-04 Robert Ravier , Vahid Tarokh

In repeated interaction problems with adaptive agents, our objective often requires anticipating and optimizing over the space of possible agent responses. We show that many problems of this form can be cast as instances of online…

机器学习 · 计算机科学 2024-06-28 William Brown , Christos Papadimitriou , Tim Roughgarden

We study the problem of multi-agent control of a dynamical system with known dynamics and adversarial disturbances. Our study focuses on optimal control without centralized precomputed policies, but rather with adaptive control policies for…

最优化与控制 · 数学 2022-07-27 Udaya Ghai , Udari Madhushani , Naomi Leonard , Elad Hazan

To address the uncertainty in function types, recent progress in online convex optimization (OCO) has spurred the development of universal algorithms that simultaneously attain minimax rates for multiple types of convex functions. However,…

机器学习 · 计算机科学 2024-05-31 Wenhao Yang , Yibo Wang , Peng Zhao , Lijun Zhang

In this paper, we develop a novel virtual-queue-based online algorithm for online convex optimization (OCO) problems with long-term and time-varying constraints and conduct a performance analysis with respect to the dynamic regret and…

最优化与控制 · 数学 2021-11-16 Qingsong Liu , Wenfei Wu , Longbo Huang , Zhixuan Fang

This paper considers online convex optimization with long term constraints, where constraints can be violated in intermediate rounds, but need to be satisfied in the long run. The cumulative constraint violation is used as the metric to…

机器学习 · 计算机科学 2021-06-10 Xinlei Yi , Xiuxian Li , Tao Yang , Lihua Xie , Tianyou Chai , Karl H. Johansson

We consider the problem of distributed online optimization, with a group of learners connected via a dynamic communication graph. The goal of the learners is to track the global minimizer of a sum of time-varying loss functions in a…

最优化与控制 · 数学 2021-12-08 Nima Eshraghi , Ben Liang

We introduce an online convex optimization algorithm which utilizes projected subgradient descent with optimal adaptive learning rates. Our method provides second-order minimax-optimal dynamic regret guarantee (i.e. dependent on the sum of…

最优化与控制 · 数学 2022-09-14 Hakan Gokcesu , Suleyman S. Kozat

Regret minimization is treated as the golden rule in the traditional study of online learning. However, regret minimization algorithms tend to converge to the static optimum, thus being suboptimal for changing environments. To address this…

机器学习 · 计算机科学 2020-02-07 Lijun Zhang , Shiyin Lu , Tianbao Yang

This paper considers the problem of online optimization where the objective function is time-varying. In particular, we extend coordinate descent type algorithms to the online case, where the objective function varies after a finite number…

最优化与控制 · 数学 2024-04-26 Yankai Lin , Iman Shames , Dragan Nešić

We consider the online convex optimization problem. In the setting of arbitrary sequences and finite set of parameters, we establish a new fast-rate quantile regret bound. Then we investigate the optimization into the L1-ball by…

统计理论 · 数学 2018-05-24 Pierre Gaillard , Olivier Wintenberger

In this paper, we broaden the horizon of online convex optimization (OCO), and consider multi-objective OCO, where there are $K$ distinct loss function sequences, and an algorithm has to choose its action at time $t$, before the $K$ loss…

机器学习 · 计算机科学 2026-02-11 Rahul Vaze , Sumiran Mishra