中文
相关论文

相关论文: Several Performance Bounds on Decentralized Online…

200 篇论文

We consider the task of minimizing the sum of convex functions stored in a decentralized manner across the nodes of a communication network. This problem is relatively well-studied in the scenario when the objective functions are smooth, or…

最优化与控制 · 数学 2024-05-29 Dmitry Kovalev , Ekaterina Borodich , Alexander Gasnikov , Dmitrii Feoktistov

This work considers the problem of decentralized online learning, where the goal is to track the optimum of the sum of time-varying functions, distributed across several nodes in a network. The local availability of the functions and their…

机器学习 · 计算机科学 2024-02-14 Shivangi Dubey Sharma , Ketan Rajawat

Constrained multiobjective optimization has gained much interest in the past few years. However, constrained multiobjective optimization problems (CMOPs) are still unsatisfactorily understood. Consequently, the choice of adequate CMOPs for…

神经与进化计算 · 计算机科学 2023-02-07 Aljoša Vodopija , Tea Tušar , Bogdan Filipič

The goal of data-driven algorithm design is to obtain high-performing algorithms for specific application domains using machine learning and data. Across many fields in AI, science, and engineering, practitioners will often fix a family of…

机器学习 · 计算机科学 2020-12-22 Maria-Florina Balcan , Travis Dick , Wesley Pegden

Decentralized optimization methods enable on-device training of machine learning models without a central coordinator. In many scenarios communication between devices is energy demanding and time consuming and forms the bottleneck of the…

最优化与控制 · 数学 2020-11-04 Dmitry Kovalev , Anastasia Koloskova , Martin Jaggi , Peter Richtarik , Sebastian U. Stich

We study an online mixed discrete and continuous optimization problem where a decision maker interacts with an unknown environment for a number of $T$ rounds. At each round, the decision maker needs to first jointly choose a discrete and a…

最优化与控制 · 数学 2024-08-27 Lintao Ye , Ming Chi , Zhi-Wei Liu , Xiaoling Wang , Vijay Gupta

In this paper, we investigate the framework of Online Convex Optimization (OCO) for online learning. OCO offers a very powerful online learning framework for many applications. In this context, we study a specific framework of OCO called…

机器学习 · 计算机科学 2022-11-01 Deepan Muthirayan , Jianjun Yuan , Pramod P. Khargonekar

We study the problem of differentially private optimization with linear constraints when the right-hand-side of the constraints depends on private data. This type of problem appears in many applications, especially resource allocation.…

机器学习 · 计算机科学 2020-11-05 Andrés Muñoz Medina , Umar Syed , Sergei Vassilvitskii , Ellen Vitercik

In the era of deep reinforcement learning, making progress is more complex, as the collected experience must be compressed into a deep model for future exploitation and sampling. Many papers have shown that training a deep learning policy…

机器学习 · 计算机科学 2025-08-05 Glen Berseth

Decentralized optimization enables a network of agents to cooperatively optimize an overall objective function without a central coordinator and is gaining increased attention in domains as diverse as control, sensor networks, data mining,…

最优化与控制 · 数学 2023-12-27 Yongqiang Wang , Angelia Nedic

In this paper, we investigate the online allocation problem of maximizing the overall revenue subject to both lower and upper bound constraints. Compared to the extensively studied online problems with only resource upper bounds, the…

机器学习 · 计算机科学 2023-01-31 Qixin Zhang , Wenbing Ye , Zaiyi Chen , Haoyuan Hu , Enhong Chen , Yang Yu

Recently, several universal methods have been proposed for online convex optimization which can handle convex, strongly convex and exponentially concave cost functions simultaneously. However, most of these algorithms have been designed…

机器学习 · 计算机科学 2023-02-14 Arnold Salas

In recent years, deep off-policy actor-critic algorithms have become a dominant approach to reinforcement learning for continuous control. One of the primary drivers of this improved performance is the use of pessimistic value updates to…

机器学习 · 计算机科学 2022-04-07 Ted Moskovitz , Jack Parker-Holder , Aldo Pacchiano , Michael Arbel , Michael I. Jordan

This article introduces a generalized framework for Decentralized Learning formulated as a Multi-Objective Optimization problem, in which both distributed agents and a central coordinator contribute independent, potentially conflicting…

最优化与控制 · 数学 2025-07-21 Roberto Morales , Umberto Biccari

Online learning has been in the spotlight from the machine learning society for a long time. To handle massive data in Big Data era, one single learner could never efficiently finish this heavy task. Hence, in this paper, we propose a novel…

机器学习 · 计算机科学 2015-06-24 Chencheng Li , Pan Zhou

We study decentralized optimization where multiple agents minimize the average of their (strongly) convex, smooth losses over a communication graph. Convergence of the existing decentralized methods generally hinges on an apriori, proper…

最优化与控制 · 数学 2025-08-01 Ilya Kuruzov , Xiaokai Chen , Gesualdo Scutari , Alexander Gasnikov

This paper considers a time-varying optimization problem associated with a network of systems, with each of the systems shared by (and affecting) a number of individuals. The objective is to minimize cost functions associated with the…

最优化与控制 · 数学 2022-03-15 Ana M. Ospina , Andrea Simonetto , Emiliano Dall'Anese

A natural goal when designing online learning algorithms for non-stationary environments is to bound the regret of the algorithm in terms of the temporal variation of the input sequence. Intuitively, when the variation is small, it should…

机器学习 · 计算机科学 2021-12-08 Gautam Goel , Babak Hassibi

In this paper we propose a model-based approach to the design of online optimization algorithms, with the goal of improving the tracking of the solution trajectory (trajectories) w.r.t. state-of-the-art methods. We focus first on quadratic…

最优化与控制 · 数学 2023-07-24 Nicola Bastianello , Ruggero Carli , Sandro Zampieri

We consider the problem of tracking the minimum of a time-varying convex optimization problem over a dynamic graph. Motivated by target tracking and parameter estimation problems in intermittently connected robotic and sensor networks, the…

最优化与控制 · 数学 2019-05-20 Rishabh Dixit , Amrit Singh Bedi , Ketan Rajawat