English
Related papers

Related papers: Distributed Primal-Dual Optimization for Online Mu…

200 papers

Meta-reinforcement learning algorithms provide a data-driven way to acquire policies that quickly adapt to many tasks with varying rewards or dynamics functions. However, learned meta-policies are often effective only on the exact task…

Machine Learning · Computer Science 2023-07-13 Anurag Ajay , Abhishek Gupta , Dibya Ghosh , Sergey Levine , Pulkit Agrawal

Distributed diffusion is a powerful algorithm for multi-task state estimation which enables networked agents to interact with neighbors to process input data and diffuse information across the network. Compared to a centralized approach,…

Multiagent Systems · Computer Science 2020-03-27 Jiani Li , Xenofon Koutsoukos

Distributed control algorithms are known to reduce overall computation time compared to centralized control algorithms. However, they can result in inconsistent solutions leading to the violation of safety-critical constraints. Inconsistent…

Systems and Control · Electrical Eng. & Systems 2024-11-26 Julius Beerwerth , Maximilian Kloock , Bassam Alrifaee

Distributed optimization methods for large-scale machine learning suffer from a communication bottleneck. It is difficult to reduce this bottleneck while still efficiently and accurately aggregating partial work from different machines. In…

Machine Learning · Computer Science 2015-07-06 Chenxin Ma , Virginia Smith , Martin Jaggi , Michael I. Jordan , Peter Richtárik , Martin Takáč

This paper proposes a two-timescale compressed primal-dual (TiCoPD) algorithm for decentralized optimization with improved communication efficiency over prior works on primal-dual decentralized optimization. The algorithm is built upon the…

Optimization and Control · Mathematics 2025-01-13 Haoming Liu , Chung-Yiu Yau , Hoi-To Wai

We consider the problem of tracking the minimum of a time-varying convex optimization problem over a dynamic graph. Motivated by target tracking and parameter estimation problems in intermittently connected robotic and sensor networks, the…

Optimization and Control · Mathematics 2019-05-20 Rishabh Dixit , Amrit Singh Bedi , Ketan Rajawat

We deal with a general distributed constrained online learning problem with privacy over time-varying networks, where a class of nondecomposable objectives are considered. Under this setting, each node only controls a part of the global…

Optimization and Control · Mathematics 2024-05-28 Huqiang Cheng , Xiaofeng Liao , Huaqing Li

Orthogonal Frequency Division Multiplexing (OFDM) is the key component of many emerging broadband wireless access standards. The resource allocation in OFDM uplink, however, is challenging due to heterogeneity of users' Quality of Service…

Networking and Internet Architecture · Computer Science 2015-03-17 Xiaoxin Zhang , Liang Chen , Jianwei Huang , Minghua Chen , Yuping Zhao

In distributed machine learning, efficient training across multiple agents with different data distributions poses significant challenges. Even with a centralized coordinator, current algorithms that achieve optimal communication complexity…

Machine Learning · Computer Science 2024-08-13 Junchi Yang , Murat Yildirim , Qiu Feng

Machine Learning has proven useful in the recent years as a way to achieve failure prediction for industrial systems. However, the high computational resources necessary to run learning algorithms are an obstacle to its widespread…

Artificial Intelligence · Computer Science 2020-01-22 Nicolas Aussel , Sophie Chabridon , Yohan Petetin

In this paper we consider a network of processors aiming at cooperatively solving linear programming problems subject to uncertainty. Each node only knows a common cost function and its local uncertain constraint set. We propose a…

Optimization and Control · Mathematics 2019-08-27 Mohammadreza Chamanbaz , Giuseppe Notarstefano , Roland Bouffanais

This paper examines the problem of real-time optimization of networked systems and develops online algorithms that steer the system towards the optimal trajectory without explicit knowledge of the system model. The problem is modeled as a…

Optimization and Control · Mathematics 2019-10-01 Yue Chen , Andrey Bernstein , Adithya Devraj , Sean Meyn

We consider cooperative multi-agent resource sharing problems over time-varying communication networks, where only local communications are allowed. The objective is to minimize the sum of agent-specific composite convex functions subject…

Optimization and Control · Mathematics 2019-08-27 Necdet Serhat Aybat , Erfan Yazdandoost Hamedani

The domain of online algorithms with predictions has been extensively studied for different applications such as scheduling, caching (paging), clustering, ski rental, etc. Recently, Bamas et al., aiming for an unified method, have provided…

Data Structures and Algorithms · Computer Science 2021-10-04 Nguyen Kim Thang , Christoph Durr

The Primal-Dual (PD) algorithm is widely used in convex optimization to determine saddle points. While the stability of the PD algorithm can be easily guaranteed, strict contraction is nontrivial to establish in most cases. This work…

Optimization and Control · Mathematics 2018-11-21 Hung D. Nguyen , Thanh Long Vu , Konstantin Turitsyn , Jean-Jacques Slotine

Bilevel optimization plays an essential role in many machine learning tasks, ranging from hyperparameter optimization to meta-learning. Existing studies on bilevel optimization, however, focus on either centralized or synchronous…

Machine Learning · Computer Science 2023-02-27 Yang Jiao , Kai Yang , Tiancheng Wu , Dongjin Song , Chengtao Jian

This paper considers a time-varying optimization problem associated with a network of systems, with each of the systems shared by (and affecting) a number of individuals. The objective is to minimize cost functions associated with the…

Optimization and Control · Mathematics 2022-03-15 Ana M. Ospina , Andrea Simonetto , Emiliano Dall'Anese

Online optimisation facilitates the solution of dynamic inverse problems, such as image stabilisation, fluid flow monitoring, and dynamic medical imaging. In this paper, we improve upon previous work on predictive online primal-dual methods…

Optimization and Control · Mathematics 2025-02-28 Neil Dizon , Jyrki Jauhiainen , Tuomo Valkonen

The multi-objective coverage control problem requires a robot swarm to collaboratively provide sensor coverage to multiple heterogeneous importance density fields IDFs simultaneously. We pose this as an optimization problem with constraints…

Systems and Control · Electrical Eng. & Systems 2025-03-14 Juan Cervino , Saurav Agarwal , Vijay Kumar , Alejandro Ribeiro

In this note, we provide an overarching analysis of primal-dual dynamics associated to linear equality-constrained optimization problems using contraction analysis. For the well-known standard version of the problem: we establish…

Systems and Control · Electrical Eng. & Systems 2021-06-22 Pedro Cisneros-Velarde , Saber Jafarpour , Francesco Bullo