English
Related papers

Related papers: An Asynchronous Decentralized Algorithm for Wasser…

200 papers

In duty-cycled wireless sensor networks, deployed sensor nodes are usually put to sleep for energy efficiency according to sleep scheduling approaches. Any sleep scheduling scheme with its supporting protocols ensures that data can always…

Networking and Internet Architecture · Computer Science 2012-07-12 Yun Wang , Peizhong Shi , Kai Li , Jie Wu

Distributed descent-based methods are an essential toolset to solving optimization problems in multi-agent system scenarios. Here the agents seek to optimize a global objective function through mutual cooperation. Oftentimes, cooperation is…

Optimization and Control · Mathematics 2019-08-28 Arunselvan Ramaswamy

This paper first proposes an N-block PCPM algorithm to solve N-block convex optimization problems with both linear and nonlinear constraints, with global convergence established. A linear convergence rate under the strong second-order…

Optimization and Control · Mathematics 2021-03-26 Run Chen , Andrew L. Liu

Machine learning with big data often involves large optimization models. For distributed optimization over a cluster of machines, frequent communication and synchronization of all model parameters (optimization variables) can be very…

Optimization and Control · Mathematics 2017-10-17 Lin Xiao , Adams Wei Yu , Qihang Lin , Weizhu Chen

Equilibrium multi-population matching (matching for teams) is a problem from mathematical economics which is related to multi-marginal optimal transport. A special but important case is the Wasserstein barycenter problem, which has…

Numerical Analysis · Mathematics 2014-11-14 Guillaume Carlier , Adam Oberman , Edouard Oudet

Bilevel optimization has gained significant attention in recent years due to its broad applications in machine learning. This paper focuses on bilevel optimization in decentralized networks and proposes a novel single-loop algorithm for…

Optimization and Control · Mathematics 2024-04-24 Youran Dong , Shiqian Ma , Junfeng Yang , Chao Yin

A challenging problem in decentralized optimization is to develop algorithms with fast convergence on random and time varying topologies under unreliable and bandwidth-constrained communication network. This paper studies a stochastic…

Optimization and Control · Mathematics 2025-05-29 Chung-Yiu Yau , Haoming Liu , Hoi-To Wai

This paper presents an AI-augmented decentralized framework for multi-agent (multi-robot) environmental mapping under limited sensing and communication. While conventional coverage formulations achieve effective spatial allocation when an…

Multiagent Systems · Computer Science 2026-01-30 Kooktae Lee , Julian Martinez

To solve the problem of joint sparsity pattern recovery in a decen-tralized network, we propose an algorithm named decentralized and collaborative subspace pursuit (DCSP). The basic idea of DCSP is to embed collaboration among nodes and…

Information Theory · Computer Science 2014-03-07 Gang Li , Thakshila Wimalajeewa , Pramod K. Varshney

While training a machine learning model using multiple workers, each of which collects data from their own data sources, it would be most useful when the data collected from different workers can be {\em unique} and {\em different}.…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-23 Hanlin Tang , Xiangru Lian , Ming Yan , Ce Zhang , Ji Liu

We propose a new algorithm to simplify the controller development for distributed robotic systems subject to external observations, disturbances, and communication delays. Unlike prior approaches that propose specialized solutions to…

Robotics · Computer Science 2021-04-15 Jiayi Wei , Tongrui Li , Swarat Chaudhuri , Isil Dillig , Joydeep Biswas

Scaling to arbitrarily large bundle adjustment problems requires data and compute to be distributed across multiple devices. Centralized methods in prior works are only able to solve small or medium size problems due to overhead in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Taosha Fan , Joseph Ortiz , Ming Hsiao , Maurizio Monge , Jing Dong , Todd Murphey , Mustafa Mukadam

In this paper a new distributed asynchronous algorithm is proposed for time synchronization in networks with random communication delays, measurement noise and communication dropouts. Three different types of the drift correction algorithm…

Systems and Control · Computer Science 2018-02-05 Milos S. Stankovic , Srdjan S. Stankovic , Karl Henrik Johansson

Distributed training algorithms of deep neural networks show impressive convergence speedup properties on very large problems. However, they inherently suffer from communication related slowdowns and communication topology becomes a crucial…

Machine Learning · Computer Science 2022-03-25 Tomer Avidor , Nadav Tal Israel

Distributed training of Deep Learning models has been critical to many recent successes in the field. Current standard methods primarily rely on synchronous centralized algorithms which induce major communication bottlenecks and…

Machine Learning · Computer Science 2023-12-07 Adel Nabli , Eugene Belilovsky , Edouard Oyallon

In this paper, a centralized two-block separable optimization is considered for which a fully parallel primal-dual discrete-time algorithm with fixed step size is derived based on monotone operator splitting method. In this algorithm, the…

Optimization and Control · Mathematics 2020-09-30 S. Sh. Alaviani , A. G. Kelkar

Wasserstein distributionally robust control (DRC) recently emerges as a principled paradigm for handling uncertainty in stochastic dynamical systems. However, it constructs data-driven ambiguity sets via uniform distribution shifts before…

Optimization and Control · Mathematics 2025-10-14 Jingyi Wu , Chao Ning , Yang Shi

Machine learning (ML) is a key technique for big-data-driven modelling and analysis of massive Internet of Things (IoT) based intelligent and ubiquitous computing. For fast-increasing applications and data amounts, distributed learning is a…

Machine Learning · Computer Science 2022-02-08 Hao Chen , Yu Ye , Ming Xiao , Mikael Skoglund

This paper presents a novel sensitivity-based distributed programming (SBDP) approach for non-convex, large-scale nonlinear programs (NLP). The algorithm relies on first-order sensitivities to cooperatively solve the central NLP in a…

Optimization and Control · Mathematics 2026-03-30 Maximilian Pierer von Esch , Andreas Völz , Knut Graichen

A robust clustering method for probabilities in Wasserstein space is introduced. This new "trimmed $k$-barycenters" approach relies on recent results on barycenters in Wasserstein space that allow intensive computation, as required by…

Methodology · Statistics 2019-02-06 E. del Barrio , J. A. Cuesta-Albertos , C. Matrán , A. Mayo-Íscar