English
Related papers

Related papers: LocalNewton: Reducing Communication Bottleneck for…

200 papers

Artificial neural networks have successfully tackled a large variety of problems by training extremely deep networks via back-propagation. A direct application of back-propagation to spiking neural networks contains biologically implausible…

Neural and Evolutionary Computing · Computer Science 2021-11-29 Kyle Daruwalla , Mikko Lipasti

Many of the distributed localization algorithms are based on relaxed optimization formulations of the localization problem. These algorithms commonly rely on first-order optimization methods, and hence may require many iterations or…

Optimization and Control · Mathematics 2016-07-19 Sina Khoshfetrat Pakazad , Emre Özkan , Carsten Fritsche , Anders Hansson , Fredrik Gustafsson

We extend classical methods of computational complexity to the realm of distributed computing, where they sometimes prove more effective than in their original context. Our focus is on decision problems in the LOCAL model, a setting in…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-08 Fabian Reiter

We introduce a new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are unevenly distributed over an extremely large number of nodes. The goal is to train a…

Machine Learning · Computer Science 2016-10-11 Jakub Konečný , H. Brendan McMahan , Daniel Ramage , Peter Richtárik

In this paper, we develop a distributed intermittent communication and task planning framework for mobile robot teams. The goal of the robots is to accomplish complex tasks, captured by local Linear Temporal Logic formulas, and share the…

Robotics · Computer Science 2018-06-26 Yiannis Kantaros , Meng Guo , Michael M. Zavlanos

Researchers recently extended Distributed Constraint Optimization Problems (DCOPs) to Communication-Aware DCOPs so that they are applicable in scenarios in which messages can be arbitrarily delayed. Distributed asynchronous local search and…

Artificial Intelligence · Computer Science 2025-04-15 Ben Rachmut , Roie Zivan , William Yeoh

In this paper, we propose an intermittent communication framework for mobile robot networks. Specifically, we consider robots that move along the edges of a connected mobility graph and communicate only when they meet at the nodes of that…

Multiagent Systems · Computer Science 2016-09-23 Yiannis Kantaros , Michael M. Zavlanos

We present a lightweight, decentralized algorithm for navigating multiple nonholonomic agents through challenging environments with narrow passages. Our key idea is to allow agents to yield to each other in large open areas instead of…

Robotics · Computer Science 2023-03-17 Liang He , Zherong Pan , Dinesh Manocha

The diversity and quantity of data warehouses, gathering data from distributed devices such as mobile devices, can enhance the success and robustness of machine learning algorithms. Federated learning enables distributed participants to…

Machine Learning · Computer Science 2022-03-10 Shuo Wang , Surya Nepal , Kristen Moore , Marthie Grobler , Carsten Rudolph , Alsharif Abuadbba

A central theme in distributed network algorithms concerns understanding and coping with the issue of locality. Inspired by sequential complexity theory, we focus on a complexity theory for distributed decision problems. In the context of…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-03-04 Pierre Fraigniaud , Amos Korman , David Peleg

We are given an equal number of mobile robotic agents, and distinct target locations. Each agent has simple integrator dynamics, a limited communication range, and knowledge of the position of every target. We address the problem of…

Robotics · Computer Science 2007-05-23 Stephen L. Smith , Francesco Bullo

Data shuffling is one of the fundamental building blocks for distributed learning algorithms, that increases the statistical gain for each step of the learning process. In each iteration, different shuffled data points are assigned by a…

Information Theory · Computer Science 2016-09-19 Mohamed Attia , Ravi Tandon

Distributed optimization methods with local updates have recently attracted a lot of attention due to their potential to reduce the communication cost of distributed methods. In these algorithms, a collection of nodes performs several local…

Optimization and Control · Mathematics 2023-10-11 Sulaiman A. Alghunaim

When scaling distributed training, the communication overhead is often the bottleneck. In this paper, we propose a novel SGD variant with reduced communication and adaptive learning rates. We prove the convergence of the proposed algorithm…

Machine Learning · Computer Science 2020-12-08 Cong Xie , Oluwasanmi Koyejo , Indranil Gupta , Haibin Lin

An efficient and fair node scheduling is a big challenge in multihop wireless networks. In this work, we propose a distributed node scheduling algorithm, called Local Voting. The idea comes from the finding that the shortest delivery time…

Networking and Internet Architecture · Computer Science 2020-02-14 Dimitrios J. Vergados , Natalia Amelina , Yuming Jiang , Katina Kralevska , Oleg Granichin

The problem of minimizing a sum of local convex objective functions over a networked system captures many important applications and has received much attention in the distributed optimization field. Most of existing work focuses on…

Optimization and Control · Mathematics 2019-01-09 Fatemeh Mansoori , Ermin Wei

We introduce a new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are distributed (unevenly) over an extremely large number of \nodes, but the goal remains to…

Machine Learning · Computer Science 2015-11-12 Jakub Konečný , Brendan McMahan , Daniel Ramage

A standard model in network synchronised distributed computing is the LOCAL model. In this model, the processors work in rounds and, in the classic setting, they know the number of vertices of the network, $n$. Using $n$, they can compute…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-20 Laurent Feuilloley

Many algorithms for control of multi-robot teams operate under the assumption that low-latency, global state information necessary to coordinate agent actions can readily be disseminated among the team. However, in harsh environments with…

Robotics · Computer Science 2021-08-02 Ekaterina Tolstaya , Landon Butler , Daniel Mox , James Paulos , Vijay Kumar , Alejandro Ribeiro

We consider the distributed learning problem where a network of $n$ agents seeks to minimize a global function $F$. Agents have access to $F$ through noisy gradients, and they can locally communicate with their neighbors a network. We study…

Machine Learning · Computer Science 2020-11-09 Tiancheng Qin , S. Rasoul Etesami , César A. Uribe
‹ Prev 1 3 4 5 6 7 10 Next ›