English
Related papers

Related papers: Dependability in Aggregation by Averaging

200 papers

In this paper, we focus on solving a distributed convex optimization problem in a network, where each agent has its own convex cost function and the goal is to minimize the sum of the agents' cost functions while obeying the network…

Optimization and Control · Mathematics 2020-02-11 Shi Pu , Wei Shi , Jinming Xu , Angelia Nedić

This paper proposes a simple but effective graph-based agglomerative algorithm, for clustering high-dimensional data. We explore the different roles of two fundamental concepts in graph theory, indegree and outdegree, in the context of…

Computer Vision and Pattern Recognition · Computer Science 2015-03-20 Wei Zhang , Xiaogang Wang , Deli Zhao , Xiaoou Tang

We study the gossip problem in a message-passing environment: When a process receives a message, it has to decide whether the sender has more recent information on other processes than itself. This problem is at the heart of many…

Formal Languages and Automata Theory · Computer Science 2018-04-30 Benedikt Bollig , Marie Fortin , Paul Gastin

Consensus of autonomous agents is a benchmark problem in cooperative control. In this paper, we consider standard continuous-time averaging consensus policies (or Laplacian flows) over time-varying graphs and focus on robustness of…

Systems and Control · Electrical Eng. & Systems 2020-09-08 Anton V. Proskurnikov , Guiseppe Calafiore

Peer to peer (P2P) systems are moving from application specific architectures to a generic service oriented design philosophy. This raises interesting problems in connection with providing useful P2P middleware services that are capable of…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Antonio Fernandez , Vincent Gramoli , Ernesto Jimenez , Anne-Marie Kermarrec , Michel Raynal

We analyse and explain the increased generalisation performance of iterate averaging using a Gaussian process perturbation model between the true and batch risk surface on the high dimensional quadratic. We derive three phenomena…

Machine Learning · Statistics 2021-11-02 Diego Granziol , Xingchen Wan , Samuel Albanie , Stephen Roberts

Proportional fairness is a popular service allocation mechanism to describe and analyze the performance of data networks at flow level. Recently, several authors have shown that the invariant distribution of such networks admits a product…

Probability · Mathematics 2015-06-18 Maria Vlasiou , Jiheng Zhang , Bert Zwart

We consider the distributed weight balancing problem in networks of nodes that are interconnected via directed edges, each of which is able to admit a positive integer weight within a certain interval, captured by individual lower and upper…

Systems and Control · Electrical Eng. & Systems 2019-07-10 Apostolos I. Rikos , Christoforos N. Hadjicostis

Federated learning is a prime candidate for distributed machine learning at the network edge due to the low communication complexity and privacy protection among other attractive properties. However, existing algorithms face issues with…

Machine Learning · Computer Science 2022-03-25 Hung T. Nguyen , H. Vincent Poor , Mung Chiang

Federated Averaging remains the most widely used aggregation strategy in federated learning due to its simplicity and scalability. However, its performance degrades significantly in non-IID data settings, where client distributions are…

Machine Learning · Computer Science 2025-03-07 Marco Arazzi , Mert Cihangiroglu , Antonino Nocera

We consider the problem of computing an aggregation function in a \emph{secure} and \emph{scalable} way. Whereas previous distributed solutions with similar security guarantees have a communication cost of $O(n^3)$, we present a distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-11-24 Sebastien Gambs , Rachid Guerraoui , Hamza Harkous , Florian Huc , Anne-Marie Kermarrec

Motivated by undetectable risks in generative AI, we study a general robust aggregation problem: how to aggregate several probability distributions to boost safety. We present consensus sampling, a black-box algorithm that, given k…

Artificial Intelligence · Computer Science 2026-05-12 Adam Tauman Kalai , Yael Tauman Kalai , Or Zamir

We consider a fully distributed constrained convex optimization problem over a multi-agent (no central coordinator) network. We propose an asynchronous gossip-based random projection (GRP) algorithm that solves the distributed problem using…

Optimization and Control · Mathematics 2013-04-08 Soomin Lee , Angelia Nedich

Here we propose a generic mechanism - networked buffering - for generating robust traits in complex systems that requires two basic conditions to be satisfied: 1) agents are versatile enough to perform more than one single functional role…

Adaptation and Self-Organizing Systems · Physics 2011-12-15 James M Whitacre , Axel Bender

Robustness and cascading failures in interdependent systems has been an active research field in the past decade. However, most existing works use percolation-based models where only the largest component of each network remains functional…

Physics and Society · Physics 2018-02-21 Yingrui Zhang , Alex Arenas , Osman Yağan

It was recently recognized that interdependencies among different networks can play a crucial role in triggering cascading failures and hence system-wide disasters. A recent model shows how pairs of interdependent networks can exhibit an…

Physics and Society · Physics 2012-12-06 Di Zhou , Gregorio D'Agostino , Antonio Scala , H. Eugene Stanley

In this work we present a randomized gossip algorithm for solving the average consensus problem while at the same time protecting the information about the initial private values stored at the nodes. We give iteration complexity bounds for…

Optimization and Control · Mathematics 2024-12-20 Filip Hanzely , Jakub Konečný , Nicolas Loizou , Peter Richtárik , Dmitry Grishchenko

Motivated by applications in machine learning and statistics, we study distributed optimization problems over a network of processors, where the goal is to optimize a global objective composed of a sum of local functions. In these problems,…

Optimization and Control · Mathematics 2019-05-14 Thinh T. Doan , Carolyn L. Beck , R. Srikant

We study the problem of maintaining robust and sparse overlay networks in fully distributed settings where nodes continuously join and leave the system. This scenario closely models real-world unstructured peer-to-peer networks, where…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-16 Antonio Cruciani

Consider a system of autonomous mobile robots initially randomly deployed on the nodes of an anonymous finite grid. A gathering algorithm is a sequence of moves to be executed independently by each robot so that all robots meet at a single…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-05 Kaustav Bose , Ranendu Adhikary , Sruti Gan Chaudhuri , Buddhadeb Sau