English
Related papers

Related papers: A New Perspective on Randomized Gossip Algorithms

200 papers

We consider a fully distributed constrained convex optimization problem over a multi-agent (no central coordinator) network. We propose an asynchronous gossip-based random projection (GRP) algorithm that solves the distributed problem using…

Optimization and Control · Mathematics 2013-04-08 Soomin Lee , Angelia Nedich

The block Kaczmarz method and its variants are designed for solving the over-determined linear system. They involve iteratively projecting the current point onto the solution space of a subset of constraints. In this work, by alternately…

Numerical Analysis · Mathematics 2023-11-02 Nian-Ci Wu , Yang Zhou , Zhaolu Tian

Consider a connected network of agents endowed with local cost functions representing private objectives. Agents seek to find an agreement on some minimizer of the aggregate cost, by means of repeated communications between neighbors.…

Optimization and Control · Mathematics 2013-09-30 Walid Ben-Ameur , Pascal Bianchi , Jérémie Jakubowicz

In the IoT era, information is more and more frequently picked up by connected smart sensors with increasing, though limited, storage, communication and computation abilities. Whether due to privacy constraints or to the structure of the…

Machine Learning · Computer Science 2026-03-26 Igor Colin , Aurélien Bellet , Stephan Clémençon , Joseph Salmon

The Kaczmarz algorithm is one of the most popular methods for solving large-scale over-determined linear systems due to its simplicity and computational efficiency. This method can be viewed as a special instance of a more general class of…

Probability · Mathematics 2020-01-23 Deanna Needell , Elizaveta Rebrova

We study a version of the randomized Kaczmarz algorithm for solving systems of linear equations where the iterates are confined to the solution space of a selected subsystem. We show that the subspace constraint leads to an accelerated…

Numerical Analysis · Mathematics 2024-06-11 Jackie Lok , Elizaveta Rebrova

We revisit the problem of inferring the overall ranking among entities in the framework of Bradley-Terry-Luce (BTL) model, based on available empirical data on pairwise preferences. By a simple transformation, we can cast the problem as…

Machine Learning · Computer Science 2016-05-10 Vivek S. Borkar , Nikhil Karamchandani , Sharad Mirani

The randomized rumor spreading problem generates a big interest in the area of distributed algorithms due to its simplicity, robustness and wide range of applications. The two most popular communication paradigms used for spreading the…

Social and Information Networks · Computer Science 2019-01-01 Dariusz R. Kowalski , Christopher Thraves Caro

The random reshuffling Kaczmarz (RRK) method enjoys the simplicity and efficiency in solving linear systems as a Kaczmarz-type method, whereas it also inherits the practical improvements of the stochastic gradient descent (SGD) with random…

Numerical Analysis · Mathematics 2025-08-08 Deren Han , Jiaxin Xie

Peer to peer (P2P) systems are moving from application specific architectures to a generic service oriented design philosophy. This raises interesting problems in connection with providing useful P2P middleware services capable of dealing…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-12-27 Antonio Fernandez , Vincent Gramoli , Ernesto Jimenez , Anne-Marie Kermarrec , Michel Raynal

The randomized Kaczmarz method is an iterative algorithm that solves overdetermined systems of linear equations. Recently, the method was extended to systems of equalities and inequalities by Leventhal and Lewis. Even more recently, Needell…

Numerical Analysis · Mathematics 2014-09-04 Jonathan Briskman , Deanna Needell

In the context of sensor networks, gossip algorithms are a popular, well esthablished technique for achieving consensus when sensor data is encoded in linear spaces. Gossip algorithms also have several extensions to non linear data spaces.…

Optimization and Control · Mathematics 2014-05-19 Anass Bellachehab , Jérémie Jakubowicz

Gossip algorithms are attractive for in-network processing in sensor networks because they do not require any specialized routing, there is no bottleneck or single point of failure, and they are robust to unreliable wireless network…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Alexandros G. Dimakis , Soummya Kar , Jose M. F. Moura , Michael G. Rabbat , Anna Scaglione

The randomized Kaczmarz (RK) method is a well-known approach for solving linear least-squares problems with a large number of rows. RK accesses and processes just one row at a time, leading to exponentially fast convergence for consistent…

Numerical Analysis · Mathematics 2025-04-11 Ethan N. Epperly , Gil Goldshlager , Robert J. Webber

Reputation aggregation in peer to peer networks is generally a very time and resource consuming process. Moreover, most of the methods consider that a node will have same reputation with all the nodes in the network, which is not true. This…

Networking and Internet Architecture · Computer Science 2019-08-23 Ruchir Gupta , Y. N. Singh

When solving linear systems $Ax=b$, $A$ and $b$ are given, but the measurements $b$ often contain corruptions. Inspired by recent work on the quantile-randomized Kaczmarz method, we propose an acceleration of the randomized Kaczmarz method…

Numerical Analysis · Mathematics 2024-10-18 Emeric Battaglia , Anna Ma

Gossip algorithms for aggregation have recently received significant attention for sensor network applications because of their simplicity and robustness in noisy and uncertain environments. However, gossip algorithms can waste significant…

Information Theory · Computer Science 2007-07-13 Alexandros G. Dimakis , Anand D. Sarwate , Martin J. Wainwright

In recent times, a considerable amount of work has been devoted to the development and analysis of gossip algorithms in Geometric Random Graphs. In a recently introduced model termed "Geographic Gossip," each node is aware of its position…

Multiagent Systems · Computer Science 2007-07-16 Hariharan Narayanan

In the first part of the paper, we have studied the computational privacy risks in distributed computing protocols against local or global dynamics eavesdroppers, and proposed a Privacy-Preserving-Summation-Consistent (PPSC) mechanism as a…

Systems and Control · Computer Science 2019-02-20 Yang Liu , Junfeng Wu , Ian Manchester , Guodong Shi

The Randomized Kaczmarz method (RK) is a stochastic iterative method for solving linear systems that has recently grown in popularity due to its speed and low memory requirement. Selectable Set Randomized Kaczmarz (SSRK) is an variant of RK…

Numerical Analysis · Mathematics 2022-02-04 Yotam Yaniv , Jacob D. Moorman , William Swartworth , Thomas Tu , Daji Landis , Deanna Needell