English
Related papers

Related papers: Communication-Efficient (Weighted) Reservoir Sampl…

200 papers

Distributed diffusion is a powerful algorithm for multi-task state estimation which enables networked agents to interact with neighbors to process input data and diffuse information across the network. Compared to a centralized approach,…

Multiagent Systems · Computer Science 2020-03-27 Jiani Li , Xenofon Koutsoukos

Data stream processing is an increasingly important topic due to the prevalence of smart devices and the demand for real-time analytics. Geo-distributed streaming systems, where cloud-based queries utilize data streams from multiple…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-22 Joel Wolfrath , Abhishek Chandra

Substreams refer to the streams of each user in a system. Substream weighting, where the weights determine the prioritization order, can be important in multiple-input multiple-output interference channels. In this letter, a distributed…

Information Theory · Computer Science 2016-11-18 Cenk M. Yetis , Yong Zeng , Kushal Anand , Yong Liang Guan , Erry Gunawan

One main challenge in federated learning is the large communication cost of exchanging weight updates from clients to the server at each round. While prior work has made great progress in compressing the weight updates through gradient…

Machine Learning · Computer Science 2023-02-10 Berivan Isik , Francesco Pase , Deniz Gunduz , Tsachy Weissman , Michele Zorzi

In distributed systems, communication is a major concern due to issues such as its vulnerability or efficiency. In this paper, we are interested in estimating sparse inverse covariance matrices when samples are distributed into different…

Methodology · Statistics 2016-10-04 Jesús Arroyo , Elizabeth Hou

We study network response to queries that require computation of remotely located data and seek to characterize the performance limits in terms of maximum sustainable query rate that can be satisfied. The available resources include (i) a…

Networking and Internet Architecture · Computer Science 2016-11-17 Apostolos Destounis , Georgios S. Paschos , Iordanis Koutsopoulos

Data stream algorithms tackle operations on high-volume sequences of read-once data items. Data stream scenarios include inherently real-time systems like sensor networks and financial markets. They also arise in purely-computational…

Data Structures and Algorithms · Computer Science 2024-03-04 Matthew Andres Moreno , Santiago Rodriguez Papa , Emily Dolson

A distributed data collection algorithm to accurately store and forward information obtained by wireless sensor networks is proposed. The proposed algorithm does not depend on the sensor network topology, routing tables, or geographic…

Networking and Internet Architecture · Computer Science 2010-11-15 Salah A. Aly , Ahmed Ali-Eldin , H. Vincent Poor

There is a growing interest in development of in-network dispersed computing paradigms that leverage the computing capabilities of heterogeneous resources dispersed across the network for processing massive amount of data is collected at…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-28 Chien-Sheng Yang , Ramtin Pedarsani , A. Salman Avestimehr

This is paper introduces a new single-pass reservoir weighted-sampling stream aggregation algorithm, Priority-Based Aggregation (PBA). While order sampling is a powerful and e cient method for weighted sampling from a stream of uniquely…

Data Structures and Algorithms · Computer Science 2017-11-02 Nick Duffield , Yunhong Xu , Liangzhen Xia , Nesreen Ahmed , Minlan Yu

In distributed wireless networks, nodes often do not know the topology (network size, connectivity and the channel gains) of the network. Thus, they have to compute their transmission and reception parameters in a distributed fashion. In…

Information Theory · Computer Science 2009-10-21 Vaneet Aggarwal , Salman Avestimehr , Ashutosh Sabharwal

Vertical distributed learning exploits the local features collected by multiple learning workers to form a better global model. However, the exchange of data between the workers and the model aggregator for parameter training incurs a heavy…

Networking and Internet Architecture · Computer Science 2022-09-07 Idan Achituve , Wenbo Wang , Ethan Fetaya , Amir Leshem

This paper presents a novel approach to enhance communication efficiency in federated learning through clipped uniform quantization. By leveraging optimal clipping thresholds and client-specific adaptive quantization schemes, the proposed…

Machine Learning · Computer Science 2024-12-17 Zavareh Bozorgasl , Hao Chen

Resource allocation is a fundamental problem in Industrial Internet of Things (IIoT) systems, in which devices work together under limited communication bandwidth to complete diverse tasks. This paper proposes a communication-efficient…

Optimization and Control · Mathematics 2026-05-26 Yuzhu Duan , Ziwen Yang , Xiaoming Duan , Shanying Zhu

The overall performance of a distributed system is highly dependent on the communication efficiency of the system. Although network resources (links, bandwidth) are becoming increasingly more available, the communication performance of data…

Data Structures and Algorithms · Computer Science 2009-06-02 Mugurel Ionut Andreica , Eliana-Dina Tirsa , Nicolae Tapus , Florin Pop , Ciprian Mihai Dobre

Distributed signal processing has attracted widespread attention in the scientific community due to its several advantages over centralized approaches. Recently, graph signal processing has risen to prominence, and adaptive distributed…

Signal Processing · Electrical Eng. & Systems 2020-08-07 Daniel G. Tiglea , Renato Candido , Magno T. M. Silva

In this paper, we propose a sampling mechanism for adaptive diffusion networks that adaptively changes the amount of sampled nodes based on mean-squared error in the neighborhood of each node. It presents fast convergence during transient…

Signal Processing · Electrical Eng. & Systems 2020-07-16 Daniel Gilio Tiglea , Renato Candido , Magno T. M. Silva

In modern data science, it is common that large-scale data are stored and processed parallelly across a great number of locations. For reasons including confidentiality concerns, only limited data information from each parallel center is…

Methodology · Statistics 2022-07-14 Ziyan Yin

This work considers distributed sensing and transmission of sporadic random samples. Lower bounds are derived for the reconstruction error of a single normally or uniformly-distributed finite-dimensional vector imperfectly measured by a…

Information Theory · Computer Science 2015-11-20 Ayşe Ünsal , Raymond Knopp

Distributed learning has become a critical enabler of the massively connected world envisioned by many. This article discusses four key elements of scalable distributed processing and real-time intelligence --- problems, data, communication…

Machine Learning · Computer Science 2020-06-24 Tsung-Hui Chang , Mingyi Hong , Hoi-To Wai , Xinwei Zhang , Songtao Lu