English
Related papers

Related papers: On reducing the communication cost of the diffusio…

200 papers

Nowadays, with the widespread of smartphones and other portable gadgets equipped with a variety of sensors, data is ubiquitous available and the focus of machine learning has shifted from being able to infer from small training samples to…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-07 Radu Cristian Ionescu

Diffusion Models (DMs) have demonstrated state-of-the-art performance in content generation without requiring adversarial training. These models are trained using a two-step process. First, a forward - diffusion - process gradually adds…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Anwaar Ulhaq , Naveed Akhtar

In multiple domains, statistical tasks are performed in distributed settings, with data split among several end machines that are connected to a fusion center. In various applications, the end machines have limited bandwidth and power, and…

Machine Learning · Computer Science 2026-01-05 Rodney Fonseca , Boaz Nadler

This article proposes diffusion LMS strategies for distributed estimation over adaptive networks that are able to exploit sparsity in the underlying system model. The approach relies on convex regularization, common in compressive sensing,…

Machine Learning · Computer Science 2015-06-05 Paolo Di Lorenzo , Ali H. Sayed

Learning sparse combinations is a frequent theme in machine learning. In this paper, we study its associated optimization problem in the distributed setting where the elements to be combined are not centrally located but spread over a…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-25 Aurélien Bellet , Yingyu Liang , Alireza Bagheri Garakani , Maria-Florina Balcan , Fei Sha

We propose a diffusion least mean p-power (LMP) algorithm for distributed estimation in alpha stable noise environments, which is one of the widely used models that appears in various environments. Compared with the diffusion least mean…

Information Theory · Computer Science 2013-10-22 Fuxi Wen

This paper focuses on decentralized composite optimization over networks without a central coordinator. We propose a novel decentralized symmetric ADMM algorithm that incorporates multiple communication rounds within each iteration, derived…

Optimization and Control · Mathematics 2026-03-06 Jinrui Huang , Xueqin Wang , Dong Liu , Jingguo Lan , Runxiong Wu

This paper proposes distributed adaptive algorithms based on the conjugate gradient (CG) method and the diffusion strategy for parameter estimation over sensor networks. We present sparsity-aware conventional and modified distributed CG…

Information Theory · Computer Science 2015-11-23 Rodrigo C. de Lamare

We introduce novel diffusion based adaptive estimation strategies for distributed networks that have significantly less communication load and achieve comparable performance to the full information exchange configurations. After local…

Systems and Control · Computer Science 2014-02-06 Muhammed O. Sayin , Suleyman S. Kozat

Distributed storage infrastructures require the use of data redundancy to achieve high data reliability. Unfortunately, the use of redundancy introduces storage and communication overheads, which can either reduce the overall storage…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-03-19 Lluis Pamies-Juarez , Ernst Biersack

The increasing popularity of cloud computing has resulted in a proliferation of data centers. Effective placement of data centers improves network performance and minimizes clients' perceived latency. The problem of determining the optimal…

Networking and Internet Architecture · Computer Science 2018-02-06 Wuqiong Luo , Wee Peng Tay , Peng Sun , Yonggang Wen

Distributed signal processing has attracted widespread attention in the scientific community due to its several advantages over centralized approaches. Recently, graph signal processing has risen to prominence, and adaptive distributed…

Signal Processing · Electrical Eng. & Systems 2020-08-07 Daniel G. Tiglea , Renato Candido , Magno T. M. Silva

This paper considers the problem of detecting impaired and noisy nodes over network. In a distributed algorithm, lots of processing units are incorporating and communicating with each other to reach a global goal. Due to each one's state in…

Multiagent Systems · Computer Science 2019-10-23 Mahdi Shamsi , Alireza Moslemi Haghighi , Farokh Marvasti

Organization, scalability and routing have been identified as key problems hindering viability and commercial success of mobile ad hoc networks. Clustering of mobile nodes among separate domains has been proposed as an efficient approach to…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-09-20 Damianos Gavalas , Grammati Pantziou , Charalampos Konstantopoulos , Basilis Mamalis

This invited paper presents some novel ideas on how to enhance the performance of consensus algorithms in distributed wireless sensor networks, when communication costs are considered. Of particular interest are consensus algorithms that…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-09-04 Steffen Limmer , Slawomir Stanczak , Mario Goldenbaum , Renato L. G. Cavalcante

Machine learning (ML) is a promising enabler for the fifth generation (5G) communication systems and beyond. By imbuing intelligence into the network edge, edge nodes can proactively carry out decision-making, and thereby react to local…

Machine Learning · Computer Science 2020-08-07 Jihong Park , Sumudu Samarakoon , Anis Elgabli , Joongheon Kim , Mehdi Bennis , Seong-Lyun Kim , Mérouane Debbah

In diffusion-based molecular communication, information is transferred from a transmitter to a receiver using molecular carriers. The low achievable data rate is the main disadvantage of diffusion-based molecular over radio-based…

Emerging Technologies · Computer Science 2018-09-18 Tayyebeh Jahani-Nezhad , Foroogh S. Tabataba

Federated optimization, wherein several agents in a network collaborate with a central server to achieve optimal social cost over the network with no requirement for exchanging information among agents, has attracted significant interest…

Multiagent Systems · Computer Science 2023-10-23 Syed Eqbal Alam , Dhirendra Shukla , Shrisha Rao

The task management is a critical component for the computational grids. The aim is to assign tasks on nodes according to a global scheduling policy and a view of local resources of nodes. A peer-to-peer approach for the task management…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-12-04 Alain Bui , Olivier Flauzac , Cyril Rabat

In this work, we are interested in adaptive and distributed estimation of graph filters from streaming data. We formulate this problem as a consensus estimation problem over graphs, which can be addressed with diffusion LMS strategies. Most…

Signal Processing · Electrical Eng. & Systems 2019-12-13 Fei Hua , Roula Nassif , Cédric Richard , Haiyan Wang , Ali H. Sayed