English
Related papers

Related papers: A communication efficient distributed learning fra…

200 papers

Fully decentralized learning is gaining momentum for training AI models at the Internet's edge, addressing infrastructure challenges and privacy concerns. In a decentralized machine learning system, data is distributed across multiple…

Machine Learning · Computer Science 2024-03-01 Luigi Palmieri , Chiara Boldrini , Lorenzo Valerio , Andrea Passarella , Marco Conti

Machine learning (ML) tasks are becoming ubiquitous in today's network applications. Federated learning has emerged recently as a technique for training ML models at the network edge by leveraging processing capabilities across the nodes…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-26 Seyyedali Hosseinalipour , Christopher G. Brinton , Vaneet Aggarwal , Huaiyu Dai , Mung Chiang

Federated Edge Learning (FEL), an emerging distributed Machine Learning (ML) paradigm, enables model training in a distributed environment while ensuring user privacy by using physical separation for each user data. However, with the…

Machine Learning · Computer Science 2024-10-11 Jingbo Zhang , Qiong Wu , Pingyi Fan , Qiang Fan

The rapid expansion of the Internet of Things (IoT) ecosystem has transformed various sectors but has also introduced significant cybersecurity challenges. Traditional centralized security methods often struggle to balance privacy…

Cryptography and Security · Computer Science 2025-02-18 Milad Rahmati

Distributed resource allocation is a central task in network systems such as smart grids, water distribution networks, and urban transportation systems. When solving such problems in practice it is often important to have nonasymptotic…

Optimization and Control · Mathematics 2021-03-30 Xuyang Wu , Sindri Magnusson , Mikael Johansson

Recent progress in scientific machine learning (SciML) has opened up the possibility of training novel neural network architectures that solve complex partial differential equations (PDEs). Several (nearly data free) approaches have been…

Semi-decentralized federated learning blends the conventional device to-server (D2S) interaction structure of federated model training with localized device-to-device (D2D) communications. We study this architecture over practical edge…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-24 Rohit Parasnis , Seyyedali Hosseinalipour , Yun-Wei Chu , Mung Chiang , Christopher G. Brinton

Most existing personalized federated learning approaches are based on intricate designs, which often require complex implementation and tuning. In order to address this limitation, we propose a simple yet effective personalized federated…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-30 Jiaqi Wang , Yuzhong Chen , Yuhang Wu , Mahashweta Das , Hao Yang , Fenglong Ma

Owing to the large volume of sensed data from the enormous number of IoT devices in operation today, centralized machine learning algorithms operating on such data incur an unbearable training time, and thus cannot satisfy the requirements…

Signal Processing · Electrical Eng. & Systems 2020-07-21 Shashank Jere , Qiang Fan , Bodong Shang , Lianjun Li , Lingjia Liu

This work considers the problem of finding analytical expressions for the expected values of dis- tributed computing performance metrics when the underlying communication network has a complex structure. Through active probing tests a real…

Adaptation and Self-Organizing Systems · Physics 2013-11-18 Francisco Prieto-Castrillo , Antonio Astillero , María Botón-Fernández

In the beyond 5G era, AI/ML empowered realworld digital twins (DTs) will enable diverse network operators to collaboratively optimize their networks, ultimately improving end-user experience. Although centralized AI-based learning…

Networking and Internet Architecture · Computer Science 2025-11-05 Saroj Kumar Panda , Tania Panayiotou , Georgios Ellinas , Sadananda Behera

Distributed deep learning (DL) has become prevalent in recent years to reduce training time by leveraging multiple computing devices (e.g., GPUs/TPUs) due to larger models and datasets. However, system scalability is limited by…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-04 Zhenheng Tang , Shaohuai Shi , Wei Wang , Bo Li , Xiaowen Chu

Machine learning algorithms can perform well when trained on large datasets. While large organisations often have considerable data assets, it can be difficult for these assets to be unified in a manner that makes training possible. Data is…

Machine Learning · Computer Science 2022-03-25 Tiffany Tuor , Joshua Lockhart , Daniele Magazzeni

The expansion of AI toward the edge increasingly exposes the cost and fragility of cen- tralised intelligence. Data transmission, latency, energy consumption, and dependence on large data centres create bottlenecks that scale poorly across…

Artificial Intelligence · Computer Science 2026-02-20 Eiman Kanjo , Mustafa Aslanov

The objective of meta-learning is to exploit the knowledge obtained from observed tasks to improve adaptation to unseen tasks. As such, meta-learners are able to generalize better when they are trained with a larger number of observed tasks…

Machine Learning · Computer Science 2022-10-11 Mert Kayaalp , Stefan Vlaski , Ali H. Sayed

We propose an adaptive diffusion mechanism to optimize a global cost function in a distributed manner over a network of nodes. The cost function is assumed to consist of a collection of individual components. Diffusion adaptation allows the…

Optimization and Control · Mathematics 2015-06-03 Jianshu Chen , Ali H. Sayed

We apply diffusion strategies to develop a fully-distributed cooperative reinforcement learning algorithm in which agents in a network communicate only with their immediate neighbors to improve predictions about their environment. The…

Multiagent Systems · Computer Science 2014-11-06 Sergio Valcarcel Macua , Jianshu Chen , Santiago Zazo , Ali H. Sayed

In this paper we propose a new approach for Big Data mining and analysis. This new approach works well on distributed datasets and deals with data clustering task of the analysis. The approach consists of two main phases, the first phase…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-05 Malika Bendechache , Nhien-An Le-Khac , M-Tahar Kechadi

Resource-constrained IoT devices, such as sensors and actuators, have become ubiquitous in recent years. This has led to the generation of large quantities of data in real-time, which is an appealing target for AI systems. However,…

Machine Learning · Computer Science 2021-10-07 M. G. Sarwar Murshed , Christopher Murphy , Daqing Hou , Nazar Khan , Ganesh Ananthanarayanan , Faraz Hussain

Emerging cross-device artificial intelligence (AI) applications require a transition from conventional centralized learning systems towards large-scale distributed AI systems that can collaboratively perform complex learning tasks. In this…

Machine Learning · Computer Science 2022-04-29 Minh N. H. Nguyen , Shashi Raj Pandey , Tri Nguyen Dang , Eui-Nam Huh , Nguyen H. Tran , Walid Saad , Choong Seon Hong