English
Related papers

Related papers: Snake Learning: A Communication- and Computation-E…

200 papers

Federated learning (FL) enables distributed training while preserving data privacy, but stragglers-slow or incapable clients-can significantly slow down the total training time and degrade performance. To mitigate the impact of stragglers,…

Machine Learning · Computer Science 2024-09-11 Honggu Kang , Seohyeon Cha , Jinwoo Shin , Jongmyeong Lee , Joonhyuk Kang

We propose a distributed approach to train deep neural networks (DNNs), which has guaranteed convergence theoretically and great scalability empirically: close to 6 times faster on instance of ImageNet data set when run with 6 machines. The…

Machine Learning · Statistics 2016-10-04 Abhimanu Kumar , Pengtao Xie , Junming Yin , Eric P. Xing

The ubiquitous use of IoT and machine learning applications is creating large amounts of data that require accurate and real-time processing. Although edge-based smart data processing can be enabled by deploying pretrained models, the…

Machine Learning · Computer Science 2021-09-15 Yinghan Long , Indranil Chakraborty , Gopalakrishnan Srinivasan , Kaushik Roy

Federated learning involves training statistical models over remote devices or siloed data centers, such as mobile phones or hospitals, while keeping data localized. Training in heterogeneous and potentially massive networks introduces…

Machine Learning · Computer Science 2020-06-24 Tian Li , Anit Kumar Sahu , Ameet Talwalkar , Virginia Smith

Classical and centralized Artificial Intelligence (AI) methods require moving data from producers (sensors, machines) to energy hungry data centers, raising environmental concerns due to computational and communication resource demands,…

Machine Learning · Computer Science 2022-06-30 Stefano Savazzi , Vittorio Rampa , Sanaz Kianoush , Mehdi Bennis

Neuromorphic data carries information in spatio-temporal patterns encoded by spikes. Accordingly, a central problem in neuromorphic computing is training spiking neural networks (SNNs) to reproduce spatio-temporal spiking patterns in…

Machine Learning · Computer Science 2021-11-03 Bleema Rosenfeld , Osvaldo Simeone , Bipin Rajendran

The design of satellite missions is currently undergoing a paradigm shift from the historical approach of individualised monolithic satellites towards distributed mission configurations, consisting of multiple small satellites. With a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-14 Maria Hartmann , Grégoire Danoy , Pascal Bouvry

The diversity and quantity of data warehouses, gathering data from distributed devices such as mobile devices, can enhance the success and robustness of machine learning algorithms. Federated learning enables distributed participants to…

Machine Learning · Computer Science 2022-03-10 Shuo Wang , Surya Nepal , Kristen Moore , Marthie Grobler , Carsten Rudolph , Alsharif Abuadbba

Traditional machine learning is centralized in the cloud (data centers). Recently, the security concern and the availability of abundant data and computation resources in wireless networks are pushing the deployment of learning algorithms…

Information Theory · Computer Science 2021-01-06 Zhaohui Yang , Mingzhe Chen , Kai-Kit Wong , H. Vincent Poor , Shuguang Cui

Spiking Neural Networks (SNNs) are biologically inspired alternatives to conventional Artificial Neural Networks (ANNs). Despite promising preliminary results, the trade-offs in the training of SNNs in a distributed scheme are not well…

Machine Learning · Computer Science 2023-03-03 Soumi Chaki , David Weinberg , Ayca Özcelikkale

Semantic communication is emerging as a key enabler for distributed edge intelligence due to its capability to convey task-relevant meaning. However, achieving communication-efficient training and robust inference over wireless links…

Machine Learning · Computer Science 2026-01-22 Hang Zhao , Hongru Li , Dongfang Xu , Shenghui Song , Khaled B. Letaief

Traditionally, distributed machine learning takes the guise of (i) different nodes training the same model (as in federated learning), or (ii) one model being split among multiple nodes (as in distributed stochastic gradient descent). In…

Networking and Internet Architecture · Computer Science 2022-07-07 Francesco Malandrino , Carla Fabiana Chiasserini

Quantum federated learning (QFL) is emerging as a key enabler for intelligent, secure, and privacy-preserving model training in next-generation 6G networks. By leveraging the computational advantages of quantum devices, QFL offers…

Cryptography and Security · Computer Science 2025-12-12 Dinh C. Nguyen , Md Bokhtiar Al Zami , Ratun Rahman , Shaba Shaon , Tuy Tan Nguyen , Fatemeh Afghah

Federated Learning is a machine learning setting where the goal is to train a high-quality centralized model while training data remains distributed over a large number of clients each with unreliable and relatively slow network…

Machine Learning · Computer Science 2017-11-01 Jakub Konečný , H. Brendan McMahan , Felix X. Yu , Peter Richtárik , Ananda Theertha Suresh , Dave Bacon

Deep Learning (DL) model-based AI services are increasingly offered in a variety of predictive analytics services such as computer vision, natural language processing, speech recognition. However, the quality of the DL models can degrade…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-04 Anirban Bhattacharjee , Ajay Dev Chhokra , Hongyang Sun , Shashank Shekhar , Aniruddha Gokhale , Gabor Karsai , Abhishek Dubey

Reinforcement learning has become a powerful paradigm for improving the capability of intelligent systems, but its practical deployment faces two central challenges. First, reinforcement learning must scale efficiently in distributed…

Machine Learning · Computer Science 2026-05-12 Guangchen Lan

The 6G mobile network is the next evolutionary step after 5G, with a prediction of an explosive surge in mobile traffic. It provides ultra-low latency, higher data rates, high device density, and ubiquitous coverage, positively impacting…

Networking and Internet Architecture · Computer Science 2025-05-20 Rodrigo Moreira , Tereza C. M. Carvalho , Flávio de Oliveira Silva , Nazim Agoulmine , Joberto S. B. Martins

With deployment of 6G technology, it is envisioned that competitive edge of wireless networks will be sustained and next decade's communication requirements will be stratified. Also 6G will aim to aid development of a human society which is…

Networking and Internet Architecture · Computer Science 2023-09-08 Sridhar Iyer , Rajashri Khanai , Dattaprasad Torse , Rahul Jashvantbhai Pandya , Khaled Rabie , Krishna Pai , Wali Ullah Khan , Zubair Fadlullah

Training deep networks is expensive and time-consuming with the training period increasing with data size and growth in model parameters. In this paper, we provide a framework for distributed training of deep networks over a cluster of CPUs…

Machine Learning · Statistics 2017-08-22 Disha Shrivastava , Santanu Chaudhury , Dr. Jayadeva

Facing the trend of merging wireless communications and multi-access edge computing (MEC), this article studies computation offloading in the beyond fifth-generation networks. To address the technical challenges originating from the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-17 Xianfu Chen , Celimuge Wu , Zhi Liu , Ning Zhang , Yusheng Ji