English
Related papers

Related papers: DynaComm: Accelerating Distributed CNN Training be…

200 papers

Edge computing has become a promising computing paradigm for building IoT (Internet of Things) applications, particularly for applications with specific constraints such as latency or privacy requirements. Due to resource constraints at the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-15 Fei Hu , Kunal Mehta , Shivakant Mishra , Mohammad AlMutawa

In recent years, the development of specialized edge computing devices has significantly increased, driven by the growing demand for AI models. These devices, such as the NVIDIA Jetson series, must efficiently handle increased data…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-03 Ashiyana Abdul Majeed , Mahmoud Meribout

To satisfy the expected plethora of computation-heavy applications, federated edge learning (FEEL) is a new paradigm featuring distributed learning to carry the capacities of low-latency and privacy-preserving. To further improve the…

Systems and Control · Electrical Eng. & Systems 2022-12-02 Jun Du , Bingqing Jiang , Chunxiao Jiang , Yuanming Shi , Zhu Han

Despite the recent success of Graph Neural Networks, it remains challenging to train a GNN on large graphs with millions of nodes and billions of edges, which are prevalent in many graph-based applications. Traditional sampling-based…

Machine Learning · Computer Science 2022-10-04 Zheng Chai , Guangji Bai , Liang Zhao , Yue Cheng

The traditional approach to distributed machine learning is to adapt learning algorithms to the network, e.g., reducing updates to curb overhead. Networks based on intelligent edge, instead, make it possible to follow the opposite approach,…

Networking and Internet Architecture · Computer Science 2022-07-07 Francesco Malandrino , Carla Fabiana Chiasserini , Nuria Molner , Antonio De La Oliva

We consider distributed machine learning at the wireless edge, where a parameter server builds a global model with the help of multiple wireless edge devices that perform computations on local dataset partitions. Edge devices transmit the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-24 Jaeyoung Song , Marios Kountouris

Deep neural networks (DNNs) have been widely used in various video analytic tasks. These tasks demand real-time responses. Due to the limited processing power on mobile devices, a common way to support such real-time analytics is to offload…

Networking and Internet Architecture · Computer Science 2023-05-04 Jian He , Chenxi Yang , Zhaoyuan He , Ghufran Baig , Lili Qiu

Wider coverage and a better solution to a latency reduction in 5G necessitate its combination with multi-access edge computing (MEC) technology. Decentralized deep learning (DDL) such as federated learning and swarm learning as a promising…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-23 Yuwei Sun , Hideya Ochiai , Hiroshi Esaki

As a key technology of enabling Artificial Intelligence (AI) applications in 5G era, Deep Neural Networks (DNNs) have quickly attracted widespread attention. However, it is challenging to run computation-intensive DNN-based tasks on mobile…

Networking and Internet Architecture · Computer Science 2019-10-14 En Li , Liekang Zeng , Zhi Zhou , Xu Chen

Distributed edge learning (DL) is considered a cornerstone of intelligence enablers, since it allows for collaborative training without the necessity for local clients to share raw data with other parties, thereby preserving privacy and…

Systems and Control · Electrical Eng. & Systems 2026-01-15 Paul Zheng , Navid Keshtiarast , Pradyumna Kumar Bishoyi , Yao Zhu , Yulin Hu , Marina Petrova , Anke Schmeink

The emerging edge-cloud collaborative Deep Learning (DL) paradigm aims at improving the performance of practical DL implementations in terms of cloud bandwidth consumption, response latency, and data privacy preservation. Focusing on…

Machine Learning · Computer Science 2020-05-06 Yuanrui Dong , Peng Zhao , Hanqiao Yu , Cong Zhao , Shusen Yang

Unlike theoretical distributed learning (DL), DL over wireless edge networks faces the inherent dynamics/uncertainty of wireless connections and edge nodes, making DL less efficient or even inapplicable under the highly dynamic wireless…

Networking and Internet Architecture · Computer Science 2021-03-10 Nguyen Van Huynh , Dinh Thai Hoang , Diep N. Nguyen , Eryk Dutkiewicz

Federated learning, as a promising distributed learning paradigm, enables collaborative training of a global model across multiple network edge clients without the need for central data collecting. However, the heterogeneity of edge data…

Machine Learning · Computer Science 2024-03-06 Xingyan Chen , Tian Du , Mu Wang , Tiancheng Gu , Yu Zhao , Gang Kou , Changqiao Xu , Dapeng Oliver Wu

Recent developments and emerging use cases, such as smart Internet of Things (IoT) and Edge AI, have sparked considerable interest in the training of neural networks over fully decentralized (serverless) networks. One of the major…

Machine Learning · Computer Science 2025-01-30 Eunjeong Jeong , Marios Kountouris

By integrating edge computing with parallel computing, distributed edge computing (DEC) makes use of distributed devices in edge networks to perform computing in parallel, which can substantially reduce service delays. In this paper, we…

Networking and Internet Architecture · Computer Science 2020-02-10 Xiaowen Gong

In this article, we present a novel framework, named distributed task-oriented communication networks (DTCN), based on recent advances in multimodal semantic transmission and edge intelligence. In DTCN, the multimodal knowledge of semantic…

Signal Processing · Electrical Eng. & Systems 2024-01-22 Jie Guo , Hao Chen , Bin Song , Yuhao Chi , Chau Yuen , Fei Richard Yu , Geoffrey Ye Li , Dusit Niyato

This paper studies a federated edge learning system, in which an edge server coordinates a set of edge devices to train a shared machine learning model based on their locally distributed data samples. During the distributed training, we…

Information Theory · Computer Science 2020-03-03 Xiaopeng Mo , Jie Xu

As artificial intelligence (AI) applications continue to expand in next-generation networks, there is a growing need for deep neural network (DNN) models. Although DNN models deployed at the edge are promising for providing AI as a service…

Networking and Internet Architecture · Computer Science 2024-08-22 Alireza Maleki , Hamed Shah-Mansouri , Babak H. Khalaj

Many real-time applications (e.g., Augmented/Virtual Reality, cognitive assistance) rely on Deep Neural Networks (DNNs) to process inference tasks. Edge computing is considered a key infrastructure to deploy such applications, as moving…

Training at the edge utilizes continuously evolving data generated at different locations. Privacy concerns prohibit the co-location of this spatially as well as temporally distributed data, deeming it crucial to design training algorithms…

Machine Learning · Computer Science 2023-03-28 Sakshi Choudhary , Sai Aparna Aketi , Gobinda Saha , Kaushik Roy