English
Related papers

Related papers: Resource-efficient Parallel Split Learning in Hete…

200 papers

Edge AI, which brings artificial intelligence to the edge of the network for real-time processing and decision-making, has emerged as a transformative technology across various applications. However, the deployment of Edge AI systems faces…

Signal Processing · Electrical Eng. & Systems 2025-11-11 Zhiyuan Zhai , Wei Ni , Xin Wang

As privacy protection gains increasing importance, more models are being trained on edge devices and subsequently merged into the central server through Federated Learning (FL). However, current research overlooks the impact of network…

Machine Learning · Computer Science 2025-08-04 Hangyu Li , Hongyue Wu , Guodong Fan , Zhen Zhang , Shizhan Chen , Zhiyong Feng

Modern deep learning models, growing larger and more complex, have demonstrated exceptional generalization and accuracy due to training on huge datasets. This trend is expected to continue. However, the increasing size of these models poses…

Machine Learning · Computer Science 2024-05-24 Anirudh Rajiv Menon , Unnikrishnan Menon , Kailash Ahirwar

To empower precision agriculture through distributed machine learning (DML), split learning (SL) has emerged as a promising paradigm, partitioning deep neural networks (DNNs) between edge devices and servers to reduce computational burdens…

Machine Learning · Computer Science 2025-06-18 Vishesh Kumar Tanwar , Soumik Sarkar , Asheesh K. Singh , Sajal K. Das

The main challenge to deploy deep neural network (DNN) over a mobile edge network is how to split the DNN model so as to match the network architecture as well as all the nodes' computation and communication capacity. This essentially…

Artificial Intelligence · Computer Science 2021-11-17 Yuqing Tian , Zhaoyang Zhang , Zhaohui Yang , Qianqian Yang

Deep learning is a popular machine learning technique and has been applied to many real-world problems. However, training a deep neural network is very time-consuming, especially on big data. It has become difficult for a single machine to…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-04 Xing Zhao , Aijun An , Junfeng Liu , Bao Xin Chen

The increased demand for data privacy and security in machine learning (ML) applications has put impetus on effective edge training on Internet-of-Things (IoT) nodes. Edge training aims to leverage speed, energy efficiency and adaptability…

Hardware Architecture · Computer Science 2025-04-29 Gang Mao , Tousif Rahman , Sidharth Maheshwari , Bob Pattison , Zhuang Shao , Rishad Shafik , Alex Yakovlev

In this work, we introduce SplitNN-driven Vertical Partitioning, a configuration of a distributed deep learning method called SplitNN to facilitate learning from vertically distributed features. SplitNN does not share raw data or model…

Machine Learning · Computer Science 2020-08-11 Iker Ceballos , Vivek Sharma , Eduardo Mugica , Abhishek Singh , Alberto Roman , Praneeth Vepakomma , Ramesh Raskar

Today's intelligent applications can achieve high performance accuracy using machine learning (ML) techniques, such as deep neural networks (DNNs). Traditionally, in a remote DNN inference problem, an edge device transmits raw data to a…

Machine Learning · Computer Science 2021-06-03 Mounssif Krouka , Anis Elgabli , Chaouki Ben Issaid , Mehdi Bennis

Mobile Edge Computing (MEC) has emerged as a promising supporting architecture providing a variety of resources to the network edge, thus acting as an enabler for edge intelligence services empowering massive mobile and Internet of Things…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-20 Xin Tang , Xu Chen , Liekang Zeng , Shuai Yu , Lin Chen

With the rise of artificial intelligence in recent years, Deep Neural Networks (DNNs) have been widely used in many domains. To achieve high performance and energy efficiency, hardware acceleration (especially inference) of DNNs is…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-17 Linghao Song , Jiachen Mao , Youwei Zhuo , Xuehai Qian , Hai Li , Yiran Chen

Resource constraints have restricted several EdgeAI applications to machine learning inference approaches, where models are trained on the cloud and deployed to the edge device. This poses challenges such as bandwidth, latency, and privacy…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Atah Nuh Mih , Hung Cao , Asfia Kawnine , Monica Wachowicz

Computing at the edge is increasingly important since a massive amount of data is generated. This poses challenges in transporting all that data to the remote data centers and cloud, where they can be processed and analyzed. On the other…

Machine Learning · Computer Science 2020-12-09 Christian Makaya , Amalendu Iyer , Jonathan Salfity , Madhu Athreya , M Anthony Lewis

The increasing complexity of neural networks poses significant challenges for democratizing FL on resource?constrained client devices. Parallel split learning (PSL) has emerged as a promising solution by offloading substantial computing…

Machine Learning · Computer Science 2026-03-20 Zheng Lin , Ons Aouedi , Wei Ni , Symeon Chatzinotas , Xianhao Chen

Most parallel neural network training methods assume homogeneous computing resources. For example, synchronous data-parallel SGD suffers from significant synchronization overhead under heterogeneous workloads, often forcing practitioners to…

Machine Learning · Computer Science 2026-02-24 Jihyun Lim , Junhyuk Jo , Chanhyeok Ko , Young Min Go , Jimin Hwa , Sunwoo Lee

Federated edge learning (FEEL) has drawn much attention as a privacy-preserving distributed learning framework for mobile edge networks. In this work, we investigate a novel semi-decentralized FEEL (SD-FEEL) architecture where multiple edge…

Networking and Internet Architecture · Computer Science 2021-12-10 Yuchang Sun , Jiawei Shao , Yuyi Mao , Jun Zhang

Large machine learning models trained on diverse data have recently seen unprecedented success. Federated learning enables training on private data that may otherwise be inaccessible, such as domain-specific datasets decentralized across…

Fueled by advances in distributed deep learning (DDL), recent years have witnessed a rapidly growing demand for resource-intensive distributed/parallel computing to process DDL computing jobs. To resolve network communication bottleneck and…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-03 Menglu Yu , Ye Tian , Bo Ji , Chuan Wu , Hridesh Rajan , Jia Liu

Deep neural networks (DNNs) have been widely used in various video analytic tasks. These tasks demand real-time responses. Due to the limited processing power on mobile devices, a common way to support such real-time analytics is to offload…

Networking and Internet Architecture · Computer Science 2023-05-04 Jian He , Chenxi Yang , Zhaoyuan He , Ghufran Baig , Lili Qiu

In the Internet of Things (IoT) networks, edge learning for data-driven tasks provides intelligent applications and services. As the network size becomes large, different users may generate distinct datasets. Thus, to suit multiple edge…

Information Theory · Computer Science 2023-05-02 Haihui Xie , Minghua Xia , Peiran Wu , Shuai Wang , H. Vincent Poor