English
Related papers

Related papers: DISTREAL: Distributed Resource-Aware Learning in H…

200 papers

Deep neural networks (DNNs) are state-of-the-art solutions for many machine learning applications, and have been widely used on mobile devices. Running DNNs on resource-constrained mobile devices often requires the help from edge servers…

Networking and Internet Architecture · Computer Science 2019-03-11 Wenqi Shi , Yunzhong Hou , Sheng Zhou , Zhisheng Niu , Yang Zhang , Lu Geng

Federated learning (FL) is a useful tool in distributed machine learning that utilizes users' local datasets in a privacy-preserving manner. When deploying FL in a constrained wireless environment; however, training models in a…

Machine Learning · Computer Science 2022-05-06 Jake Perazzone , Shiqiang Wang , Mingyue Ji , Kevin Chan

Federated edge learning (FEEL) is envisioned as a promising paradigm to achieve privacy-preserving distributed learning. However, it consumes excessive learning time due to the existence of straggler devices. In this paper, a novel…

Information Theory · Computer Science 2022-04-04 Shanfeng Huang , Zezhong Zhang , Shuai Wang , Rui Wang , Kaibin Huang

Human activity recognition (HAR) is a time series classification task that focuses on identifying the motion patterns from human sensor readings. Adequate data is essential but a major bottleneck for training a generalizable HAR model,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Xin Qin , Jindong Wang , Shuo Ma , Wang Lu , Yongchun Zhu , Xing Xie , Yiqiang Chen

Federated learning has gained popularity as a means of training models distributed across the wireless edge. The paper introduces delay-aware hierarchical federated learning (DFL) to improve the efficiency of distributed machine learning…

Machine Learning · Computer Science 2023-09-29 Frank Po-Chen Lin , Seyyedali Hosseinalipour , Nicolò Michelusi , Christopher Brinton

In neural network surrogate solvers for electromagnetic simulations, accurately modeling resonant phenomena remains a central challenge. High-amplitude resonances generate strongly localized field patterns that deviate significantly from…

Optics · Physics 2026-05-19 Sunghyun Nam , Chan Y. Park , Min Seok Jang

Many machine learning algorithms have been developed under the assumption that data sets are already available in batch form. Yet in many application domains data is only available sequentially overtime via compute nodes in different…

Optimization and Control · Mathematics 2020-09-10 Alfredo Garcia , Luochao Wang , Jeff Huang , Lingzhou Hong

In the resource-constrained IoT-edge computing environment, Split Federated (SplitFed) learning is implemented to enhance training efficiency. This method involves each terminal device dividing its full DNN model at a designated layer into…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-23 Binbin Huang , Hailiang Zhao , Lingbin Wang , Wenzhuo Qian , Yuyu Yin , Shuiguang Deng

Heterogeneity across devices in federated learning (FL) typically refers to statistical (e.g., non-i.i.d. data distributions) and resource (e.g., communication bandwidth) dimensions. In this paper, we focus on another important dimension…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-10 Su Wang , Seyyedali Hosseinalipour , Christopher G. Brinton

Scaling deep neural network (DNN) training to more devices can reduce time-to-solution. However, it is impractical for users with limited computing resources. FOSI, as a hybrid order optimizer, converges faster than conventional optimizers…

Machine Learning · Computer Science 2025-08-05 Shunxian Gu , Chaoqun You , Bangbang Ren , Lailong Luo , Junxu Xia , Deke Guo

The training of deep and/or convolutional neural networks (DNNs/CNNs) is traditionally done on servers with powerful CPUs and GPUs. Recent efforts have emerged to localize machine learning tasks fully on the edge. This brings advantages in…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-17 Pranav Rama , Madison Threadgill , Andreas Gerstlauer

Next Generation (NextG) networks are expected to support demanding tactile internet applications such as augmented reality and connected autonomous vehicles. Whereas recent innovations bring the promise of larger link capacity, their…

Machine Learning · Computer Science 2021-12-08 Peyman Tehrani , Francesco Restuccia , Marco Levorato

Mobile devices contribute more than half of the world's web traffic, providing massive and diverse data for powering various federated learning (FL) applications. In order to avoid the communication bottleneck on the parameter server (PS)…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-03 Yunming Liao , Yang Xu , Hongli Xu , Zhiwei Yao , Liusheng Huang , Chunming Qiao

Federated learning is a distributed learning paradigm in which multiple mobile clients train a global model while keeping data local. These mobile clients can have various available memory and network bandwidth. However, to achieve the best…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-16 Dixi Yao

Federated learning (FL) enables distributed training while preserving data privacy, but stragglers-slow or incapable clients-can significantly slow down the total training time and degrade performance. To mitigate the impact of stragglers,…

Machine Learning · Computer Science 2024-09-11 Honggu Kang , Seohyeon Cha , Jinwoo Shin , Jongmyeong Lee , Joonhyuk Kang

Deep Neural Networks (DNNs) have significantly improved the accuracy of intelligent applications on mobile devices. DNN surgery, which partitions DNN processing between mobile devices and multi-access edge computing (MEC) servers, can…

Computer Science and Game Theory · Computer Science 2023-06-22 Xiang Yang , Dezhi Chen , Qi Qi , Jingyu Wang , Haifeng Sun , Jianxin Liao , Song Guo

Increasingly complex and diverse deep neural network (DNN) models necessitate distributing the execution across multiple devices for training and inference tasks, and also require carefully planned schedules for performance. However,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-28 Zhiqi Lin , Youshan Miao , Guanbin Xu , Cheng Li , Olli Saarikivi , Saeed Maleki , Fan Yang

Wearable devices are revolutionizing personal technology, but their usability is often hindered by frequent charging due to high power consumption. This paper introduces Distributed Neural Networks (DistNN), a framework that distributes…

Emerging Technologies · Computer Science 2025-09-19 Meghna Roy Chowdhury , Ming-che Li , Archisman Ghosh , Md Faizul Bari , Shreyas Sen

To satisfy the expected plethora of computation-heavy applications, federated edge learning (FEEL) is a new paradigm featuring distributed learning to carry the capacities of low-latency and privacy-preserving. To further improve the…

Systems and Control · Electrical Eng. & Systems 2022-12-02 Jun Du , Bingqing Jiang , Chunxiao Jiang , Yuanming Shi , Zhu Han

Federated Learning (FL), as a privacy-preserving machine learning paradigm, trains a global model across devices without exposing local data. However, resource heterogeneity and inevitable stragglers in wireless networks severely impact the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-20 Youquan Xian , Xiaoyun Gan , Chuanjian Yao , Dongcheng Li , Peng Wang , Peng Liu , Ying Zhao