English
Related papers

Related papers: Convergence Rate Maximization for Split Learning-b…

200 papers

Fine-tuning pre-trained large language models (LLMs) in a distributed manner poses significant challenges on resource-constrained edge networks. To address this challenge, we propose SflLLM, a novel framework that integrates split federated…

Machine Learning · Computer Science 2025-07-03 Kai Zhao , Zhaohui Yang , Ye Hu , Mingzhe Chen , Chen Zhu , Zhaoyang Zhang

Deep metric learning (DML) aims to learn a discriminative high-dimensional embedding space for downstream tasks like classification, clustering, and retrieval. Prior literature predominantly focuses on pair-based and proxy-based methods to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Xiruo Jiang , Yazhou Yao , Xili Dai , Fumin Shen , Xian-Sheng Hua , Heng-Tao Shen

Federated Split Learning (FSL) is a promising distributed learning paradigm in practice, which gathers the strengths of both Federated Learning (FL) and Split Learning (SL) paradigms, to ensure model privacy while diminishing the resource…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Yifan Shi , Yuhui Zhang , Ziyue Huang , Xiaofeng Yang , Li Shen , Wei Chen , Xueqian Wang

Edge AI has been recently proposed to facilitate the training and deployment of Deep Neural Network (DNN) models in proximity to the sources of data. To enable the training of large models on resource-constraint edge devices and protect…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-26 Mingjin Zhang , Jiannong Cao , Yuvraj Sahni , Xiangchun Chen , Shan Jiang

The increasing complexity of neural networks poses a significant barrier to the deployment of distributed machine learning (ML) on resource-constrained devices, such as federated learning (FL). Split learning (SL) offers a promising…

Machine Learning · Computer Science 2025-08-19 Zehang Lin , Zheng Lin , Miao Yang , Jianhao Huang , Yuxin Zhang , Zihan Fang , Xia Du , Zhe Chen , Shunzhi Zhu , Wei Ni

We systematically evaluate a Deep Learning (DL) method in a 3D medical image segmentation task. Our segmentation method is integrated into the radiosurgery treatment process and directly impacts the clinical workflow. With our method, we…

Image and Video Processing · Electrical Eng. & Systems 2021-08-24 Boris Shirokikh , Alexandra Dalechina , Alexey Shevtsov , Egor Krivov , Valery Kostjuchenko , Amayak Durgaryan , Mikhail Galkin , Andrey Golanov , Mikhail Belyaev

Surface electromyogram (sEMG), as a bioelectrical signal reflecting the activity of human muscles, has a wide range of applications in the control of prosthetics, human-computer interaction and so on. However, the existing recognition…

Signal Processing · Electrical Eng. & Systems 2024-04-19 Xiupeng Qiao , Zekun Chen , Shili Liang

As an edge intelligence algorithm for multi-device collaborative training, federated learning (FL) can reduce the communication burden but increase the computing load of wireless devices. In contrast, split learning (SL) can reduce the…

Machine Learning · Computer Science 2022-09-07 Benshun Yin , Zhiyong Chen , Meixia Tao

in healthcare. However, the existing AI model may be biased in its decision marking. The bias induced by data itself, such as collecting data in subgroups only, can be mitigated by including more diversified data. Distributed and…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-28 Di Fan , Yifan Wu , Xiaoxiao Li

Fine-tuning a large language model (LLM) using the local data of edge users can enable personalized services and applications. For privacy protection, the prevalent solution adopts distributed learning for fine-tuning and integrates…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-24 Songge Zhang , Guoliang Cheng , Zuguang Li , Wen Wu

U-shaped networks are widely used in various medical image tasks, such as segmentation, restoration and reconstruction, but most of them usually rely on centralized learning and thus ignore privacy issues. To address the privacy concerns,…

Image and Video Processing · Electrical Eng. & Systems 2022-12-14 Ziyuan Yang , Yingyu Chen , Huijie Huangfu , Maosong Ran , Hui Wang , Xiaoxiao Li , Yi Zhang

Continual Learning requires a model to learn multiple tasks in sequence while maintaining both stability:preserving knowledge from previously learned tasks, and plasticity:effectively learning new tasks. Gradient projection has emerged as…

Machine Learning · Computer Science 2025-06-12 Haomiao Qiu , Miao Zhang , Ziyue Qiao , Weili Guan , Min Zhang , Liqiang Nie

Current electromyography (EMG) pattern recognition (PR) models have been shown to generalize poorly in unconstrained environments, setting back their adoption in applications such as hand gesture control. This problem is often due to…

Despite the undeniable progress in visual recognition tasks fueled by deep neural networks, there exists recent evidence showing that these models are poorly calibrated, resulting in over-confident predictions. The standard practices of…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Balamurali Murugesan , Bingyuan Liu , Adrian Galdran , Ismail Ben Ayed , Jose Dolz

To alleviate the shortage of computing power faced by clients in training deep neural networks (DNNs) using federated learning (FL), we leverage the edge computing and split learning to propose a model-splitting allowed FL (SFL) framework,…

Machine Learning · Computer Science 2023-07-24 Yao Wen , Guopeng Zhang , Kezhi Wang , Kun Yang

This paper proposes a novel communication-efficient split learning (SL) framework, named SplitFC, which reduces the communication overhead required for transmitting intermediate feature and gradient vectors during the SL training process.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-06 Yongjeong Oh , Jaeho Lee , Christopher G. Brinton , Yo-Seb Jeon

Federated learning (FL) is a useful tool in distributed machine learning that utilizes users' local datasets in a privacy-preserving manner. When deploying FL in a constrained wireless environment; however, training models in a…

Machine Learning · Computer Science 2022-05-06 Jake Perazzone , Shiqiang Wang , Mingyue Ji , Kevin Chan

Federated Learning (FL) has evolved as a promising technique to handle distributed machine learning across edge devices. A single neural network (NN) that optimises a global objective is generally learned in most work in FL, which could be…

Information Theory · Computer Science 2022-03-10 Sawan Singh Mahara , Shruti M. , B. N. Bharath , Akash Murthy

The remarkable performance of large language models (LLMs) in various language tasks has attracted considerable attention. However, the ever-increasing size of these models presents growing challenges for deployment and inference.…

Computation and Language · Computer Science 2025-02-21 Jiayu Qin , Jianchao Tan , Kefeng Zhang , Xunliang Cai , Wei Wang

In this paper, we present our work on developing robot arm prosthetic via deep learning. Our work proposes to use transfer learning techniques applied to the Google Inception model to retrain the final layer for surface electromyography…

Signal Processing · Electrical Eng. & Systems 2020-05-06 David Lonsdale , Li Zhang , Richard Jiang