English
Related papers

Related papers: Fine-tuning Multimodal Transformers on Edge: A Par…

200 papers

Many studies integrate federated learning (FL) with self-supervised learning (SSL) to take advantage of raw data distributed across edge devices. However, edge devices often struggle with high computational and communication costs imposed…

Machine Learning · Computer Science 2025-12-02 Ye Lin Tun , Chu Myaet Thwal , Huy Q. Le , Minh N. H. Nguyen , Eui-Nam Huh , Choong Seon Hong

Semi-supervised learning addresses the issue of limited annotations in medical images effectively, but its performance is often inadequate for complex backgrounds and challenging tasks. Multi-modal fusion methods can significantly improve…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Dongdong Meng , Sheng Li , Hao Wu , Guoping Wang , Xueqing Yan

SplitFed Learning (SFL) combines federated learning and split learning to enable collaborative training across distributed edge devices; however, it faces significant challenges in heterogeneous environments with diverse computational and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-27 Abdullah Al Asif , Sixing Yu , Juan Pablo Munoz , Arya Mazaheri , Ali Jannesari

Federated learning (FL) and split learning (SL) are two popular distributed machine learning approaches. Both follow a model-to-data scenario; clients train and test machine learning models without sharing raw data. SL provides better model…

Machine Learning · Computer Science 2022-02-18 Chandra Thapa , M. A. P. Chamikara , Seyit Camtepe , Lichao Sun

Traditionally, distributed machine learning takes the guise of (i) different nodes training the same model (as in federated learning), or (ii) one model being split among multiple nodes (as in distributed stochastic gradient descent). In…

Networking and Internet Architecture · Computer Science 2022-07-07 Francesco Malandrino , Carla Fabiana Chiasserini

Multi-Task Learning (MTL) aims to enhance the model generalization by sharing representations between related tasks for better performance. Typical MTL methods are jointly trained with the complete multitude of ground-truths for all tasks…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Yufeng Wang , Yi-Hsuan Tsai , Wei-Chih Hung , Wenrui Ding , Shuo Liu , Ming-Hsuan Yang

Privacy-preserving machine learning has become a key conundrum for multi-party artificial intelligence. Federated learning (FL) and Split Learning (SL) are two frameworks that enable collaborative learning while keeping the data private (on…

Machine Learning · Computer Science 2022-12-15 Frédéric Berdoz , Abhishek Singh , Martin Jaggi , Ramesh Raskar

Federated Learning (FL), Split Learning (SL), and SplitFed Learning (SFL) are three recent developments in distributed machine learning that are gaining attention due to their ability to preserve the privacy of raw data. Thus, they are…

Machine Learning · Computer Science 2021-09-21 Praveen Joshi , Chandra Thapa , Seyit Camtepe , Mohammed Hasanuzzamana , Ted Scully , Haithem Afli

In this paper, we propose an edge-assisted split federated learning framework to facilitate large language model (LLM) fine-tuning on heterogeneous mobile devices while alleviating memory pressures on both mobile devices and the edge…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-04 Xiaopei Chen , Liang Li , Fei Ji , Wen Wu

In this paper, we propose a novel approach to minimize the inference delay in semantic segmentation using split learning (SL), tailored to the needs of real-time computer vision (CV) applications for resource-constrained devices. Semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Nikos G. Evgenidis , Nikos A. Mitsiou , Sotiris A. Tegos , Panagiotis D. Diamantoulakis , George K. Karagiannidis

Collaborative training methods like Federated Learning (FL) and Split Learning (SL) enable distributed machine learning without sharing raw data. However, FL assumes clients can train entire models, which is infeasible for large-scale…

Machine Learning · Computer Science 2025-06-18 Srijith Nair , Michael Lin , Peizhong Ju , Amirreza Talebi , Elizabeth Serena Bentley , Jia Liu

Federated learning (FL) operates based on model exchanges between the server and the clients, and it suffers from significant client-side computation and communication burden. Split federated learning (SFL) arises a promising solution by…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-23 Yiannis Papageorgiou , Yannis Thomas , Alexios Filippakopoulos , Ramin Khalili , Iordanis Koutsopoulos

Incorporating self-supervised learning (SSL) before standard supervised learning (SL) has become a widely used strategy to enhance model performance, particularly in data-limited scenarios. However, this approach introduces a trade-off…

Machine Learning · Computer Science 2025-03-06 Zexin Li , Jiancheng Zhang , Yufei Li , Yinglun Zhu , Cong Liu

Federated learning (FL) is a promising approach for addressing scalability and latency issues in large-scale networks by enabling collaborative model training without requiring the sharing of raw data. However, existing FL frameworks often…

Machine Learning · Computer Science 2025-08-13 Dung T. Tran , Nguyen B. Ha , Van-Dinh Nguyen , Kok-Seng Wong

Federated learning (FedL) has emerged as a popular technique for distributing model training over a set of wireless devices, via iterative local updates (at devices) and global aggregations (at the server). In this paper, we develop…

Fine-tuning foundation models is critical for superior performance on personalized downstream tasks, compared to using pre-trained models. Collaborative learning can leverage local clients' datasets for fine-tuning, but limited client data…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-15 Tianjun Yuan , Jiaxiang Geng , Pengchao Han , Xianhao Chen , Bing Luo

While fine-tuning pre-trained networks has become a popular way to train image segmentation models, such backbone networks for image segmentation are frequently pre-trained using image classification source datasets, e.g., ImageNet. Though…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Xuhong Li , Haoyi Xiong , Yi Liu , Dingfu Zhou , Zeyu Chen , Yaqing Wang , Dejing Dou

Quantum Machine Learning (QML) is an emerging field of research with potential applications to distributed collaborative learning, such as Split Learning (SL). SL allows resource-constrained clients to collaboratively train ML models with a…

Quantum Physics · Physics 2025-07-08 Hevish Cowlessur , Chandra Thapa , Tansu Alpcan , Seyit Camtepe

Mobile devices and the immense amount and variety of data they generate are key enablers of machine learning (ML)-based applications. Traditional ML techniques have shifted toward new paradigms such as federated (FL) and split learning (SL)…

Machine Learning · Computer Science 2022-07-06 Pranvera Kortoçi , Yilei Liang , Pengyuan Zhou , Lik-Hang Lee , Abbas Mehrabi , Pan Hui , Sasu Tarkoma , Jon Crowcroft

Split computing ($\neq$ split learning) is a promising approach to deep learning models for resource-constrained edge computing systems, where weak sensor (mobile) devices are wirelessly connected to stronger edge servers through channels…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Yoshitomo Matsubara , Matteo Mendula , Marco Levorato