English
Related papers

Related papers: Visual Transformer Meets CutMix for Improved Accur…

200 papers

Privacy-Preserving machine learning (PPML) can help us train and deploy models that utilize private information. In particular, on-device machine learning allows us to avoid sharing raw data with a third-party server during inference.…

Machine Learning · Computer Science 2024-01-23 Xinchi Qiu , Ilias Leontiadis , Luca Melis , Alex Sablayrolles , Pierre Stock

The recent success of deep learning applications has coincided with those widely available powerful computational resources for training sophisticated machine learning models with huge datasets. Nonetheless, training large models such as…

Machine Learning · Computer Science 2022-01-03 Farley Lai , Asim Kadav , Erik Kruus

Quantum Machine Learning (QML) is an emerging field of research with potential applications to distributed collaborative learning, such as Split Learning (SL). SL allows resource-constrained clients to collaboratively train ML models with a…

Quantum Physics · Physics 2025-07-08 Hevish Cowlessur , Chandra Thapa , Tansu Alpcan , Seyit Camtepe

With the advancement of Large Language Models (LLMs), LLM applications have expanded into a growing number of fields. However, users with data privacy concerns face limitations in directly utilizing LLM APIs, while private deployments incur…

Cryptography and Security · Computer Science 2025-08-06 Zixuan Gu , Qiufeng Fan , Long Sun , Yang Liu , Xiaojun Ye

The popularity of Deep Learning (DL) makes the privacy of sensitive data more imperative than ever. As a result, various privacy-preserving techniques have been implemented to preserve user data privacy in DL. Among various…

Cryptography and Security · Computer Science 2023-08-31 Khoa Nguyen , Tanveer Khan , Antonis Michalas

The expanding scale of neural networks poses a major challenge for distributed machine learning, particularly under limited communication resources. While split learning (SL) alleviates client computational burden by distributing model…

Networking and Internet Architecture · Computer Science 2026-02-04 Zhen Fang , Miao Yang , Zehang Lin , Zheng Lin , Zihan Fang , Zongyuan Zhang , Tianyang Duan , Dong Huang , Shunzhi Zhu

The ever-growing concerns regarding data privacy have led to a paradigm shift in machine learning (ML) architectures from centralized to distributed approaches, giving rise to federated learning (FL) and split learning (SL) as the two…

Machine Learning · Computer Science 2023-11-07 Zhipeng Cheng , Xuwei Fan , Minghui Liwang , Ning Chen , Xiaoyu Xia , Xianbin Wang

Federated learning (FL) provides a distributed learning framework for multiple participants to collaborate learning without sharing raw data. In many practical FL scenarios, participants have heterogeneous resources due to disparities in…

Machine Learning · Computer Science 2022-03-21 Junyuan Hong , Haotao Wang , Zhangyang Wang , Jiayu Zhou

We present SplitMixer, a simple and lightweight isotropic MLP-like architecture, for visual recognition. It contains two types of interleaving convolutional operations to mix information across spatial locations (spatial mixing) and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Ali Borji , Sikun Lin

Split Federated Learning (SplitFed) combines federated and split learning to preserve privacy while reducing client-side computation. However, in medical image segmentation, heterogeneous label quality across clients can significantly…

Image and Video Processing · Electrical Eng. & Systems 2026-05-13 Zahra Hafezi Kafshgari , Hadi Hadizadeh , Parvaneh Saeedi

Split learning (SL) aims to protect user data privacy by distributing deep models between client-server and keeping private data locally. In SL training with multiple clients, the local model weights are shared among the clients for local…

Cryptography and Security · Computer Science 2024-07-23 Ngoc Duy Pham , Tran Khoa Phan , Alsharif Abuadbba , Yansong Gao , Doan Nguyen , Naveen Chilamkurti

Recent studies on semantic communication commonly rely on neural network (NN) based transceivers such as deep joint source and channel coding (DeepJSCC). Unlike traditional transceivers, these neural transceivers are trainable using actual…

Machine Learning · Computer Science 2023-10-17 Jinhyuk Choi , Jihong Park , Seung-Woo Ko , Jinho Choi , Mehdi Bennis , Seong-Lyun Kim

Vision Transformers (ViTs) excel in 3D medical segmentation but require massive annotated datasets. While Self-Supervised Learning (SSL) mitigates this using unlabeled data, it still faces strict privacy and logistical barriers.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jiaqi Tang , Mengyan Zheng , Shu Zhang , Fandong Zhang , Qingchao Chen

Federated learning (FL) and split learning (SL) are state-of-the-art distributed machine learning techniques to enable machine learning training without accessing raw data on clients or end devices. However, their \emph{comparative training…

Machine Learning · Computer Science 2021-03-05 Yansong Gao , Minki Kim , Chandra Thapa , Sharif Abuadbba , Zhi Zhang , Seyit A. Camtepe , Hyoungshick Kim , Surya Nepal

In recent years, the exponential increase in the demand of wireless data transmission rises the urgency for accurate spectrum sensing approaches to improve spectrum efficiency. The unreliability of conventional spectrum sensing methods by…

Information Theory · Computer Science 2022-08-09 Zezhong Zhang , Guangxu Zhu , Shuguang Cui

Communication overhead is a known bottleneck in federated learning (FL). To address this, lossy compression is commonly used on the information communicated between the server and clients during training. In horizontal FL, where each client…

Machine Learning · Computer Science 2025-02-25 Pedro Valdeira , João Xavier , Cláudia Soares , Yuejie Chi

Split learning (SL) is a privacy-preserving distributed deep learning method used to train a collaborative model without the need for sharing of patient's raw data between clients. In split learning, an additional privacy-preserving…

Machine Learning · Computer Science 2021-03-29 Harshit Madaan , Manish Gawali , Viraj Kulkarni , Aniruddha Pant

In classical federated learning, the clients contribute to the overall training by communicating local updates for the underlying model on their private data to a coordinating server. However, updating and communicating the entire model…

Machine Learning · Computer Science 2022-02-18 Jianyu Wang , Hang Qi , Ankit Singh Rawat , Sashank Reddi , Sagar Waghmare , Felix X. Yu , Gauri Joshi

Collaborative machine learning across healthcare institutions promises improved diagnostic accuracy by leveraging diverse datasets, yet privacy regulations such as HIPAA prohibit direct patient data sharing. While federated learning (FL)…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Al Amin , Kamrul Hasan , Liang Hong , Sharif Ullah

With the proliferation of distributed edge computing resources, the 6G mobile network will evolve into a network for connected intelligence. Along this line, the proposal to incorporate federated learning into the mobile edge has gained…

Machine Learning · Computer Science 2024-01-25 Zheng Lin , Guanqiao Qu , Xianhao Chen , Kaibin Huang