English
Related papers

Related papers: Privacy-Preserving Split Learning with Vision Tran…

200 papers

Mobile devices and the immense amount and variety of data they generate are key enablers of machine learning (ML)-based applications. Traditional ML techniques have shifted toward new paradigms such as federated (FL) and split learning (SL)…

Machine Learning · Computer Science 2022-07-06 Pranvera Kortoçi , Yilei Liang , Pengyuan Zhou , Lik-Hang Lee , Abbas Mehrabi , Pan Hui , Sasu Tarkoma , Jon Crowcroft

The Sparse Vector Technique (SVT) is one of the most fundamental tools in differential privacy (DP). It works as a backbone for adaptive data analysis by answering a sequence of queries on a given dataset, and gleaning useful information in…

Cryptography and Security · Computer Science 2026-05-06 Yuhan Liu , Sheng Wang , Yixuan Liu , Feifei Li , Hong Chen

Privacy protection in medical data is a legitimate obstacle for centralized machine learning applications. Here, we propose a client-server image segmentation system which allows for the analysis of multi-centric medical images while…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Bach Kim , Jose Dolz , Pierre-Marc Jodoin , Christian Desrosiers

In collaborative learning (CL), multiple parties jointly train a machine learning model on their private datasets. However, data can not be shared directly due to privacy concerns. To ensure input confidentiality, cryptographic techniques,…

Cryptography and Security · Computer Science 2026-01-15 Francesco Capano , Jonas Böhler , Benjamin Weggenmann

Recent advances in deep learning have drastically improved performance on many Natural Language Understanding (NLU) tasks. However, the data used to train NLU models may contain private information such as addresses or phone numbers,…

Computation and Language · Computer Science 2022-03-03 Christophe Dupuy , Radhika Arava , Rahul Gupta , Anna Rumshisky

The deployment of large language models (LLMs) on resource-constrained devices remains challenging, spurring interest in split inference, where models are partitioned between client and server to reduce computational burden and enhance…

Cryptography and Security · Computer Science 2026-05-25 Mingyuan Fan , Yu Liu , Fuyi Wang , Cen Chen

Data Distribution Service (DDS) is an innovative approach towards communication in ICS/IoT infrastructure and robotics. Being based on the cross-platform and cross-language API to be applicable in any computerised device, it offers the…

Machine Learning · Computer Science 2021-06-15 Stanislav Abaimov

Split learning (SL) transfers most of the training workload to the server, which alleviates computational burden on client devices. However, the transmission of intermediate feature representations, referred to as smashed data, incurs…

Machine Learning · Computer Science 2026-03-19 Jialei Tan , Zheng Lin , Xiangming Cai , Ruoxi Zhu , Zihan Fang , Pingping Chen , Wei Ni

To empower precision agriculture through distributed machine learning (DML), split learning (SL) has emerged as a promising paradigm, partitioning deep neural networks (DNNs) between edge devices and servers to reduce computational burdens…

Machine Learning · Computer Science 2025-06-18 Vishesh Kumar Tanwar , Soumik Sarkar , Asheesh K. Singh , Sajal K. Das

Large language models (LLMs) are commonly adapted to downstream tasks through fine-tuning, but fine-tuning data often contains sensitive information that may be leaked by the resulting model. Differential privacy (DP) offers formal…

Machine Learning · Computer Science 2026-05-19 Haichao Sha , Zihao Wang , Yuncheng Wu , Hong Chen , Wei Dong

Federated learning has emerged as an attractive approach to protect data privacy by eliminating the need for sharing clients' data while reducing communication costs compared with centralized machine learning algorithms. However, recent…

The widespread application of artificial intelligence in health research is currently hampered by limitations in data availability. Distributed learning methods such as federated learning (FL) and shared learning (SL) are introduced to…

Machine Learning · Computer Science 2022-04-08 Sangjoon Park , Jong Chul Ye

While preserving the privacy of federated learning (FL), differential privacy (DP) inevitably degrades the utility (i.e., accuracy) of FL due to model perturbations caused by DP noise added to model updates. Existing studies have considered…

Machine Learning · Computer Science 2023-03-09 Xin Yuan , Wei Ni , Ming Ding , Kang Wei , Jun Li , H. Vincent Poor

Split Federated Learning (SFL) enables privacy-preserving collaborative training by partitioning models between clients and a server. However, under non-IID data distributions, SFL often suffers from biased optimization and unstable…

Machine Learning · Computer Science 2026-05-19 Yuhan Xie , Chen Lyu , Jingrong Huang

Federated learning (FL) aims to collaboratively train the global model in a distributed manner by sharing the model parameters from local clients to a central server, thereby potentially protecting users' private information. Nevertheless,…

Machine Learning · Computer Science 2023-02-17 Zhe Li , Honglong Chen , Zhichen Ni , Huajie Shao

Differential Privacy (DP) provides a formal privacy guarantee preventing adversaries with access to a machine learning model from extracting information about individual training points. Differentially Private Stochastic Gradient Descent…

Machine Learning · Computer Science 2022-06-17 Soham De , Leonard Berrada , Jamie Hayes , Samuel L. Smith , Borja Balle

Self-Supervised Learning (SSL) for Vision Transformers (ViTs) has recently demonstrated considerable potential as a pre-training strategy for a variety of computer vision tasks, including image classification and segmentation, both in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Yannis Kaltampanidis , Alexandros Doumanoglou , Dimitrios Zarpalas

Quantum computing revolutionizes the way of solving complex problems and handling vast datasets, which shows great potential to accelerate the machine learning process. However, data leakage in quantum machine learning (QML) may present…

Quantum Physics · Physics 2024-03-08 Keyi Ju , Xiaoqi Qin , Hui Zhong , Xinyue Zhang , Miao Pan , Baoling Liu

Self-supervised learning (SSL) has produced a diverse landscape of vision transformers (ViTs) whose pretrained representations support a wide range of downstream tasks. Towards a better understanding of these models, a body of work has…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Xiaoyan Yu , Lisa Mais , Jannik Franzen , Peter Hirsch , Nick Lechtenbörger , Andreas Mardt , Dagmar Kainmüller

A major challenge in applying differential privacy to training deep neural network models is scalability.The widely-used training algorithm, differentially private stochastic gradient descent (DP-SGD), struggles with training…

Machine Learning · Computer Science 2023-03-09 Kamil Adamczewski , Mijung Park