English
Related papers

Related papers: Privacy-Preserving Split Learning with Vision Tran…

200 papers

Federated Split Learning (FSL) is a promising distributed learning paradigm in practice, which gathers the strengths of both Federated Learning (FL) and Split Learning (SL) paradigms, to ensure model privacy while diminishing the resource…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Yifan Shi , Yuhui Zhang , Ziyue Huang , Xiaofeng Yang , Li Shen , Wei Chen , Xueqian Wang

Large Language Models (LLMs) excel in natural language understanding by capturing hidden semantics in vector space. This process enriches the value of text embeddings for various downstream tasks, thereby fostering the…

Artificial Intelligence · Computer Science 2024-08-28 Peihua Mai , Ran Yan , Zhe Huang , Youjia Yang , Yan Pang

With the advancement of Large Language Models (LLMs), LLM applications have expanded into a growing number of fields. However, users with data privacy concerns face limitations in directly utilizing LLM APIs, while private deployments incur…

Cryptography and Security · Computer Science 2025-08-06 Zixuan Gu , Qiufeng Fan , Long Sun , Yang Liu , Xiaojun Ye

Split learning of deep neural networks (SplitNN) has provided a promising solution to learning jointly for the mutual interest of a guest and a host, which may come from different backgrounds, holding features partitioned vertically.…

Machine Learning · Computer Science 2023-04-20 Yunlong Mao , Zexi Xin , Zhenyu Li , Jue Hong , Qingyou Yang , Sheng Zhong

Federated Learning (FL) enables multiple clients to train a collaborative model without sharing their local data. Split Learning (SL) allows a model to be trained in a split manner across different locations. Split-Federated (SplitFed)…

Machine Learning · Computer Science 2024-12-24 Chamani Shiranthika , Hadi Hadizadeh , Parvaneh Saeedi , Ivan V. Bajić

Differentially private (DP) training preserves the data privacy usually at the cost of slower convergence (and thus lower accuracy), as well as more severe mis-calibration than its non-private counterpart. To analyze the convergence of DP…

Machine Learning · Computer Science 2023-06-21 Zhiqi Bu , Hua Wang , Zongyu Dai , Qi Long

Deep neural networks have strong capabilities of memorizing the underlying training data, which can be a serious privacy concern. An effective solution to this problem is to train models with differential privacy, which provides rigorous…

Machine Learning · Computer Science 2024-07-04 Ergute Bao , Yizheng Zhu , Xiaokui Xiao , Yin Yang , Beng Chin Ooi , Benjamin Hong Meng Tan , Khin Mi Mi Aung

Recent advancements in pre-trained large language models (LLMs) have significantly influenced various domains. Adapting these models for specific tasks often involves fine-tuning (FT) with private, domain-specific data. However, privacy…

Cryptography and Security · Computer Science 2024-12-11 Guanzhong Chen , Zhenghan Qin , Mingxin Yang , Yajie Zhou , Tao Fan , Tianyu Du , Zenglin Xu

With the rise of large language models, service providers offer language models as a service, enabling users to fine-tune customized models via uploaded private datasets. However, this raises concerns about sensitive data leakage. Prior…

Cryptography and Security · Computer Science 2026-01-22 Yi Liu , Weixiang Han , Chengjun Cai , Xingliang Yuan , Cong Wang

Despite the recent success of deep learning in the field of medicine, the issue of data scarcity is exacerbated by concerns about privacy and data ownership. Distributed learning approaches, including federated learning, have been…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Sangjoon Park , Ik-Jae Lee , Jun Won Kim , Jong Chul Ye

We introduce AdaMix, an adaptive differentially private algorithm for training deep neural network classifiers using both private and public image data. While pre-training language models on large public datasets has enabled strong…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Aditya Golatkar , Alessandro Achille , Yu-Xiang Wang , Aaron Roth , Michael Kearns , Stefano Soatto

Privacy is a growing concern in modern deep-learning systems and applications. Differentially private (DP) training prevents the leakage of sensitive information in the collected training data from the trained machine learning models. DP…

Machine Learning · Computer Science 2024-08-28 Xinwei Zhang , Zhiqi Bu , Mingyi Hong , Meisam Razaviyayn

The rapid growth of Internet of Medical Things (IoMT) devices has resulted in significant security risks, particularly the risk of malware attacks on resource-constrained devices. Conventional deep learning methods are impractical due to…

Cryptography and Security · Computer Science 2025-11-04 Siva Sai , Manish Prasad , Animesh Bhargava , Vinay Chamola , Rajkumar Buyya

Recent self-supervised learning (SSL) methods have shown impressive results in learning visual representations from unlabeled images. This paper aims to improve their performance further by utilizing the architectural advantages of the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Sukmin Yun , Hankook Lee , Jaehyung Kim , Jinwoo Shin

Federated learning, as a distributed architecture, shows great promise for applications in Cyber-Physical-Social Systems (CPSS). In order to mitigate the privacy risks inherent in CPSS, the integration of differential privacy with federated…

Machine Learning · Computer Science 2025-06-05 Jiayi Wan , Xiang Zhu , Fanzhen Liu , Wei Fan , Xiaolong Xu

Many high-stakes applications require machine learning models that protect user privacy and provide well-calibrated, accurate predictions. While Differential Privacy (DP) is the gold standard for protecting user privacy, standard DP…

Machine Learning · Computer Science 2025-05-09 Ossi Räisä , Stratis Markou , Matthew Ashman , Wessel P. Bruinsma , Marlon Tobaben , Antti Honkela , Richard E. Turner

Split Learning (SL) has emerged as a practical and efficient alternative to traditional federated learning. While previous attempts to attack SL have often relied on overly strong assumptions or targeted easily exploitable models, we seek…

Cryptography and Security · Computer Science 2025-03-25 Xiaochen Zhu , Xinjian Luo , Yuncheng Wu , Yangfan Jiang , Xiaokui Xiao , Beng Chin Ooi

Federated learning facilitates the collaborative training of models without the sharing of raw data. However, recent attacks demonstrate that simply maintaining data locality during training processes does not provide sufficient privacy…

Machine Learning · Computer Science 2019-08-16 Stacey Truex , Nathalie Baracaldo , Ali Anwar , Thomas Steinke , Heiko Ludwig , Rui Zhang , Yi Zhou

A key feature of federated learning (FL) is to preserve the data privacy of end users. However, there still exist potential privacy leakage in exchanging gradients under FL. As a result, recent research often explores the differential…

Cryptography and Security · Computer Science 2024-03-20 Yuntao Wang , Zhou Su , Yanghe Pan , Tom H Luan , Ruidong Li , Shui Yu

In this paper, we propose a novel approach to minimize the inference delay in semantic segmentation using split learning (SL), tailored to the needs of real-time computer vision (CV) applications for resource-constrained devices. Semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Nikos G. Evgenidis , Nikos A. Mitsiou , Sotiris A. Tegos , Panagiotis D. Diamantoulakis , George K. Karagiannidis