English
Related papers

Related papers: Privacy-Preserving Split Learning with Vision Tran…

200 papers

U-shaped networks are widely used in various medical image tasks, such as segmentation, restoration and reconstruction, but most of them usually rely on centralized learning and thus ignore privacy issues. To address the privacy concerns,…

Image and Video Processing · Electrical Eng. & Systems 2022-12-14 Ziyuan Yang , Yingyu Chen , Huijie Huangfu , Maosong Ran , Hui Wang , Xiaoxiao Li , Yi Zhang

We propose a novel method for privacy-preserving deep neural networks (DNNs) with the Vision Transformer (ViT). The method allows us not only to train models and test with visually protected images but to also avoid the performance…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Teru Nagamori , Sayaka Shiota , Hitoshi Kiya

Differential privacy (DP) in deep learning is a critical concern as it ensures the confidentiality of training data while maintaining model utility. Existing DP training algorithms provide privacy guarantees by clipping and then injecting…

Machine Learning · Computer Science 2025-04-02 Mingqian Feng , Zeliang Zhang , Jinyang Jiang , Yijie Peng , Chenliang Xu

In the wake of the burgeoning expansion of generative artificial intelligence (AI) services, the computational demands inherent to these technologies frequently necessitate cloud-powered computational offloading, particularly for…

Machine Learning · Computer Science 2024-10-28 Shoki Ohta , Takayuki Nishio

The internet of things (IoT) is transforming major industries including but not limited to healthcare, agriculture, finance, energy, and transportation. IoT platforms are continually improving with innovations such as the amalgamation of…

Machine Learning · Computer Science 2019-11-12 M. A. P. Chamikara , P. Bertok , I. Khalil , D. Liu , S. Camtepe , M. Atiquzzaman

Ensuring the privacy of Large Language Models (LLMs) is becoming increasingly important. The most widely adopted technique to accomplish this is DP-SGD, which trains a model to guarantee Differential Privacy (DP). However, DP-SGD…

Cryptography and Security · Computer Science 2024-04-30 James Flemings , Meisam Razaviyayn , Murali Annavaram

Differential privacy (DP) has become an essential framework for privacy-preserving machine learning. Existing DP learning methods, however, often have disparate impacts on model predictions, e.g., for minority groups. Gradient clipping,…

Machine Learning · Computer Science 2025-06-03 Linzh Zhao , Aki Rehn , Mikko A. Heikkilä , Razane Tajeddine , Antti Honkela

Image data have been extensively used in Deep Neural Network (DNN) tasks in various scenarios, e.g., autonomous driving and medical image analysis, which incurs significant privacy concerns. Existing privacy protection techniques are unable…

Cryptography and Security · Computer Science 2024-04-08 Qiushi Li , Yan Zhang , Ju Ren , Qi Li , Yaoxue Zhang

Collaborative machine learning techniques such as federated learning (FL) enable the training of models on effectively larger datasets without data transfer. Recent initiatives have demonstrated that segmentation models trained with FL can…

Image and Video Processing · Electrical Eng. & Systems 2021-07-07 Alexander Ziller , Dmitrii Usynin , Nicolas Remerscheid , Moritz Knolle , Marcus Makowski , Rickmer Braren , Daniel Rueckert , Georgios Kaissis

Vision Transformers (ViTs) dominate self-supervised learning (SSL). While they have proven highly effective for large-scale pretraining, they are computationally inefficient and scale poorly with image size. Consequently, foundational…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Nedyalko Prisadnikov , Danda Pani Paudel , Yuqian Fu , Luc Van Gool

Differentially Private Stochastic Gradient Descent (DP-SGD) is a key method for applying privacy in the training of deep learning models. It applies isotropic Gaussian noise to gradients during training, which can perturb these gradients in…

Machine Learning · Computer Science 2023-11-28 Pedro Faustini , Natasha Fernandes , Shakila Tonni , Annabelle McIver , Mark Dras

Deep learning techniques have achieved remarkable performance in wide-ranging tasks. However, when trained on privacy-sensitive datasets, the model parameters may expose private information in training data. Prior attempts for…

Machine Learning · Computer Science 2021-06-22 Wenxiao Wang , Tianhao Wang , Lun Wang , Nanqing Luo , Pan Zhou , Dawn Song , Ruoxi Jia

The significance of distributed learning and inference algorithms in Internet of Things (IoT) network is growing since they flexibly distribute computation load between IoT devices and the infrastructure, enhance data privacy, and minimize…

Networking and Internet Architecture · Computer Science 2024-10-28 Vukan Ninkovic , Dejan Vukobratovic , Dragisa Miskovic , Marco Zennaro

Large convolutional neural networks (CNN) can be difficult to train in the differentially private (DP) regime, since the optimization algorithms require a computationally expensive operation, known as the per-sample gradient clipping. We…

Machine Learning · Computer Science 2022-12-01 Zhiqi Bu , Jialin Mao , Shiyun Xu

Protecting data privacy in deep learning (DL) is of crucial importance. Several celebrated privacy notions have been established and used for privacy-preserving DL. However, many existing mechanisms achieve privacy at the cost of…

Machine Learning · Computer Science 2024-08-13 Wenqi Tao , Huaming Ling , Zuoqiang Shi , Bao Wang

Vision Transformers (ViTs) excel in 3D medical segmentation but require massive annotated datasets. While Self-Supervised Learning (SSL) mitigates this using unlabeled data, it still faces strict privacy and logistical barriers.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jiaqi Tang , Mengyan Zheng , Shu Zhang , Fandong Zhang , Qingchao Chen

This article presents DDP-SA, a scalable privacy-preserving federated learning framework that jointly leverages client-side local differential privacy (LDP) and full-threshold additive secret sharing (ASS) for secure aggregation. Unlike…

Cryptography and Security · Computer Science 2026-04-09 Wenjing Wei , Farid Nait-Abdesselam , Alla Jammine

This work aims to provide both privacy and utility within a split learning framework while considering both forward attribute inference and backward reconstruction attacks. To address this, a novel approach has been proposed, which makes…

Cryptography and Security · Computer Science 2025-03-03 Griffin Higgins , Roozbeh Razavi-Far , Xichen Zhang , Amir David , Ali Ghorbani , Tongyu Ge

Train machine learning models on sensitive user data has raised increasing privacy concerns in many areas. Federated learning is a popular approach for privacy protection that collects the local gradient information instead of real data.…

Cryptography and Security · Computer Science 2021-05-24 Lichao Sun , Jianwei Qian , Xun Chen

Federated learning is distributed model training across several clients without disclosing raw data. Despite advancements in data privacy, risks still remain. Differential Privacy (DP) is a technique to protect sensitive data by adding…

Machine Learning · Computer Science 2025-10-14 Tejash Varsani