English
Related papers

Related papers: LDPKiT: Superimposing Remote Queries for Privacy-P…

200 papers

In the arena of privacy-preserving machine learning, differentially private stochastic gradient descent (DP-SGD) has outstripped the objective perturbation mechanism in popularity and interest. Though unrivaled in versatility, DP-SGD…

Machine Learning · Computer Science 2024-01-02 Rachel Redberg , Antti Koskela , Yu-Xiang Wang

Neural machine translation (NMT) is a widely popular text generation task, yet there is a considerable research gap in the development of privacy-preserving NMT models, despite significant data privacy concerns for NMT systems.…

Computation and Language · Computer Science 2024-04-25 Timour Igamberdiev , Doan Nam Long Vu , Felix Künnecke , Zhuo Yu , Jannik Holmer , Ivan Habernal

Differential privacy (DP) is a privacy-preserving paradigm that protects the training data when training deep learning models. Critically, the performance of models is determined by the training hyperparameters, especially those of the…

Machine Learning · Computer Science 2025-03-04 Zhiqi Bu , Ruixuan Liu

Privacy issues were raised in the process of training deep learning in medical, mobility, and other fields. To solve this problem, we present privacy-preserving distributed deep learning method that allow clients to learn a variety of data…

Machine Learning · Computer Science 2020-09-14 Jongwon Kim , Sungho Shin , Yeonguk Yu , Junseok Lee , Kyoobin Lee

User-level privacy is important in distributed systems. Previous research primarily focuses on the central model, while the local models have received much less attention. Under the central model, user-level DP is strictly stronger than the…

Machine Learning · Statistics 2024-05-28 Puning Zhao , Li Shen , Rongfei Fan , Qingming Li , Huiwen Wu , Jiafei Wu , Zhe Liu

This paper examines the evolving landscape of machine learning (ML) and its profound impact across various sectors, with a special focus on the emerging field of Privacy-preserving Machine Learning (PPML). As ML applications become…

Cryptography and Security · Computer Science 2025-01-30 Chaoyu Zhang , Shaoyu Li

Machine Learning (ML), addresses a multitude of complex issues in multiple disciplines, including social sciences, finance, and medical research. ML models require substantial computing power and are only as powerful as the data utilized.…

Cryptography and Security · Computer Science 2024-03-07 Tanveer Khan , Mindaugas Budzys , Khoa Nguyen , Antonis Michalas

Federated learning (FL) that enables edge devices to collaboratively learn a shared model while keeping their training data locally has received great attention recently and can protect privacy in comparison with the traditional centralized…

Machine Learning · Computer Science 2022-11-17 Rui Hu , Yanmin Gong , Yuanxiong Guo

Ensuring the privacy of sensitive data used to train modern machine learning models is of paramount importance in many areas of practice. One recent popular approach to study these concerns is using the differential privacy via a…

Cryptography and Security · Computer Science 2020-07-29 Lichao Sun , Ji Wang , Philip S. Yu , Lifang He

The rapid rise of IoT and Big Data has facilitated copious data driven applications to enhance our quality of life. However, the omnipresent and all-encompassing nature of the data collection can generate privacy concerns. Hence, there is a…

Machine Learning · Computer Science 2021-09-09 Mert Al , Semih Yagli , Sun-Yuan Kung

Deep learning models leak significant amounts of information about their training datasets. Previous work has investigated training models with differential privacy (DP) guarantees through adding DP noise to the gradients. However, such…

Machine Learning · Computer Science 2020-07-23 Milad Nasr , Reza Shokri , Amir houmansadr

As Large Language Models (LLMs) proliferate, developing privacy safeguards for these models is crucial. One popular safeguard involves training LLMs in a differentially private manner. However, such solutions are shown to be computationally…

Machine Learning · Computer Science 2024-10-04 James Flemings , Meisam Razaviyayn , Murali Annavaram

Federated learning has emerged as an attractive approach to protect data privacy by eliminating the need for sharing clients' data while reducing communication costs compared with centralized machine learning algorithms. However, recent…

Contextual bandit algorithms are useful in personalized online decision-making. However, many applications such as personalized medicine and online advertising require the utilization of individual-specific information for effective…

Machine Learning · Statistics 2021-06-08 Yuxuan Han , Zhipeng Liang , Yang Wang , Jiheng Zhang

Recent developments in deep learning have led to great success in various natural language processing (NLP) tasks. However, these applications may involve data that contain sensitive information. Therefore, how to achieve good performance…

Computation and Language · Computer Science 2023-10-24 Lijie Hu , Ivan Habernal , Lei Shen , Di Wang

Some machine learning applications involve training data that is sensitive, such as the medical histories of patients in a clinical trial. A model may inadvertently and implicitly store some of its training data; careful analysis of the…

Machine Learning · Statistics 2017-03-06 Nicolas Papernot , Martín Abadi , Úlfar Erlingsson , Ian Goodfellow , Kunal Talwar

The integration of Differential Privacy (DP) with diffusion models (DMs) presents a promising yet challenging frontier, particularly due to the substantial memorization capabilities of DMs that pose significant privacy risks. Differential…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Yu-Lin Tsai , Yizhe Li , Zekai Chen , Po-Yu Chen , Chia-Mu Yu , Xuebin Ren , Francois Buet-Golfouse

Differential Privacy (DP) is a widely adopted technique, valued for its effectiveness in protecting the privacy of task-specific datasets, making it a critical tool for large language models. However, its effectiveness in Multimodal Large…

Cryptography and Security · Computer Science 2025-06-10 Qianshan Wei , Jiaqi Li , Zihan You , Yi Zhan , Kecen Li , Jialin Wu , Xinfeng Li Hengjun Liu , Yi Yu , Bin Cao , Yiwen Xu , Yang Liu , Guilin Qi

As machine learning becomes a practice and commodity, numerous cloud-based services and frameworks are provided to help customers develop and deploy machine learning applications. While it is prevalent to outsource model training and…

Cryptography and Security · Computer Science 2018-07-16 Tianwei Zhang , Zecheng He , Ruby B. Lee

Preserving privacy in contemporary NLP models allows us to work with sensitive data, but unfortunately comes at a price. We know that stricter privacy guarantees in differentially-private stochastic gradient descent (DP-SGD) generally…

Computation and Language · Computer Science 2023-02-01 Manuel Senge , Timour Igamberdiev , Ivan Habernal