English
Related papers

Related papers: PrivacyGuard: A Modular Framework for Privacy Audi…

200 papers

The rapid development of language models (LMs) brings unprecedented accessibility and usage for both models and users. On the one hand, powerful LMs achieve state-of-the-art performance over numerous downstream NLP tasks. On the other hand,…

Computation and Language · Computer Science 2024-06-04 Haoran Li , Dadi Guo , Donghao Li , Wei Fan , Qi Hu , Xin Liu , Chunkit Chan , Duanyi Yao , Yuan Yao , Yangqiu Song

Machine learning models are vulnerable to data inference attacks, such as membership inference and model inversion attacks. In these types of breaches, an adversary attempts to infer a data record's membership in a dataset or even…

Cryptography and Security · Computer Science 2022-03-15 Dayong Ye , Sheng Shen , Tianqing Zhu , Bo Liu , Wanlei Zhou

This paper investigates capabilities of Privacy-Preserving Deep Learning (PPDL) mechanisms against various forms of privacy attacks. First, we propose to quantitatively measure the trade-off between model accuracy and privacy losses…

Machine Learning · Computer Science 2020-06-25 Lixin Fan , Kam Woh Ng , Ce Ju , Tianyu Zhang , Chang Liu , Chee Seng Chan , Qiang Yang

Federated learning (FL) enhances privacy by keeping user data on local devices. However, emerging attacks have demonstrated that the updates shared by users during training can reveal significant information about their data. This has…

Machine learning (ML) models used in medical imaging diagnostics can be vulnerable to a variety of privacy attacks, including membership inference attacks, that lead to violations of regulations governing the use of medical data and…

Cryptography and Security · Computer Science 2021-08-23 William Paul , Yinzhi Cao , Miaomiao Zhang , Phil Burlina

Differential Privacy (DP) has emerged as a rigorous formalism to reason about quantifiable privacy leakage. In machine learning (ML), DP has been employed to limit inference/disclosure of training examples. Prior work leveraged DP across…

Cryptography and Security · Computer Science 2021-12-28 Ismat Jarin , Birhanu Eshete

Artificial intelligence systems are prevalent in everyday life, with use cases in retail, manufacturing, health, and many other fields. With the rise in AI adoption, associated risks have been identified, including privacy risks to the…

Machine Learning · Computer Science 2024-07-19 Shlomit Shachor , Natalia Razinkov , Abigail Goldsteen

In applications involving sensitive data, such as finance and healthcare, the necessity for preserving data privacy can be a significant barrier to machine learning model development. Differential privacy (DP) has emerged as one canonical…

Machine Learning · Computer Science 2022-11-15 Zachary Izzo , Jinsung Yoon , Sercan O. Arik , James Zou

Privacy-preserving machine learning (PPML) based on cryptographic protocols has emerged as a promising paradigm to protect user data privacy in cloud-based machine learning services. While it achieves formal privacy protection, PPML often…

Cryptography and Security · Computer Science 2025-07-22 Wenxuan Zeng , Tianshi Xu , Yi Chen , Yifan Zhou , Mingzhe Zhang , Jin Tan , Cheng Hong , Meng Li

Fine-tuning large language models (LLMs) has become an essential strategy for adapting them to specialized tasks; however, this process introduces significant privacy challenges, as sensitive training data may be inadvertently memorized and…

Cryptography and Security · Computer Science 2025-05-02 Hao Du , Shang Liu , Yang Cao

The explosive growth of machine learning has made it a critical infrastructure in the era of artificial intelligence. The extensive use of data poses a significant threat to individual privacy. Various countries have implemented…

Cryptography and Security · Computer Science 2024-06-11 Hengzhu Liu , Ping Xiong , Tianqing Zhu , Philip S. Yu

The newly emerged machine learning (e.g. deep learning) methods have become a strong driving force to revolutionize a wide range of industries, such as smart healthcare, financial technology, and surveillance systems. Meanwhile, privacy has…

Machine Learning · Computer Science 2020-11-25 Bo Liu , Ming Ding , Sina Shaham , Wenny Rahayu , Farhad Farokhi , Zihuai Lin

Private and public organizations regularly collect and analyze digitalized data about their associates, volunteers, clients, etc. However, because most personal data are sensitive, there is a key challenge in designing privacy-preserving…

Cryptography and Security · Computer Science 2022-04-05 Héber H. Arcolezi

Machine Learning (ML) has recently shown tremendous success in modeling various healthcare prediction tasks, ranging from disease diagnosis and prognosis to patient treatment. Due to the sensitive nature of medical data, privacy must be…

Machine Learning · Computer Science 2024-10-01 Alejandro Guerra-Manzanares , L. Julian Lechuga Lopez , Michail Maniatakos , Farah E. Shamout

The main aim of Privacy-Preserving Machine Learning (PPML) is to protect the privacy and provide security to the data used in building Machine Learning models. There are various techniques in PPML such as Secure Multi-Party Computation,…

Machine Learning · Computer Science 2022-06-01 Syed Imtiaz Ahamed , Vadlamani Ravi

Recent advancements in privacy-preserving machine learning are paving the way to extend the benefits of ML to highly sensitive data that, until now, have been hard to utilize due to privacy concerns and regulatory constraints.…

Cryptography and Security · Computer Science 2024-09-24 Hidde Lycklama , Alexander Viand , Nicolas Küchler , Christian Knabenhans , Anwar Hithnawi

The increased application of machine learning (ML) in sensitive domains requires protecting the training data through privacy frameworks, such as differential privacy (DP). DP requires to specify a uniform privacy level $\varepsilon$ that…

Machine Learning · Computer Science 2024-01-31 Krishna Acharya , Franziska Boenisch , Rakshit Naidu , Juba Ziani

There has been an explosion of research on differential privacy (DP) and its various applications in recent years, ranging from novel variants and accounting techniques in differential privacy to the thriving field of differentially private…

Cryptography and Security · Computer Science 2024-04-09 Saswat Das , Subhankar Mishra

In several jurisdictions, the regulatory framework on the release and sharing of personal data is being extended to machine learning (ML). The implicit assumption is that disclosing a trained ML model entails a privacy risk for any personal…

Cryptography and Security · Computer Science 2025-11-14 Josep Domingo-Ferrer

Modern machine learning (ML) ecosystems offer a surging number of ML frameworks and code repositories that can greatly facilitate the development of ML models. Today, even ordinary data holders who are not ML experts can apply off-the-shelf…

Cryptography and Security · Computer Science 2024-07-03 Zitao Chen , Karthik Pattabiraman