English
Related papers

Related papers: Representation Magnitude has a Liability to Privac…

200 papers

Machine Learning (ML) alleviates the challenges of high-dimensional data analysis and improves decision making in critical applications like healthcare. Effective cancer type from high-dimensional genetic mutation data can be useful for…

Cryptography and Security · Computer Science 2022-04-13 Esha Sarkar , Eduardo Chielle , Gamze Gursoy , Leo Chen , Mark Gerstein , Michail Maniatakos

Large language models (LLMs) are increasingly deployed in interactive and retrieval-augmented settings, raising significant privacy concerns. While attacks such as Membership Inference (MIA), Attribute Inference (AIA), Data Extraction…

Cryptography and Security · Computer Science 2026-05-05 Karima Makhlouf , Lamiaa Basyoni , Syed Khaderi , Gabriel Marquez , Peter Sotomango , Mahmoud Awawdah , Sami Zhioua

We study statistical risk minimization problems under a privacy model in which the data is kept confidential even from the learner. In this local privacy framework, we establish sharp upper and lower bounds on the convergence rates of…

Machine Learning · Statistics 2013-10-11 John C. Duchi , Michael I. Jordan , Martin J. Wainwright

Artificial intelligence, machine learning, and deep learning as a service have become the status quo for many industries, leading to the widespread deployment of models that handle sensitive data. Well-performing models, the industry seeks,…

The main aim of Privacy-Preserving Machine Learning (PPML) is to protect the privacy and provide security to the data used in building Machine Learning models. There are various techniques in PPML such as Secure Multi-Party Computation,…

Machine Learning · Computer Science 2022-06-01 Syed Imtiaz Ahamed , Vadlamani Ravi

Membership inference attacks (MIAs) are currently considered one of the main privacy attack strategies, and their defense mechanisms have also been extensively explored. However, there is still a gap between the existing defense approaches…

Machine Learning · Computer Science 2024-05-30 Xingli Fang , Jung-Eun Kim

The increasing deployment of Machine Learning (ML) models in sensitive domains motivates the need for robust, practical privacy assessment tools. PrivacyGuard is a comprehensive tool for empirical differential privacy (DP) analysis,…

Machine Learning · Computer Science 2025-10-28 Luca Melis , Matthew Grange , Iden Kalemaj , Karan Chadha , Shengyuan Hu , Elena Kashtelyan , Will Bullock

As machine learning becomes a more mainstream technology, the objective for governments and public sectors is to harness the power of machine learning to advance their mission by revolutionizing public services. Motivational government use…

Cryptography and Security · Computer Science 2020-10-13 Nader Sehatbakhsh , Ellie Daw , Onur Savas , Amin Hassanzadeh , Ian McCulloh

As Large Language Models (LLMs) are increasingly deployed in sensitive domains, traditional data privacy measures prove inadequate for protecting information that is implicit, contextual, or inferable - what we define as semantic privacy.…

Cryptography and Security · Computer Science 2025-07-17 Baihe Ma , Yanna Jiang , Xu Wang , Guangsheng Yu , Qin Wang , Caijun Sun , Chen Li , Xuelei Qi , Ying He , Wei Ni , Ren Ping Liu

A key concern for AI safety remains understudied in the machine learning (ML) literature: how can we ensure users of ML models do not leverage predictions on incorrect personal data to harm others? This is particularly pertinent given the…

Machine Learning · Computer Science 2025-10-01 Muhammad H. Ashiq , Peter Triantafillou , Hung Yun Tseng , Grigoris G. Chrysos

Machine learning (ML) has become a core component of many real-world applications and training data is a key factor that drives current progress. This huge success has led Internet companies to deploy machine learning as a service (MLaaS).…

Cryptography and Security · Computer Science 2018-12-18 Ahmed Salem , Yang Zhang , Mathias Humbert , Pascal Berrang , Mario Fritz , Michael Backes

We study the problem of privacy-preserving machine learning (PPML) for ensemble methods, focusing our effort on random forests. In collaborative analysis, PPML attempts to solve the conflict between the need for data sharing and privacy.…

Machine Learning · Computer Science 2018-11-22 Irene Giacomelli , Somesh Jha , Ross Kleiman , David Page , Kyonghwan Yoon

Artificial intelligence systems are prevalent in everyday life, with use cases in retail, manufacturing, health, and many other fields. With the rise in AI adoption, associated risks have been identified, including privacy risks to the…

Machine Learning · Computer Science 2024-07-19 Shlomit Shachor , Natalia Razinkov , Abigail Goldsteen

Predictive machine learning models are becoming increasingly deployed in high-stakes contexts involving sensitive personal data; in these contexts, there is a trade-off between model explainability and data privacy. In this work, we push…

Cryptography and Security · Computer Science 2024-07-29 Catherine Huang , Martin Pawelczyk , Himabindu Lakkaraju

The rapid advancement of large language models (LLMs) has demonstrated milestone success in a variety of tasks, yet their potential for generating harmful content has raised significant safety concerns. Existing safety evaluation approaches…

Computation and Language · Computer Science 2025-05-22 Tianqi Du , Zeming Wei , Quan Chen , Chenheng Zhang , Yisen Wang

Algorithmic fairness and privacy are essential pillars of trustworthy machine learning. Fair machine learning aims at minimizing discrimination against protected groups by, for example, imposing a constraint on models to equalize their…

Machine Learning · Statistics 2021-04-08 Hongyan Chang , Reza Shokri

Training reliable deep learning models which avoid making overconfident but incorrect predictions is a longstanding challenge. This challenge is further exacerbated when learning has to be differentially private: protection provided to…

Machine Learning · Computer Science 2023-05-31 Stephan Rabanser , Anvith Thudi , Abhradeep Thakurta , Krishnamurthy Dvijotham , Nicolas Papernot

Neural networks trained on real-world data often exhibit biases while simultaneously being vulnerable to privacy attacks aimed at extracting sensitive information. Despite extensive research on each problem individually, their intersection…

Machine Learning · Computer Science 2025-10-07 Chenxiang Zhang , Jun Pang , Sjouke Mauw

Deep neural networks have become a primary tool for solving problems in many fields. They are also used for addressing information retrieval problems and show strong performance in several tasks. Training these models requires large,…

Information Retrieval · Computer Science 2017-07-25 Mostafa Dehghani , Hosein Azarbonyad , Jaap Kamps , Maarten de Rijke

Membership inference attacks seek to infer membership of individual training instances of a model to which an adversary has black-box access through a machine learning-as-a-service API. In providing an in-depth characterization of…

Cryptography and Security · Computer Science 2019-02-04 Stacey Truex , Ling Liu , Mehmet Emre Gursoy , Lei Yu , Wenqi Wei