English
Related papers

Related papers: Anonymizing Machine Learning Models

200 papers

Today, computer systems hold large amounts of personal data. Yet while such an abundance of data allows breakthroughs in artificial intelligence, and especially machine learning (ML), its existence can be a threat to user privacy, and it…

Over the last decade, proliferation of various online platforms and their increasing adoption by billions of users have heightened the privacy risk of a user enormously. In fact, security researchers have shown that sparse microdata…

Machine Learning · Computer Science 2017-02-07 Baichuan Zhang , Noman Mohammed , Vachik Dave , Mohammad Al Hasan

The principle of data minimization aims to reduce the amount of data collected, processed or retained to minimize the potential for misuse, unauthorized access, or data breaches. Rooted in privacy-by-design principles, data minimization has…

Machine Learning · Computer Science 2024-05-31 Prakhar Ganesh , Cuong Tran , Reza Shokri , Ferdinando Fioretto

Many individuals are concerned about the governance of machine learning systems and the prevention of algorithmic harms. The EU's recent General Data Protection Regulation (GDPR) has been seen as a core tool for achieving better governance…

Machine Learning · Computer Science 2018-10-17 Michael Veale , Reuben Binns , Lilian Edwards

The use of Machine Learning (ML) for data-driven decision-making often relies on access to sensitive datasets, which introduces privacy challenges. Traditional encryption methods protect data at rest or in transit but fail to secure it…

Cryptography and Security · Computer Science 2026-04-28 Alexandre Marques , Beatriz Sá , Rui Botelho , Pedro Pinto

Artificial intelligence systems are prevalent in everyday life, with use cases in retail, manufacturing, health, and many other fields. With the rise in AI adoption, associated risks have been identified, including privacy risks to the…

Machine Learning · Computer Science 2024-07-19 Shlomit Shachor , Natalia Razinkov , Abigail Goldsteen

Data augmentation is widely used to mitigate data bias in the training dataset. However, data augmentation exposes machine learning models to privacy attacks, such as membership inference attacks. In this paper, we propose an effective…

Machine Learning · Computer Science 2024-04-23 Zhixin Pan , Emma Andrews , Laura Chang , Prabhat Mishra

Approximate machine unlearning aims to remove the effect of specific data from trained models to ensure individuals' privacy. Existing methods focus on the removed records and assume the retained ones are unaffected. However, recent studies…

Machine Learning · Computer Science 2025-08-27 Yuechun Gu , Jiajie He , Keke Chen

In this paper, we investigate the effect of machine learning based anonymization on anomalous subgroup preservation. In particular, we train a binary classifier to discover the most anomalous subgroup in a dataset by maximizing the bias…

Publishing datasets plays an essential role in open data research and promoting transparency of government agencies. However, such data publication might reveal users' private information. One of the most sensitive sources of data is…

Machine Learning · Computer Science 2019-11-06 Sina Shaham , Ming Ding , Bo Liu , Shuping Dang , Zihuai Lin , Jun Li

It is observed in the literature that data augmentation can significantly mitigate membership inference (MI) attack. However, in this work, we challenge this observation by proposing new MI attacks to utilize the information of augmented…

Machine Learning · Computer Science 2021-03-01 Da Yu , Huishuai Zhang , Wei Chen , Jian Yin , Tie-Yan Liu

Differential privacy allows bounding the influence that training data records have on a machine learning model. To use differential privacy in machine learning, data scientists must choose privacy parameters $(\epsilon,\delta)$. Choosing…

Cryptography and Security · Computer Science 2021-07-21 Daniel Bernau , Günther Eibl , Philip W. Grassal , Hannah Keller , Florian Kerschbaum

The rise of connected personal devices together with privacy concerns call for machine learning algorithms capable of leveraging the data of a large number of agents to learn personalized models under strong privacy requirements. In this…

Machine Learning · Computer Science 2018-02-20 Aurélien Bellet , Rachid Guerraoui , Mahsa Taziki , Marc Tommasi

Recently issued data privacy regulations like GDPR (General Data Protection Regulation) grant individuals the right to be forgotten. In the context of machine learning, this requires a model to forget about a training data sample if…

Cryptography and Security · Computer Science 2022-06-13 Hongsheng Hu , Zoran Salcic , Gillian Dobbie , Jinjun Chen , Lichao Sun , Xuyun Zhang

The arms race between attacks and defenses for machine learning models has come to a forefront in recent years, in both the security community and the privacy community. However, one big limitation of previous research is that the security…

Machine Learning · Statistics 2019-08-27 Liwei Song , Reza Shokri , Prateek Mittal

Machine learning models, especially deep neural networks have been shown to be susceptible to privacy attacks such as membership inference where an adversary can detect whether a data point was used for training a black-box model. Such…

Machine Learning · Computer Science 2020-07-20 Shruti Tople , Amit Sharma , Aditya Nori

Machine learning models have been shown to leak information violating the privacy of their training set. We focus on membership inference attacks on machine learning models which aim to determine whether a data point was used to train the…

Cryptography and Security · Computer Science 2020-09-02 Shadi Rahimian , Tribhuvanesh Orekondy , Mario Fritz

The rapid development of video surveillance systems for object detection, tracking, activity recognition, and anomaly detection has revolutionized our day-to-day lives while setting alarms for privacy concerns. It isn't easy to strike a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Nazia Aslam , Kamal Nasrollahi

The rapid rise of IoT and Big Data has facilitated copious data driven applications to enhance our quality of life. However, the omnipresent and all-encompassing nature of the data collection can generate privacy concerns. Hence, there is a…

Machine Learning · Computer Science 2021-09-09 Mert Al , Semih Yagli , Sun-Yuan Kung

Since the introduction of the GDPR and CCPA legislation, both public and private facial image datasets are increasingly scrutinized. Several datasets have been taken offline completely and some have been anonymized. However, it is unclear…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Sander R. Klomp , Matthew van Rijn , Rob G. J. Wijnhoven , Cees G. M. Snoek , Peter H. N. de With