English
Related papers

Related papers: Privacy-Preserving Debiasing using Data Augmentati…

200 papers

This dissertation explores the impact of bias in deep neural networks and presents methods for reducing its influence on model performance. The first part begins by categorizing and describing potential sources of bias and errors in data…

Machine Learning · Computer Science 2023-08-21 Agnieszka Mikołajczyk-Bareła

Differentially private training algorithms provide protection against one of the most popular attacks in machine learning: the membership inference attack. However, these privacy algorithms incur a loss of the model's classification…

Cryptography and Security · Computer Science 2021-10-13 Jiaxiang Liu , Simon Oya , Florian Kerschbaum

Machine learning models are vulnerable to adversarial attacks, including attacks that leak information about the model's training data. There has recently been an increase in interest about how to best address privacy concerns, especially…

Machine Learning · Computer Science 2024-05-30 Keltin Grimes , Collin Abidi , Cole Frank , Shannon Gallagher

Privacy attacks on machine learning models aim to identify the data that is used to train such models. Such attacks, traditionally, are studied on static models that are trained once and are accessible by the adversary. Motivated to meet…

Machine Learning · Computer Science 2022-02-09 Ji Gao , Sanjam Garg , Mohammad Mahmoody , Prashant Nalini Vasudevan

Fairness and privacy are two important values machine learning (ML) practitioners often seek to operationalize in models. Fairness aims to reduce model bias for social/demographic sub-groups. Privacy via differential privacy (DP)…

Machine Learning · Computer Science 2024-02-08 Sanjari Srivastava , Piotr Mardziel , Zhikhun Zhang , Archana Ahlawat , Anupam Datta , John C Mitchell

This paper surveys the landscape of security and data attacks on machine unlearning, with a focus on financial and e-commerce applications. We discuss key privacy threats such as Membership Inference Attacks and Data Reconstruction Attacks,…

Cryptography and Security · Computer Science 2024-10-02 Carl E. J. Brodzinski

Machine learning models are vulnerable to data inference attacks, such as membership inference and model inversion attacks. In these types of breaches, an adversary attempts to infer a data record's membership in a dataset or even…

Cryptography and Security · Computer Science 2022-03-15 Dayong Ye , Sheng Shen , Tianqing Zhu , Bo Liu , Wanlei Zhou

With the introduction of data protection and privacy regulations, it has become crucial to remove the lineage of data on demand from a machine learning (ML) model. In the last few years, there have been notable developments in machine…

Machine Learning · Computer Science 2023-06-01 Ayush K Tarun , Vikram S Chundawat , Murari Mandal , Mohan Kankanhalli

Gradient leakage attacks pose a significant threat to the privacy guarantees of federated learning. While distortion-based protection mechanisms are commonly employed to mitigate this issue, they often lead to notable performance…

Cryptography and Security · Computer Science 2024-12-19 Haoyang Li , Wei Chen , Xiaojin Zhang

Machine unlearning is an emerging technique that aims to remove the influence of specific data from trained models, thereby enhancing privacy protection. However, recent research has uncovered critical privacy vulnerabilities, showing that…

Cryptography and Security · Computer Science 2026-01-29 Lulu Xue , Shengshan Hu , Wei Lu , Ziqi Zhou , Yufei Song , Jianhong Cheng , Minghui Li , Yanjun Zhang , Leo Yu Zhang

When applying differential privacy to sensitive data, we can often improve performance using external information such as other sensitive data, public data, or human priors. We propose to use the learning-augmented algorithms (or algorithms…

Cryptography and Security · Computer Science 2023-05-09 Mikhail Khodak , Kareem Amin , Travis Dick , Sergei Vassilvitskii

Although federated learning improves privacy of training data by exchanging local gradients or parameters rather than raw data, the adversary still can leverage local gradients and parameters to obtain local training data by launching…

Machine Learning · Computer Science 2021-08-17 Xue Yang , Yan Feng , Weijun Fang , Jun Shao , Xiaohu Tang , Shu-Tao Xia , Rongxing Lu

Machine unlearning is motivated by desire for data autonomy: a person can request to have their data's influence removed from deployed models, and those models should be updated as if they were retrained without the person's data. We show…

Machine Learning · Computer Science 2024-05-31 Martin Bertran , Shuai Tang , Michael Kearns , Jamie Morgenstern , Aaron Roth , Zhiwei Steven Wu

Data augmentation has been widely applied as an effective methodology to improve generalization in particular when training deep neural networks. Recently, researchers proposed a few intensive data augmentation techniques, which indeed…

Machine Learning · Computer Science 2019-11-22 Zhuoxun He , Lingxi Xie , Xin Chen , Ya Zhang , Yanfeng Wang , Qi Tian

Data augmentation has proved extremely useful by increasing training data variance to alleviate overfitting and improve deep neural networks' generalization performance. In medical image analysis, a well-designed augmentation policy usually…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Yunhe Gao , Zhiqiang Tang , Mu Zhou , Dimitris Metaxas

The development of fair and ethical AI systems requires careful consideration of bias mitigation, an area often overlooked or ignored. In this study, we introduce a novel and efficient approach for addressing biases called Targeted Data…

Machine Learning · Computer Science 2023-08-23 Agnieszka Mikołajczyk-Bareła , Maria Ferlin , Michał Grochowski

Machine unlearning algorithms, designed for selective removal of training data from models, have emerged as a promising approach to growing privacy concerns. In this work, we expose a critical yet underexplored vulnerability in the…

Cryptography and Security · Computer Science 2024-10-15 Yangsibo Huang , Daogao Liu , Lynn Chua , Badih Ghazi , Pritish Kamath , Ravi Kumar , Pasin Manurangsi , Milad Nasr , Amer Sinha , Chiyuan Zhang

Smishing, which aims to illicitly obtain personal information from unsuspecting victims, holds significance due to its negative impacts on our society. In prior studies, as a tool to counteract smishing, machine learning (ML) has been…

Social and Information Networks · Computer Science 2024-11-07 Ho Sung Shim , Hyoungjun Park , Kyuhan Lee , Jang-Sun Park , Seonhye Kang

Federated Learning (FL) is a prominent framework that enables training a centralized model while securing user privacy by fusing local, decentralized models. In this setting, one major obstacle is data heterogeneity, i.e., each client…

Machine Learning · Computer Science 2022-06-22 Artur Back de Luca , Guojun Zhang , Xi Chen , Yaoliang Yu

Machine Unlearning (MU) has recently gained considerable attention due to its potential to achieve Safe AI by removing the influence of specific data from trained Machine Learning (ML) models. This process, known as knowledge removal,…

Cryptography and Security · Computer Science 2025-02-18 Ziyao Liu , Huanyi Ye , Chen Chen , Yongsen Zheng , Kwok-Yan Lam