English
Related papers

Related papers: On the Privacy Risks of Algorithmic Recourse

200 papers

We establish a simple connection between robust and differentially-private algorithms: private mechanisms which perform well with very high probability are automatically robust in the sense that they retain accuracy even if a constant…

Machine Learning · Statistics 2022-12-02 Kristian Georgiev , Samuel B. Hopkins

The field of artificial intelligence (AI) has experienced remarkable progress in recent years, driven by the widespread adoption of open-source machine learning models in both research and industry. Considering the resource-intensive nature…

Machine Learning · Computer Science 2023-08-21 Dominik Hintersdorf , Lukas Struppek , Kristian Kersting

Predictive machine learning models are becoming increasingly deployed in high-stakes contexts involving sensitive personal data; in these contexts, there is a trade-off between model explainability and data privacy. In this work, we push…

Cryptography and Security · Computer Science 2024-07-29 Catherine Huang , Martin Pawelczyk , Himabindu Lakkaraju

A Private Repetition algorithm takes as input a differentially private algorithm with constant success probability and boosts it to one that succeeds with high probability. These algorithms are closely related to private metaselection…

Cryptography and Security · Computer Science 2024-10-28 Kunal Talwar

Privacy attacks on Machine Learning (ML) models often focus on inferring the existence of particular data points in the training data. However, what the adversary really wants to know is if a particular individual's (subject's) data was…

Machine Learning · Computer Science 2023-06-05 Anshuman Suri , Pallika Kanani , Virendra J. Marathe , Daniel W. Peterson

Federated learning frameworks typically require collaborators to share their local gradient updates of a common model instead of sharing training data to preserve privacy. However, prior works on Gradient Leakage Attacks showed that private…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Jiahao Lu , Xi Sheryl Zhang , Tianli Zhao , Xiangyu He , Jian Cheng

Many commonly used learning algorithms work by iteratively updating an intermediate solution using one or a few data points in each iteration. Analysis of differential privacy for such algorithms often involves ensuring privacy of each step…

Machine Learning · Computer Science 2018-12-12 Vitaly Feldman , Ilya Mironov , Kunal Talwar , Abhradeep Thakurta

Machine learning based decision making systems are increasingly affecting humans. An individual can suffer an undesirable outcome under such decision making systems (e.g. denied credit) irrespective of whether the decision is fair or…

Machine Learning · Computer Science 2019-07-24 Shalmali Joshi , Oluwasanmi Koyejo , Warut Vijitbenjaronk , Been Kim , Joydeep Ghosh

Collaborative learning has gained great popularity due to its benefit of data privacy protection: participants can jointly train a Deep Learning model without sharing their training sets. However, recent works discovered that an adversary…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Wei Gao , Shangwei Guo , Tianwei Zhang , Han Qiu , Yonggang Wen , Yang Liu

The amount of personal data collected in our everyday interactions with connected devices offers great opportunities for innovative services fueled by machine learning, as well as raises serious concerns for the privacy of individuals. In…

Machine Learning · Computer Science 2018-03-28 Pierre Dellenbach , Aurélien Bellet , Jan Ramon

When applying differential privacy to sensitive data, we can often improve performance using external information such as other sensitive data, public data, or human priors. We propose to use the learning-augmented algorithms (or algorithms…

Cryptography and Security · Computer Science 2023-05-09 Mikhail Khodak , Kareem Amin , Travis Dick , Sergei Vassilvitskii

Credit risk modeling has permeated our everyday life. Most banks and financial companies use this technique to model their clients' trustworthiness. While machine learning is increasingly used in this field, the resulting large-scale…

Cryptography and Security · Computer Science 2020-10-07 Yuli Zheng , Zhenyu Wu , Ye Yuan , Tianlong Chen , Zhangyang Wang

With the growing use of machine learning (ML) models in critical domains such as finance and healthcare, the need to offer recourse for those adversely affected by the decisions of ML models has become more important; individuals ought to…

Machine Learning · Computer Science 2024-04-02 Haochen Wu , Shubham Sharma , Sunandita Patra , Sriram Gopalakrishnan

Local differential privacy is a widely studied restriction on distributed algorithms that collect aggregates about sensitive user data, and is now deployed in several large systems. We initiate a systematic study of a fundamental limitation…

Data Structures and Algorithms · Computer Science 2019-09-23 Albert Cheu , Adam Smith , Jonathan Ullman

Within the realm of privacy-preserving machine learning, empirical privacy defenses have been proposed as a solution to achieve satisfactory levels of training data privacy without a significant drop in model utility. Most existing defenses…

Cryptography and Security · Computer Science 2023-10-19 Caelin G. Kaplan , Chuan Xu , Othmane Marfoq , Giovanni Neglia , Anderson Santana de Oliveira

It is critical to understand the privacy and robustness vulnerabilities of machine learning models, as their implementation expands in scope. In membership inference attacks, adversaries can determine whether a particular set of data was…

Cryptography and Security · Computer Science 2019-11-06 Michael Lomnitz , Nina Lopatina , Paul Gamble , Zigfried Hampel-Arias , Lucas Tindall , Felipe A. Mejia , Maria Alejandra Barrios

We consider the problem of fitting a linear model to data held by individuals who are concerned about their privacy. Incentivizing most players to truthfully report their data to the analyst constrains our design to mechanisms that provide…

Computer Science and Game Theory · Computer Science 2015-06-12 Rachel Cummings , Stratis Ioannidis , Katrina Ligett

We propose a practical methodology to protect a user's private data, when he wishes to publicly release data that is correlated with his private data, in the hope of getting some utility. Our approach relies on a general statistical…

Cryptography and Security · Computer Science 2015-10-28 Salman Salamatian , Amy Zhang , Flavio du Pin Calmon , Sandilya Bhamidipati , Nadia Fawaz , Branislav Kveton , Pedro Oliveira , Nina Taft

Membership inference attacks (MIAs) pose a significant threat to the privacy of machine learning models and are widely used as tools for privacy assessment, auditing, and machine unlearning. While prior MIA research has primarily focused on…

Machine Learning · Computer Science 2025-07-04 Zhiqi Wang , Chengyu Zhang , Yuetian Chen , Nathalie Baracaldo , Swanand Kadhe , Lei Yu

The collection and availability of big data, combined with advances in pre-trained models (e.g. BERT), have revolutionized the predictive performance of natural language processing tasks. This allows corporations to provide machine learning…

Cryptography and Security · Computer Science 2022-11-01 Xuanli He , Chen Chen , Lingjuan Lyu , Qiongkai Xu