English
Related papers

Related papers: On the Privacy Risks of Algorithmic Recourse

200 papers

Text-to-image generation models have recently attracted unprecedented attention as they unlatch imaginative applications in all areas of life. However, developing such models requires huge amounts of data that might contain…

Cryptography and Security · Computer Science 2022-10-04 Yixin Wu , Ning Yu , Zheng Li , Michael Backes , Yang Zhang

Privacy is a human right. It ensures that individuals are free to engage in discussions, participate in groups, and form relationships online or offline without fear of their data being inappropriately harvested, analyzed, or otherwise used…

Artificial Intelligence · Computer Science 2024-06-04 Keenan Jones , Fatima Zahrah , Jason R. C. Nurse

Tabular data typically contains private and important information; thus, precautions must be taken before they are shared with others. Although several methods (e.g., differential privacy and k-anonymity) have been proposed to prevent…

Cryptography and Security · Computer Science 2022-08-26 Jihyeon Hyeong , Jayoung Kim , Noseong Park , Sushil Jajodia

Black-box machine learning models are used in critical decision-making domains, giving rise to several calls for more algorithmic transparency. The drawback is that model explanations can leak information about the training data and the…

Machine Learning · Computer Science 2020-06-17 Neel Patel , Reza Shokri , Yair Zick

Deep learning has attracted broad interest in healthcare and medical communities. However, there has been little research into the privacy issues created by deep networks trained for medical applications. Recently developed inference attack…

Machine Learning · Computer Science 2020-11-03 Maoqiang Wu , Xinyue Zhang , Jiahao Ding , Hien Nguyen , Rong Yu , Miao Pan , Stephen T. Wong

We study how inherent randomness in the training process -- where each sample (or client in federated learning) contributes only to a randomly selected portion of training -- can be leveraged for privacy amplification. This includes (1)…

Machine Learning · Computer Science 2025-06-03 Andy Dong , Wei-Ning Chen , Ayfer Ozgur

Algorithmic recourse aims to provide actionable recommendations to individuals to obtain a more favourable outcome from an automated decision-making system. As it involves reasoning about interventions performed in the physical world,…

Machine Learning · Statistics 2021-06-23 Julius von Kügelgen , Nikita Agarwal , Jakob Zeitler , Afsaneh Mastouri , Bernhard Schölkopf

Federated learning has emerged as a promising paradigm for collaborative model training while preserving data privacy. However, recent studies have shown that it is vulnerable to various privacy attacks, such as data reconstruction attacks.…

Cryptography and Security · Computer Science 2024-07-25 Xiaojin Zhang , Wei Chen

Federated learning has quickly gained popularity with its promises of increased user privacy and efficiency. Previous works have shown that federated gradient updates contain information that can be used to approximately recover user data…

Machine Learning · Computer Science 2022-03-21 Liam Fowl , Jonas Geiping , Wojtek Czaja , Micah Goldblum , Tom Goldstein

Machine learning is increasingly used in the most diverse applications and domains, whether in healthcare, to predict pathologies, or in the financial sector to detect fraud. One of the linchpins for efficiency and accuracy in machine…

Machine Learning · Computer Science 2022-01-17 Tânia Carvalho , Nuno Moniz , Pedro Faria , Luís Antunes

Ratio statistics--such as relative risk and odds ratios--play a central role in hypothesis testing, model evaluation, and decision-making across many areas of machine learning, including causal inference and fairness analysis. However,…

Machine Learning · Statistics 2025-05-28 Tomer Shoham , Katrina Ligettt

In large-scale statistical learning, data collection and model fitting are moving increasingly toward peripheral devices---phones, watches, fitness trackers---away from centralized data collection. Concomitant with this rise in…

Machine Learning · Statistics 2019-06-04 Abhishek Bhowmick , John Duchi , Julien Freudiger , Gaurav Kapoor , Ryan Rogers

Generative machine learning models are being increasingly viewed as a way to share sensitive data between institutions. While there has been work on developing differentially private generative modeling approaches, these approaches…

Cryptography and Security · Computer Science 2022-10-13 Yixi Xu , Sumit Mukherjee , Xiyang Liu , Shruti Tople , Rahul Dodhia , Juan Lavista Ferres

Machine learning models trained on private datasets have been shown to leak their private data. While recent work has found that the average data point is rarely leaked, the outlier samples are frequently subject to memorization and,…

Machine Learning · Computer Science 2022-06-23 Nicholas Carlini , Matthew Jagielski , Chiyuan Zhang , Nicolas Papernot , Andreas Terzis , Florian Tramer

In contemporary edge computing systems, decentralized edge nodes aggregate unprocessed data and facilitate data analytics to uphold low transmission latency and real-time data processing capabilities. Recently, these edge nodes have evolved…

Cryptography and Security · Computer Science 2024-04-29 Kongyang Chen , Yi Lin , Hui Luo , Bing Mi , Yatie Xiao , Chao Ma , Jorge Sá Silva

We study how to communicate findings of Bayesian inference to third parties, while preserving the strong guarantee of differential privacy. Our main contributions are four different algorithms for private Bayesian inference on…

Artificial Intelligence · Computer Science 2015-12-23 Zuhe Zhang , Benjamin Rubinstein , Christos Dimitrakakis

Differential privacy is a strong notion for privacy that can be used to prove formal guarantees, in terms of a privacy budget, $\epsilon$, about how much information is leaked by a mechanism. However, implementations of privacy-preserving…

Machine Learning · Computer Science 2019-08-14 Bargav Jayaraman , David Evans

Personalized AI agents rely on access to a user's digital footprint, which often includes sensitive data from private emails, chats and purchase histories. Yet this access creates a fundamental societal and privacy risk: systems lacking…

Computation and Language · Computer Science 2026-01-01 Srija Mukhopadhyay , Sathwik Reddy , Shruthi Muthukumar , Jisun An , Ponnurangam Kumaraguru

In modern settings of data analysis, we may be running our algorithms on datasets that are sensitive in nature. However, classical machine learning and statistical algorithms were not designed with these risks in mind, and it has been…

Data Structures and Algorithms · Computer Science 2021-08-21 Huanyu Zhang

Training machine learning models on privacy-sensitive data has become a popular practice, driving innovation in ever-expanding fields. This has opened the door to new attacks that can have serious privacy implications. One such attack, the…

Cryptography and Security · Computer Science 2023-06-16 Thomas Humphries , Simon Oya , Lindsey Tulloch , Matthew Rafuse , Ian Goldberg , Urs Hengartner , Florian Kerschbaum