English
Related papers

Related papers: Do Fairness Interventions Come at the Cost of Priv…

200 papers

A Membership Inference Attack (MIA) assesses how much a trained machine learning model reveals about its training data by determining whether specific query instances were included in the dataset. We classify existing MIAs into adaptive or…

Cryptography and Security · Computer Science 2025-09-09 Yuntao Du , Jiacheng Li , Yuetian Chen , Kaiyuan Zhang , Zhizhen Yuan , Hanshen Xiao , Bruno Ribeiro , Ninghui Li

Large Language Models (LLMs) embed sensitive, human-generated data, prompting the need for unlearning methods. Although certified unlearning offers strong privacy guarantees, its restrictive assumptions make it unsuitable for LLMs, giving…

Machine Learning · Computer Science 2025-06-03 Rongzhe Wei , Mufei Li , Mohsen Ghassemi , Eleonora Kreačić , Yifan Li , Xiang Yue , Bo Li , Vamsi K. Potluru , Pan Li , Eli Chien

In distributed learning settings, models are iteratively updated with shared gradients computed from potentially sensitive user data. While previous work has studied various privacy risks of sharing gradients, our paper aims to provide a…

Machine Learning · Computer Science 2024-09-02 Zhuohang Li , Andrew Lowy , Jing Liu , Toshiaki Koike-Akino , Kieran Parsons , Bradley Malin , Ye Wang

Optimizing prediction accuracy can come at the expense of fairness. Towards minimizing discrimination against a group, fair machine learning algorithms strive to equalize the behavior of a model across different groups, by imposing a…

Machine Learning · Statistics 2020-06-17 Hongyan Chang , Ta Duy Nguyen , Sasi Kumar Murakonda , Ehsan Kazemi , Reza Shokri

Recently, recommender systems have achieved promising performances and become one of the most widely used web applications. However, recommender systems are often trained on highly sensitive user data, thus potential data leakage from…

Cryptography and Security · Computer Science 2021-09-17 Minxing Zhang , Zhaochun Ren , Zihan Wang , Pengjie Ren , Zhumin Chen , Pengfei Hu , Yang Zhang

Diffusion models have recently gained significant attention in both academia and industry due to their impressive generative performance in terms of both sampling quality and distribution coverage. Accordingly, proposals are made for…

Machine Learning · Computer Science 2024-09-20 Xinjian Luo , Yangfan Jiang , Fei Wei , Yuncheng Wu , Xiaokui Xiao , Beng Chin Ooi

Graph Neural Networks (GNNs) have shown remarkable success in various graph-based learning tasks. However, recent studies have raised concerns about fairness and privacy issues in GNNs, highlighting the potential for biased or…

Machine Learning · Computer Science 2025-03-05 Bartlomiej Surma , Michael Backes , Yang Zhang

Fairness,the impartial treatment towards individuals or groups regardless of their inherent or acquired characteristics [20], is a critical challenge for the successful implementation of Artificial Intelligence (AI) in multiple fields like…

Neural and Evolutionary Computing · Computer Science 2025-05-19 Catalina M Jaramillo , Paul Squires , Julian Togelius

Speech technology has been increasingly deployed in various areas of daily life including sensitive domains such as healthcare and law enforcement. For these technologies to be effective, they must work reliably for all users while…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-06 Anna Leschanowsky , Sneha Das

Large language models (LLMs) are increasingly deployed in interactive and retrieval-augmented settings, raising significant privacy concerns. While attacks such as Membership Inference (MIA), Attribute Inference (AIA), Data Extraction…

Cryptography and Security · Computer Science 2026-05-05 Karima Makhlouf , Lamiaa Basyoni , Syed Khaderi , Gabriel Marquez , Peter Sotomango , Mahmoud Awawdah , Sami Zhioua

Most approaches in algorithmic fairness constrain machine learning methods so the resulting predictions satisfy one of several intuitive notions of fairness. While this may help private companies comply with non-discrimination laws or avoid…

Machine Learning · Statistics 2018-06-08 Matt J. Kusner , Chris Russell , Joshua R. Loftus , Ricardo Silva

Generative AI systems are quickly improving, now able to produce believable output in several modalities including images, text, and audio. However, this fast development has prompted increased scrutiny concerning user privacy and the use…

Cryptography and Security · Computer Science 2025-12-29 Kurtis Chow , Omar Samiullah , Vinesh Sridhar , Hewen Zhang

Artificial Intelligence (AI) models are now being utilized in all facets of our lives such as healthcare, education and employment. Since they are used in numerous sensitive environments and make decisions that can be life altering,…

Artificial Intelligence · Computer Science 2024-03-27 Tahsin Alamgir Kheya , Mohamed Reda Bouadjenek , Sunil Aryal

Traditional ranking algorithms are designed to retrieve the most relevant items for a user's query, but they often inherit biases from data that can unfairly disadvantage vulnerable groups. Fairness in information access systems (IAS) is…

Information Retrieval · Computer Science 2025-06-05 Thomas Jaenich , Alejandro Moreo , Alessandro Fabris , Graham McDonald , Andrea Esuli , Iadh Ounis , Fabrizio Sebastiani

This study investigates the trade-offs between fairness, privacy, and utility in image classification using machine learning (ML). Recent research suggests that generalization techniques can improve the balance between privacy and utility.…

Machine Learning · Computer Science 2024-12-17 Ahmad Hassanpour , Amir Zarei , Khawla Mallat , Anderson Santana de Oliveira , Bian Yang

Authentication systems are vulnerable to model inversion attacks where an adversary is able to approximate the inverse of a target machine learning model. Biometric models are a prime candidate for this type of attack. This is because…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Sohaib Ahmad , Benjamin Fuller , Kaleel Mahmood

Discrimination can occur when the underlying unbiased labels are overwritten by an agent with potential bias, resulting in biased datasets that unfairly harm specific groups and cause classifiers to inherit these biases. In this paper, we…

Machine Learning · Computer Science 2023-12-27 Yixuan Zhang , Boyu Li , Zenan Ling , Feng Zhou

Understanding and removing bias from the decisions made by machine learning models is essential to avoid discrimination against unprivileged groups. Despite recent progress in algorithmic fairness, there is still no clear answer as to which…

AI systems have been known to amplify biases in real-world data. Explanations may help human-AI teams address these biases for fairer decision-making. Typically, explanations focus on salient input features. If a model is biased against…

Artificial Intelligence · Computer Science 2024-04-10 Navita Goyal , Connor Baumler , Tin Nguyen , Hal Daumé

Federated learning (FL) has emerged as a promising privacy-aware paradigm that allows multiple clients to jointly train a model without sharing their private data. Recently, many studies have shown that FL is vulnerable to membership…

Cryptography and Security · Computer Science 2021-09-14 Hongsheng Hu , Zoran Salcic , Lichao Sun , Gillian Dobbie , Xuyun Zhang