English
Related papers

Related papers: Towards Poisoning Fair Representations

200 papers

Machine learning systems are often deployed for making critical decisions like credit lending, hiring, etc. While making decisions, such systems often encode the user's demographic information (like gender, age) in their intermediate…

Machine Learning · Computer Science 2023-01-24 Somnath Basu Roy Chowdhury , Snigdha Chaturvedi

We study deceptive fairness attacks on graphs to answer the following question: How can we achieve poisoning attacks on a graph learning model to exacerbate the bias deceptively? We answer this question via a bi-level optimization problem…

Machine Learning · Computer Science 2023-10-25 Jian Kang , Yinglong Xia , Ross Maciejewski , Jiebo Luo , Hanghang Tong

Fair representation learning is an attractive approach that promises fairness of downstream predictors by encoding sensitive data. Unfortunately, recent work has shown that strong adversarial predictors can still exhibit unfairness by…

Machine Learning · Computer Science 2022-03-21 Mislav Balunović , Anian Ruoss , Martin Vechev

Recent studies show that Deep Reinforcement Learning (DRL) models are vulnerable to adversarial attacks, which attack DRL models by adding small perturbations to the observations. However, some attacks assume full availability of the victim…

Machine Learning · Computer Science 2022-02-18 Xinlei Pan , Chaowei Xiao , Warren He , Shuang Yang , Jian Peng , Mingjie Sun , Jinfeng Yi , Zijiang Yang , Mingyan Liu , Bo Li , Dawn Song

As data are increasingly being stored in different silos and societies becoming more aware of data privacy issues, the traditional centralized training of artificial intelligence (AI) models is facing efficiency and privacy challenges.…

Cryptography and Security · Computer Science 2022-01-20 Lingjuan Lyu , Han Yu , Xingjun Ma , Chen Chen , Lichao Sun , Jun Zhao , Qiang Yang , Philip S. Yu

As machine learning (ML) classifiers increasingly oversee the automated monitoring of network traffic, studying their resilience against adversarial attacks becomes critical. This paper focuses on poisoning attacks, specifically backdoor…

Cryptography and Security · Computer Science 2023-06-05 Giorgio Severi , Simona Boboila , Alina Oprea , John Holodnak , Kendra Kratkiewicz , Jason Matterer

Machine learning is being integrated into a growing number of critical systems with far-reaching impacts on society. Unexpected behaviour and unfair decision processes are coming under increasing scrutiny due to this widespread use and its…

Machine Learning · Computer Science 2020-09-02 Pieter Delobelle , Paul Temple , Gilles Perrouin , Benoît Frénay , Patrick Heymans , Bettina Berendt

Machine learning is susceptible to poisoning attacks, in which an attacker controls a small fraction of the training data and chooses that data with the goal of inducing some behavior unintended by the model developer in the trained model.…

Machine Learning · Computer Science 2023-11-21 Evan Rose , Fnu Suya , David Evans

Federated large language models (FedLLMs) enable powerful generative capabilities within wireless networks while preserving data privacy. Nonetheless, FedLLMs remain vulnerable to model poisoning attacks. This article first reviews recent…

Cryptography and Security · Computer Science 2025-08-01 Hanlin Cai , Haofan Dong , Houtianfu Wang , Kai Li , Ozgur B. Akan

Minimizing risk with fairness constraints is one of the popular approaches to learning a fair classifier. Recent works showed that this approach yields an unfair classifier if the training set is corrupted. In this work, we study the…

Machine Learning · Computer Science 2022-05-10 Changhun Jo , Jy-yong Sohn , Kangwook Lee

Causal representation learning (CRL) enhances machine learning models' robustness and generalizability by learning structural causal models associated with data-generating processes. We focus on a family of CRL methods that uses contrastive…

Machine Learning · Statistics 2025-03-17 Xiusi Li , Sékou-Oumar Kaba , Siamak Ravanbakhsh

Deep clustering has the potential to learn a strong representation and hence better clustering performance compared to traditional clustering methods such as $k$-means and spectral clustering. However, this strong representation learning…

Machine Learning · Computer Science 2021-06-01 Hongjing Zhang , Ian Davidson

Federated Rank Learning (FRL) is a promising Federated Learning (FL) paradigm designed to be resilient against model poisoning attacks due to its discrete, ranking-based update mechanism. Unlike traditional FL methods that rely on model…

Machine Learning · Computer Science 2026-01-22 Zhihao Chen , Zirui Gong , Jianting Ning , Yanjun Zhang , Leo Yu Zhang

Targeted data poisoning attacks manipulate model predictions on specific test samples by injecting malicious data into training. Yet existing evaluations report average attack success rates over randomly selected targets, obscuring true…

Machine Learning · Computer Science 2026-05-25 William Xu , Chenyu Zhang , Yihan Wang , Matthew Y. R. Yang , Zuoqiu Liu , Gautam Kamath , Yaoliang Yu , Yiwei Lu

Data poisoning has been proposed as a compelling defense against facial recognition models trained on Web-scraped pictures. Users can perturb images they post online, so that models will misclassify future (unperturbed) pictures. We…

Machine Learning · Computer Science 2022-03-15 Evani Radiya-Dixit , Sanghyun Hong , Nicholas Carlini , Florian Tramèr

Machine learning models have demonstrated promising performance in many areas. However, the concerns that they can be biased against specific demographic groups hinder their adoption in high-stake applications. Thus, it is essential to…

Machine Learning · Computer Science 2023-05-31 Canyu Chen , Yueqing Liang , Xiongxiao Xu , Shangyu Xie , Ashish Kundu , Ali Payani , Yuan Hong , Kai Shu

Federated learning distributes model training among a multitude of agents, who, guided by privacy concerns, perform training using their local data but share only model parameter updates, for iterative aggregation at the server. In this…

Machine Learning · Computer Science 2019-11-26 Arjun Nitin Bhagoji , Supriyo Chakraborty , Prateek Mittal , Seraphin Calo

Property inference attacks consider an adversary who has access to the trained model and tries to extract some global statistics of the training data. In this work, we study property inference in scenarios where the adversary can…

Machine Learning · Computer Science 2021-01-28 Melissa Chase , Esha Ghosh , Saeed Mahloujifar

Although deep learning (DL) models have shown great success in many medical image analysis tasks, deployment of the resulting models into real clinical contexts requires: (1) that they exhibit robustness and fairness across different…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Raghav Mehta , Changjian Shui , Tal Arbel

The label bias and selection bias are acknowledged as two reasons in data that will hinder the fairness of machine-learning outcomes. The label bias occurs when the labeling decision is disturbed by sensitive features, while the selection…

Machine Learning · Computer Science 2021-07-08 Yixuan Zhang , Feng Zhou , Zhidong Li , Yang Wang , Fang Chen