English
Related papers

Related papers: BadFair: Backdoored Fairness Attacks with Group-co…

200 papers

Whereas previous post-processing approaches for increasing the fairness of predictions of biased classifiers address only group fairness, we propose a method for increasing both individual and group fairness. Our novel framework includes an…

Despite the remarkable progress of diffusion models in image generation, recent studies reveal their vulnerability to backdoor attacks via covert visual or textual triggers. Although evolving defense mechanisms can detect most existing…

Cryptography and Security · Computer Science 2026-05-29 Jia Wu , Yu Pan , Junjun Yang , Yi Du

Anomaly detection (AD) has been widely studied for decades in many real-world applications, including fraud detection in finance, and intrusion detection for cybersecurity, etc. Due to the imbalanced nature between protected and unprotected…

Machine Learning · Computer Science 2024-09-18 Ziwei Wu , Lecheng Zheng , Yuancheng Yu , Ruizhong Qiu , John Birge , Jingrui He

Ensuring fairness in anomaly detection models has received much attention recently as many anomaly detection applications involve human beings. However, existing fair anomaly detection approaches mainly focus on association-based fairness…

Machine Learning · Computer Science 2023-03-07 Xiao Han , Lu Zhang , Yongkai Wu , Shuhan Yuan

This paper introduces marginal fairness, a new individual fairness notion for equitable decision-making in the presence of protected attributes such as gender, race, and religion. This criterion ensures that decisions based on generalized…

Machine Learning · Statistics 2025-05-27 Fei Huang , Silvana M. Pesenti

Deep learning models have consistently outperformed traditional machine learning models in various classification tasks, including image classification. As such, they have become increasingly prevalent in many real world applications…

Cryptography and Security · Computer Science 2018-08-31 Cong Liao , Haoti Zhong , Anna Squicciarini , Sencun Zhu , David Miller

Fairness-aware classification models have gained increasing attention in recent years as concerns grow on discrimination against some demographic groups. Most existing models require full knowledge of the sensitive features, which can be…

Machine Learning · Computer Science 2025-05-02 Kaiqi Jiang , Wenzhe Fan , Mao Li , Xinhua Zhang

As collaborative learning and the outsourcing of data collection become more common, malicious actors (or agents) which attempt to manipulate the learning process face an additional obstacle as they compete with each other. In backdoor…

Machine Learning · Computer Science 2021-10-12 Siddhartha Datta , Giulio Lovisotto , Ivan Martinovic , Nigel Shadbolt

As machine learning (ML) systems increasingly impact critical sectors such as hiring, financial risk assessments, and criminal justice, the imperative to ensure fairness has intensified due to potential negative implications. While much ML…

Machine Learning · Computer Science 2025-01-09 Nurit Cohen-Inger , Seffi Cohen , Neomi Rabaev , Lior Rokach , Bracha Shapira

Fairwashing refers to the risk that an unfair black-box model can be explained by a fairer model through post-hoc explanation manipulation. In this paper, we investigate the capability of fairwashing attacks by analyzing their…

Machine Learning · Computer Science 2021-11-04 Ulrich Aïvodji , Hiromi Arai , Sébastien Gambs , Satoshi Hara

Artificial intelligence systems, especially those using machine learning, are being deployed in domains from hiring to loan issuance in order to automate these complex decisions. Judging both the effectiveness and fairness of these AI…

Artificial Intelligence · Computer Science 2025-07-04 Disa Sariola , Patrick Button , Aron Culotta , Nicholas Mattei

Fair classification has become an important topic in machine learning research. While most bias mitigation strategies focus on neural networks, we noticed a lack of work on fair classifiers based on decision trees even though they have…

Machine Learning · Computer Science 2019-11-19 Vincent Grari , Boris Ruf , Sylvain Lamprier , Marcin Detyniecki

Diffusion models have recently gained significant attention in both academia and industry due to their impressive generative performance in terms of both sampling quality and distribution coverage. Accordingly, proposals are made for…

Machine Learning · Computer Science 2024-09-20 Xinjian Luo , Yangfan Jiang , Fei Wei , Yuncheng Wu , Xiaokui Xiao , Beng Chin Ooi

Recent research has identified discriminatory behavior of automated prediction algorithms towards groups identified on specific protected attributes (e.g., gender, ethnicity, age group, etc.). When deployed in real-world scenarios, such…

Machine Learning · Computer Science 2023-12-20 Anubha Pandey , Aditi Rai , Maneet Singh , Deepak Bhatt , Tanmoy Bhowmik

With the widespread application of super-resolution (SR) in various fields, researchers have begun to investigate its security. Previous studies have demonstrated that SR models can also be subjected to backdoor attacks through data…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Ji Guo , Xiaolei Wen , Wenbo Jiang , Cheng Huang , Jinjin Li , Hongwei Li

Due to its decentralized nature, Federated Learning (FL) lends itself to adversarial attacks in the form of backdoors during training. The goal of a backdoor is to corrupt the performance of the trained model on specific sub-tasks (e.g., by…

Pre-trained general-purpose language models have been a dominating component in enabling real-world natural language processing (NLP) applications. However, a pre-trained model with backdoor can be a severe threat to the applications. Most…

Computation and Language · Computer Science 2021-11-02 Lujia Shen , Shouling Ji , Xuhong Zhang , Jinfeng Li , Jing Chen , Jie Shi , Chengfang Fang , Jianwei Yin , Ting Wang

Algorithmic fairness and privacy are essential pillars of trustworthy machine learning. Fair machine learning aims at minimizing discrimination against protected groups by, for example, imposing a constraint on models to equalize their…

Machine Learning · Statistics 2021-04-08 Hongyan Chang , Reza Shokri

Most fair machine learning methods either highly rely on the sensitive information of the training samples or require a large modification on the target models, which hinders their practical application. To address this issue, we propose a…

Machine Learning · Computer Science 2023-12-27 Haonan Wang , Ziwei Wu , Jingrui He

Recent studies have pointed out that natural language processing (NLP) models are vulnerable to backdoor attacks. A backdoored model produces normal outputs on the clean samples while performing improperly on the texts with triggers that…

Computation and Language · Computer Science 2023-12-27 Xuan Sheng , Zhicheng Li , Zhaoyang Han , Xiangmao Chang , Piji Li