English
Related papers

Related papers: Beyond Detection: Unveiling Fairness Vulnerabiliti…

200 papers

With the growing adoption of AI and machine learning systems in real-world applications, ensuring their fairness has become increasingly critical. The majority of the work in algorithmic fairness focus on assessing and improving the…

Machine Learning · Computer Science 2025-11-12 Eunice Chan , Hanghang Tong

Deep learning-based weather forecasting (DLWF) models have recently demonstrated significant performance gains over gold-standard physics-based simulation tools. However, these models are potentially vulnerable to adversarial attacks, which…

Machine Learning · Computer Science 2026-04-07 Yue Deng , Asadullah Hill Galib , Xin Lan , Jack Gunn , Pang-Ning Tan , Lifeng Luo

Methods for building fair predictors often involve tradeoffs between fairness and accuracy and between different fairness criteria, but the nature of these tradeoffs varies. Recent work seeks to characterize these tradeoffs in specific…

Machine Learning · Statistics 2021-09-02 Alan Mishler , Edward Kennedy

As the use of machine learning models has increased, numerous studies have aimed to enhance fairness. However, research on the intersection of fairness and explainability remains insufficient, leading to potential issues in gaining the…

Machine Learning · Computer Science 2025-01-22 Hyungjun Joo , Hyeonggeun Han , Sehwan Kim , Sangwoo Hong , Jungwoo Lee

Deep neural networks are vulnerable to adversarial examples, i.e., carefully-crafted inputs that mislead classification at test time. Recent defenses have been shown to improve adversarial robustness by detecting anomalous deviations from…

Machine Learning · Computer Science 2020-10-20 Francesco Crecchi , Marco Melis , Angelo Sotgiu , Davide Bacciu , Battista Biggio

Speaker recognition is increasingly used in several everyday applications including smart speakers, customer care centers and other speech-driven analytics. It is crucial to accurately evaluate and mitigate biases present in machine…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-18 Raghuveer Peri , Krishna Somandepalli , Shrikanth Narayanan

Although adversarial training (AT) has proven effective in enhancing the model's robustness, the recently revealed issue of fairness in robustness has not been well addressed, i.e. the robust accuracy varies significantly among different…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Yanghao Zhang , Tianle Zhang , Ronghui Mu , Xiaowei Huang , Wenjie Ruan

Fair classification aims to stress the classification models to achieve the equality (treatment or prediction quality) among different sensitive groups. However, fair classification can be under the risk of poisoning attacks that…

Machine Learning · Computer Science 2022-10-19 Han Xu , Xiaorui Liu , Yuxuan Wan , Jiliang Tang

Exploiting social media to spread hate has tremendously increased over the years. Lately, multi-modal hateful content such as memes has drawn relatively more traction than uni-modal content. Moreover, the availability of implicit content…

Computation and Language · Computer Science 2023-02-14 Piush Aggarwal , Pranit Chawla , Mithun Das , Punyajoy Saha , Binny Mathew , Torsten Zesch , Animesh Mukherjee

We study deceptive fairness attacks on graphs to answer the following question: How can we achieve poisoning attacks on a graph learning model to exacerbate the bias deceptively? We answer this question via a bi-level optimization problem…

Machine Learning · Computer Science 2023-10-25 Jian Kang , Yinglong Xia , Ross Maciejewski , Jiebo Luo , Hanghang Tong

Recent advancements in Artificial Intelligence, particularly in Large Language Models (LLMs), have transformed natural language processing by improving generative capabilities. However, detecting biases embedded within these models remains…

Computation and Language · Computer Science 2025-03-11 Suvendu Mohanty

In spite of the successful application in many fields, machine learning models today suffer from notorious problems like vulnerability to adversarial examples. Beyond falling into the cat-and-mouse game between adversarial attack and…

Artificial Intelligence · Computer Science 2022-07-06 Jitao Sang , Xian Zhao , Jiaming Zhang , Zhiyu Lin

Textual backdoor attacks are a kind of practical threat to NLP systems. By injecting a backdoor in the training phase, the adversary could control model predictions via predefined triggers. As various attack and defense models have been…

Machine Learning · Computer Science 2022-11-02 Ganqu Cui , Lifan Yuan , Bingxiang He , Yangyi Chen , Zhiyuan Liu , Maosong Sun

Current natural language processing (NLP) research tends to focus on only one or, less frequently, two dimensions - e.g., performance, privacy, fairness, or efficiency - at a time, which may lead to suboptimal conclusions and often…

Computation and Language · Computer Science 2024-05-06 Minh Duc Bui , Katharina von der Wense

An outlier detection method may be considered fair over specified sensitive attributes if the results of outlier detection are not skewed towards particular groups defined on such sensitive attributes. In this task, we consider, for the…

Machine Learning · Computer Science 2020-08-06 Deepak P , Savitha Sam Abraham

Adversarial examples have proven to threaten speaker identification systems, and several countermeasures against them have been proposed. In this paper, we propose a method to detect the presence of adversarial examples, i.e., a binary…

Sound · Computer Science 2024-03-01 Sonal Joshi , Thomas Thebaud , Jesús Villalba , Najim Dehak

With language models becoming increasingly ubiquitous, it has become essential to address their inequitable treatment of diverse demographic groups and factors. Most research on evaluating and mitigating fairness harms has been concentrated…

Computation and Language · Computer Science 2023-03-01 Krithika Ramesh , Sunayana Sitaram , Monojit Choudhury

In recent years, a growing body of work has emerged on how to learn machine learning models under fairness constraints, often expressed with respect to some sensitive attributes. In this work, we consider the setting in which an adversary…

Machine Learning · Computer Science 2022-09-07 Julien Ferry , Ulrich Aïvodji , Sébastien Gambs , Marie-José Huguet , Mohamed Siala

Machine learning models are increasingly used in critical applications but are mostly "black boxes" due to their lack of transparency. Local explanation approaches, such as LIME, address this issue by approximating the behavior of complex…

Machine Learning · Computer Science 2025-12-01 Krishna Khadka , Sunny Shree , Pujan Budhathoki , Yu Lei , Raghu Kacker , D. Richard Kuhn

Discrimination can occur when the underlying unbiased labels are overwritten by an agent with potential bias, resulting in biased datasets that unfairly harm specific groups and cause classifiers to inherit these biases. In this paper, we…

Machine Learning · Computer Science 2023-12-27 Yixuan Zhang , Boyu Li , Zenan Ling , Feng Zhou