English
Related papers

Related papers: Beyond Detection: Unveiling Fairness Vulnerabiliti…

200 papers

Clustering algorithms are widely used in many societal resource allocation applications, such as loan approvals and candidate recruitment, among others, and hence, biased or unfair model outputs can adversely impact individuals that rely on…

Machine Learning · Computer Science 2023-02-22 Anshuman Chhabra , Peizhao Li , Prasant Mohapatra , Hongfu Liu

Optimizing prediction accuracy can come at the expense of fairness. Towards minimizing discrimination against a group, fair machine learning algorithms strive to equalize the behavior of a model across different groups, by imposing a…

Machine Learning · Statistics 2020-06-17 Hongyan Chang , Ta Duy Nguyen , Sasi Kumar Murakonda , Ehsan Kazemi , Reza Shokri

Machine learning software is being used in many applications (finance, hiring, admissions, criminal justice) having a huge social impact. But sometimes the behavior of this software is biased and it shows discrimination based on some…

Software Engineering · Computer Science 2020-08-31 Joymallya Chakraborty , Kewen Peng , Tim Menzies

Although much work in NLP has focused on measuring and mitigating stereotypical bias in semantic spaces, research addressing bias in computational argumentation is still in its infancy. In this paper, we address this research gap and…

Computation and Language · Computer Science 2022-04-11 Carolin Holtermann , Anne Lauscher , Simone Paolo Ponzetto

Backdoor attacks, in which a model behaves maliciously when given an attacker-specified trigger, pose a major security risk for practitioners who depend on publicly released language models. As a countermeasure, backdoor detection methods…

Computation and Language · Computer Science 2025-09-23 Jun Yan , Wenjie Jacky Mo , Xiang Ren , Robin Jia

As the data-driven decision process becomes dominating for industrial applications, fairness-aware machine learning arouses great attention in various areas. This work proposes fairness penalties learned by neural networks with a simple…

Machine Learning · Statistics 2024-03-12 Jinwon Sohn , Qifan Song , Guang Lin

Machine learning is being integrated into a growing number of critical systems with far-reaching impacts on society. Unexpected behaviour and unfair decision processes are coming under increasing scrutiny due to this widespread use and its…

Machine Learning · Computer Science 2020-09-02 Pieter Delobelle , Paul Temple , Gilles Perrouin , Benoît Frénay , Patrick Heymans , Bettina Berendt

Social media platforms are deploying machine learning based offensive language classification systems to combat hateful, racist, and other forms of offensive speech at scale. However, despite their real-world deployment, we do not yet…

Computation and Language · Computer Science 2022-03-23 Jonathan Rusert , Zubair Shafiq , Padmini Srinivasan

Current backdoor attacks against federated learning (FL) strongly rely on universal triggers or semantic patterns, which can be easily detected and filtered by certain defense mechanisms such as norm clipping, comparing parameter…

Machine Learning · Computer Science 2023-10-02 Yanqi Qiao , Dazhuang Liu , Congwen Chen , Rui Wang , Kaitai Liang

As Artificial Intelligence (AI) is increasingly used in areas that significantly impact human lives, concerns about fairness and transparency have grown, especially regarding their impact on protected groups. Recently, the intersection of…

Artificial Intelligence · Computer Science 2025-05-05 Vasiliki Papanikou , Danae Pla Karidi , Evaggelia Pitoura , Emmanouil Panagiotou , Eirini Ntoutsi

Automatic detection of toxic language plays an essential role in protecting social media users, especially minority groups, from verbal abuse. However, biases toward some attributes, including gender, race, and dialect, exist in most…

Computation and Language · Computer Science 2021-06-15 Yung-Sung Chuang , Mingye Gao , Hongyin Luo , James Glass , Hung-yi Lee , Yun-Nung Chen , Shang-Wen Li

Target-group detection is the task of detecting which group(s) a piece of content is ``directed at or about''. Applications include targeted marketing, content recommendation, and group-specific content assessment. Key challenges include:…

Machine Learning · Computer Science 2026-05-05 Soumyajit Gupta , Maria De-Arteaga , Matthew Lease

In critical machine learning applications, ensuring fairness is essential to avoid perpetuating social inequities. In this work, we address the challenges of reducing bias and improving accuracy in data-scarce environments, where the cost…

Machine Learning · Computer Science 2023-12-15 Romain Camilleri , Andrew Wagenmaker , Jamie Morgenstern , Lalit Jain , Kevin Jamieson

With the increasing application of machine learning in high-stake decision-making problems, potential algorithmic bias towards people from certain social groups poses negative impacts on individuals and our society at large. In the…

Machine Learning · Computer Science 2022-06-22 Ziwei Wu , Jingrui He

Anomaly detection is a method for discovering unusual and suspicious behavior. In many real-world scenarios, the examined events can be directly linked to the actions of an adversary, such as attacks on computer networks or frauds in…

Machine Learning · Computer Science 2020-04-23 Olga Petrova , Karel Durkota , Galina Alperovich , Karel Horak , Michal Najman , Branislav Bosansky , Viliam Lisy

Face recognition (FR) systems continue to spread in our daily lives with an increasing demand for higher explainability and interpretability of FR systems that are mainly based on deep learning. While bias across demographic groups in FR…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Marco Huber , Meiling Fang , Fadi Boutros , Naser Damer

Numerous methods have been implemented that pursue fairness with respect to sensitive features by mitigating biases in machine learning. Yet, the problem settings that each method tackles vary significantly, including the stage of…

Machine Learning · Computer Science 2024-10-23 MaryBeth Defrance , Maarten Buyl , Tijl De Bie

Federated Learning (FL) is a technique that allows multiple parties to train a shared model collaboratively without disclosing their private data. It has become increasingly popular due to its distinct privacy advantages. However, FL models…

Machine Learning · Computer Science 2024-10-04 Syed Irfan Ali Meerza , Jian Liu

As advances in Deep Neural Networks (DNNs) demonstrate unprecedented levels of performance in many critical applications, their vulnerability to attacks is still an open question. We consider evasion attacks at testing time against Deep…

Cryptography and Security · Computer Science 2022-06-16 Alesia Chernikova , Alina Oprea

The growing integration of Large Language Models (LLMs) into critical societal domains has raised concerns about embedded biases that can perpetuate stereotypes and undermine fairness. Such biases may stem from historical inequalities in…

Computation and Language · Computer Science 2025-10-17 Riccardo Cantini , Alessio Orsino , Massimo Ruggiero , Domenico Talia