English
Related papers

Related papers: Controlled Model Debiasing through Minimal and Int…

200 papers

Deep neural networks have achieved exceptional results across a range of applications. As the demand for efficient and sparse deep learning models escalates, the significance of model compression, particularly pruning, is increasingly…

Machine Learning · Computer Science 2025-04-01 Yucong Dai , Gen Li , Feng Luo , Xiaolong Ma , Yongkai Wu

The problem of bias persists in the deep learning community as models continue to provide disparate performance across different demographic subgroups. Therefore, several algorithms have been proposed to improve the fairness of deep models.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Puspita Majumdar , Surbhi Mittal , Saheb Chhabra , Mayank Vatsa , Richa Singh

In this paper, we introduce a novel post-processing algorithm that is both model-agnostic and does not require the sensitive attribute at test time. In addition, our algorithm is explicitly designed to enforce minimal changes between biased…

Machine Learning · Computer Science 2024-08-30 Federico Di Gennaro , Thibault Laugel , Vincent Grari , Xavier Renard , Marcin Detyniecki

Despite the rapid development and great success of machine learning models, extensive studies have exposed their disadvantage of inheriting latent discrimination and societal bias from the training data. This phenomenon hinders their…

Machine Learning · Computer Science 2021-12-30 Tianxiang Zhao , Enyan Dai , Kai Shu , Suhang Wang

Machine learning algorithms are now frequently used in sensitive contexts that substantially affect the course of human lives, such as credit lending or criminal justice. This is driven by the idea that `objective' machines base their…

Machine Learning · Computer Science 2019-01-17 Songül Tolan

As the use of artificial intelligence rapidly increases, the development of trustworthy artificial intelligence has become important. However, recent studies have shown that deep neural networks are susceptible to learn spurious…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Yooshin Cho , Hanbyel Cho , Janghyeon Lee , HyeongGwon Hong , Jaesung Ahn , Junmo Kim

Recommender systems are seen as an effective tool to address information overload, but it is widely known that the presence of various biases makes direct training on large-scale observational data result in sub-optimal prediction…

Information Retrieval · Computer Science 2023-04-19 Haoxuan Li , Yanghao Xiao , Chunyuan Zheng , Peng Wu

The goal of fairness in classification is to learn a classifier that does not discriminate against groups of individuals based on sensitive attributes, such as race and gender. One approach to designing fair algorithms is to use relaxations…

Machine Learning · Computer Science 2021-06-09 Kirtan Padh , Diego Antognini , Emma Lejal Glaude , Boi Faltings , Claudiu Musat

Ensuring fairness in image classification prevents models from perpetuating and amplifying bias. Concept bottleneck models (CBMs) map images to high-level, human-interpretable concepts before making predictions via a sparse, one-layer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Schrasing Tong , Antoine Salaun , Vincent Yuan , Annabel Adeyeri , Lalana Kagal

Large pre-trained language models contain societal biases and carry along these biases to downstream tasks. Current in-processing bias mitigation approaches (like adversarial training) impose debiasing by updating a model's parameters,…

Computation and Language · Computer Science 2023-06-21 Deepak Kumar , Oleg Lesota , George Zerveas , Daniel Cohen , Carsten Eickhoff , Markus Schedl , Navid Rekabsaz

As the decisions made or influenced by machine learning models increasingly impact our lives, it is crucial to detect, understand, and mitigate unfairness. But even simply determining what "unfairness" should mean in a given context is…

Machine Learning · Computer Science 2020-10-16 Tom Begley , Tobias Schwedes , Christopher Frye , Ilya Feige

As machine learning algorithms are increasingly deployed for high-impact automated decision making, ethical and increasingly also legal standards demand that they treat all individuals fairly, without discrimination based on their age,…

Machine Learning · Computer Science 2021-05-03 Maarten Buyl , Tijl De Bie

Debiasing methods in NLP models traditionally focus on isolating information related to a sensitive attribute (e.g., gender or race). We instead argue that a favorable debiasing method should use sensitive information 'fairly,' with…

Computation and Language · Computer Science 2023-10-24 Bodhisattwa Prasad Majumder , Zexue He , Julian McAuley

How can we control for latent discrimination in predictive models? How can we provably remove it? Such questions are at the heart of algorithmic fairness and its impacts on society. In this paper, we define a new operational fairness…

Machine Learning · Computer Science 2019-02-25 Soheil Ghili , Ehsan Kazemi , Amin Karbasi

The performance of algorithmic decision rules is largely dependent on the quality of training datasets available to them. Biases in these datasets can raise economic and ethical concerns due to the resulting algorithms' disparate treatment…

Machine Learning · Computer Science 2025-04-14 Yifan Yang , Yang Liu , Parinaz Naghizadeh

Machine learning models built on datasets containing discriminative instances attributed to various underlying factors result in biased and unfair outcomes. It's a well founded and intuitive fact that existing bias mitigation strategies…

Machine Learning · Computer Science 2022-10-25 Bhushan Chaudhari , Akash Agarwal , Tanmoy Bhowmik

We propose new tools for policy-makers to use when assessing and correcting fairness and bias in AI algorithms. The three tools are: - A new definition of fairness called "controlled fairness" with respect to choices of protected features…

Machine Learning · Computer Science 2020-07-10 Mingliang Chen , Aria Shahverdi , Sarah Anderson , Se Yong Park , Justin Zhang , Dana Dachman-Soled , Kristin Lauter , Min Wu

The popularity of machine learning has increased the risk of unfair models getting deployed in high-stake applications, such as justice system, drug/vaccination design, and medical diagnosis. Although there are effective methods to train…

Machine Learning · Computer Science 2022-07-14 Mohit Bajaj , Lingyang Chu , Vittorio Romaniello , Gursimran Singh , Jian Pei , Zirui Zhou , Lanjun Wang , Yong Zhang

Deep learning is increasingly being used in high-stake decision making applications that affect individual lives. However, deep learning models might exhibit algorithmic discrimination behaviors with respect to protected groups, potentially…

Machine Learning · Computer Science 2020-03-20 Mengnan Du , Fan Yang , Na Zou , Xia Hu

Algorithmic fairness has become an important machine learning problem, especially for mission-critical Web applications. This work presents a self-supervised model, called DualFair, that can debias sensitive attributes like gender and race…

Machine Learning · Computer Science 2023-03-16 Sungwon Han , Seungeon Lee , Fangzhao Wu , Sundong Kim , Chuhan Wu , Xiting Wang , Xing Xie , Meeyoung Cha