English
Related papers

Related papers: Model Debiasing via Gradient-based Explanation on …

200 papers

Confounding bias is a crucial problem when applying machine learning to practice, especially in clinical practice. We consider the problem of learning representations independent to multiple biases. In literature, this is mostly solved by…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Xianjing Liu , Bo Li , Esther Bron , Wiro Niessen , Eppo Wolvius , Gennady Roshchupkin

As large language models (LLMs) are increasingly deployed in real-world applications, ensuring their fair responses across demographics has become crucial. Despite many efforts, an ongoing challenge is hidden bias: LLMs appear fair under…

Computation and Language · Computer Science 2026-02-05 Kahee Lim , Soyeon Kim , Steven Euijong Whang

Fair machine learning methods seek to train models that balance model performance across demographic subgroups defined over sensitive attributes like race and gender. Although sensitive attributes are typically assumed to be known during…

Machine Learning · Computer Science 2024-03-22 Akshaj Kumar Veldanda , Ivan Brugere , Sanghamitra Dutta , Alan Mishler , Siddharth Garg

Existing bias mitigation methods for DNN models primarily work on learning debiased encoders. This process not only requires a lot of instance-level annotations for sensitive attributes, it also does not guarantee that all fairness…

Machine Learning · Computer Science 2021-10-28 Mengnan Du , Subhabrata Mukherjee , Guanchu Wang , Ruixiang Tang , Ahmed Hassan Awadallah , Xia Hu

Subset selection algorithms are ubiquitous in AI-driven applications, including, online recruiting portals and image search engines, so it is imperative that these tools are not discriminatory on the basis of protected attributes such as…

Computers and Society · Computer Science 2021-02-23 Anay Mehrotra , L. Elisa Celis

It is now well understood that machine learning models, trained on data without due care, often exhibit unfair and discriminatory behavior against certain populations. Traditional algorithmic fairness research has mainly focused on…

Machine Learning · Computer Science 2022-09-16 Rashidul Islam , Shimei Pan , James R. Foulds

As deep spatio-temporal neural networks are increasingly utilised in urban computing contexts, the deployment of such methods can have a direct impact on users of critical urban infrastructure, such as public transport, emergency services,…

Machine Learning · Computer Science 2025-08-12 Sichen Zhao , Wei Shao , Jeffrey Chan , Ziqi Xu , Flora Salim

Representation learning is increasingly employed to generate representations that are predictive across multiple downstream tasks. The development of representation learning algorithms that provide strong fairness guarantees is thus…

Machine Learning · Computer Science 2023-10-25 Yuhong Luo , Austin Hoag , Philip S. Thomas

Machine learning fairness concerns about the biases towards certain protected or sensitive group of people when addressing the target tasks. This paper studies the debiasing problem in the context of image classification tasks. Our data…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Yi Zhang , Jitao Sang

How do we learn from biased data? Historical datasets often reflect historical prejudices; sensitive or protected attributes may affect the observed treatments and outcomes. Classification algorithms tasked with predicting outcomes…

Machine Learning · Computer Science 2018-12-04 David Madras , Elliot Creager , Toniann Pitassi , Richard Zemel

Dataset bias is a critical challenge in machine learning since it often leads to a negative impact on a model due to the unintended decision rules captured by spurious correlations. Although existing works often handle this issue based on…

Machine Learning · Computer Science 2022-04-05 Seonguk Seo , Joon-Young Lee , Bohyung Han

Training machine learning models with the only accuracy as a final goal may promote prejudices and discriminatory behaviors embedded in the data. One solution is to learn latent representations that fulfill specific fairness metrics.…

Machine Learning · Computer Science 2021-07-28 Patrik Joslin Kenfack , Adil Mehmood Khan , Rasheed Hussain , S. M. Ahsan Kazmi

Fair data pre-processing is a widely used strategy for mitigating bias in machine learning. A promising line of research focuses on calibrating datasets to satisfy a designed fairness policy so that sensitive attributes influence outcomes…

Databases · Computer Science 2026-03-30 Ying Zheng , Yangfan Jiang , Kian-Lee Tan

Fairness-aware learning aims to mitigate discrimination against specific protected social groups (e.g., those categorized by gender, ethnicity, age) while minimizing predictive performance loss. Despite efforts to improve fairness in…

Machine Learning · Computer Science 2025-05-02 Kewen Peng , Yicheng Yang , Hao Zhuo

Language models frequently inherit societal biases from their training data. Numerous techniques have been proposed to mitigate these biases during both the pre-training and fine-tuning stages. However, fine-tuning a pre-trained debiased…

Computation and Language · Computer Science 2024-10-03 Shahed Masoudian , Markus Frohmann , Navid Rekabsaz , Markus Schedl

Despite remarkable success in diverse web-based applications, Graph Neural Networks(GNNs) inherit and further exacerbate historical discrimination and social stereotypes, which critically hinder their deployments in high-stake domains such…

Machine Learning · Computer Science 2025-01-28 Ying Song , Balaji Palanisamy

As the use of machine learning models has increased, numerous studies have aimed to enhance fairness. However, research on the intersection of fairness and explainability remains insufficient, leading to potential issues in gaining the…

Machine Learning · Computer Science 2025-01-22 Hyungjun Joo , Hyeonggeun Han , Sehwan Kim , Sangwoo Hong , Jungwoo Lee

Machine learning systems are increasingly being used to make impactful decisions such as loan applications and criminal justice risk assessments, and as such, ensuring fairness of these systems is critical. This is often challenging as the…

Machine Learning · Computer Science 2020-12-18 YooJung Choi , Meihua Dang , Guy Van den Broeck

We address the challenging problem of deep representation learning--the efficient adaption of a pre-trained deep network to different tasks. Specifically, we propose to explore gradient-based features. These features are gradients of the…

Machine Learning · Computer Science 2020-04-14 Fangzhou Mu , Yingyu Liang , Yin Li

Fair representation learning aims to encode invariant representation with respect to the protected attribute, such as gender or age. In this paper, we design Fairness-aware Disentangling Variational AutoEncoder (FD-VAE) for fair…

Machine Learning · Computer Science 2020-07-09 Sungho Park , Dohyung Kim , Sunhee Hwang , Hyeran Byun