English
Related papers

Related papers: InterFair: Debiasing with Natural Language Feedbac…

200 papers

Despite the impressive prediction ability, machine learning models show discrimination towards certain demographics and suffer from unfair prediction behaviors. To alleviate the discrimination, extensive studies focus on eliminating the…

Machine Learning · Computer Science 2023-07-11 Chia-Yuan Chang , Yu-Neng Chuang , Kwei-Herng Lai , Xiaotian Han , Xia Hu , Na Zou

There has been growing attention on fairness considerations recently, especially in the context of intelligent decision making systems. Explainable recommendation systems, in particular, may suffer from both explanation bias and performance…

Information Retrieval · Computer Science 2020-06-30 Zuohui Fu , Yikun Xian , Ruoyuan Gao , Jieyu Zhao , Qiaoying Huang , Yingqiang Ge , Shuyuan Xu , Shijie Geng , Chirag Shah , Yongfeng Zhang , Gerard de Melo

Biases in culture, gender, ethnicity, etc. have existed for decades and have affected many areas of human social interaction. These biases have been shown to impact machine learning (ML) models, and for natural language processing (NLP),…

Computation and Language · Computer Science 2022-09-21 Dhanasekar Sundararaman , Vivek Subramanian

Prioritizing fairness is of central importance in artificial intelligence (AI) systems, especially for those societal applications, e.g., hiring systems should recommend applicants equally from different demographic groups, and risk…

Machine Learning · Computer Science 2022-03-04 Zhibo Wang , Xiaowei Dong , Henry Xue , Zhifei Zhang , Weifeng Chiu , Tao Wei , Kui Ren

This paper presents fairlib, an open-source framework for assessing and improving classification fairness. It provides a systematic framework for quickly reproducing existing baseline models, developing new methods, evaluating models with…

Machine Learning · Computer Science 2022-05-05 Xudong Han , Aili Shen , Yitong Li , Lea Frermann , Timothy Baldwin , Trevor Cohn

People frequently interact with information retrieval (IR) systems, however, IR models exhibit biases and discrimination towards various demographics. The in-processing fair ranking methods provide a trade-offs between accuracy and fairness…

Information Retrieval · Computer Science 2022-05-20 Yuantong Li , Xiaokai Wei , Zijian Wang , Shen Wang , Parminder Bhatia , Xiaofei Ma , Andrew Arnold

Fair decisions require ignoring irrelevant, potentially biasing, information. To achieve this, decision-makers need to approximate what decision they would have made had they not known certain facts, such as the gender or race of a job…

Computation and Language · Computer Science 2026-01-22 Brian Christian , Matan Mazor

Biases in existing datasets used to train algorithmic decision rules can raise ethical and economic concerns due to the resulting disparate treatment of different groups. We propose an algorithm for sequentially debiasing such datasets…

Machine Learning · Computer Science 2023-01-11 Yifan Yang , Yang Liu , Parinaz Naghizadeh

Deep learning models, particularly Convolutional Neural Networks (CNNs), have demonstrated exceptional performance in diagnosing skin diseases, often outperforming dermatologists. However, they have also unveiled biases linked to specific…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Anshul Pundhir , Balasubramanian Raman , Pravendra Singh

When people interpret text, they rely on inferences that go beyond the observed language itself. Inspired by this observation, we introduce a method for the analysis of text that takes implicitly communicated content explicitly into…

Computation and Language · Computer Science 2025-02-25 Alexander Hoyle , Rupak Sarkar , Pranav Goel , Philip Resnik

NLU models often exploit biases to achieve high dataset-specific performance without properly learning the intended task. Recently proposed debiasing methods are shown to be effective in mitigating this tendency. However, these methods rely…

Computation and Language · Computer Science 2020-10-14 Prasetya Ajie Utama , Nafise Sadat Moosavi , Iryna Gurevych

Recommendation systems aim to predict users' feedback on items not exposed to them. Confounding bias arises due to the presence of unmeasured variables (e.g., the socio-economic status of a user) that can affect both a user's exposure and…

Machine Learning · Computer Science 2023-06-16 Qing Zhang , Xiaoying Zhang , Yang Liu , Hongning Wang , Min Gao , Jiheng Zhang , Ruocheng Guo

Existing model-based interactive recommendation systems are trained by querying a world model to capture the user preference, but learning the world model from historical logged data will easily suffer from bias issues such as popularity…

Information Retrieval · Computer Science 2024-02-27 Zijian Li , Ruichu Cai , Haiqin Huang , Sili Zhang , Yuguang Yan , Zhifeng Hao , Zhenghua Dong

Neural network architectures have been extensively employed in the fair representation learning setting, where the objective is to learn a new representation for a given vector which is independent of sensitive information. Various…

Machine Learning · Computer Science 2022-01-19 Mattia Cerrato , Marius Köppel , Alexander Segner , Stefan Kramer

Implicit feedback (e.g., clicks, dwell times, etc.) is an abundant source of data in human-interactive systems. While implicit feedback has many advantages (e.g., it is inexpensive to collect, user centric, and timely), its inherent biases…

Information Retrieval · Computer Science 2016-08-17 Thorsten Joachims , Adith Swaminathan , Tobias Schnabel

Powerful predictive AI systems have demonstrated great potential in augmenting human decision making. Recent empirical work has argued that the vision for optimal human-AI collaboration requires 'appropriate reliance' of humans on AI…

Artificial Intelligence · Computer Science 2024-09-24 Gaole He , Abri Bharos , Ujwal Gadiraju

Multimodal Large Language Models (MLLMs) already achieve state-of-the-art results across a wide range of tasks and modalities. To push their reasoning ability further, recent studies explore advanced prompting schemes and post-training…

Artificial Intelligence · Computer Science 2025-09-09 Zhenyu Pan , Yutong Zhang , Jianshu Zhang , Haoran Lu , Haozheng Luo , Yuwei Han , Philip S. Yu , Manling Li , Han Liu

Face Recognition (FR) has advanced significantly with the development of deep learning, achieving high accuracy in several applications. However, the lack of interpretability of these systems raises concerns about their accountability,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Ivan DeAndres-Tame , Muhammad Faisal , Ruben Tolosana , Rouqaiah Al-Refai , Ruben Vera-Rodriguez , Philipp Terhörst

A central goal of algorithmic fairness is to reduce bias in automated decision making. An unavoidable tension exists between accuracy gains obtained by using sensitive information (e.g., gender or ethnic group) as part of a statistical…

Machine Learning · Statistics 2020-02-03 Luca Oneto , Michele Donini , Amon Elders , Massimiliano Pontil

Mitigating bias in training on biased datasets is an important open problem. Several techniques have been proposed, however the typical evaluation regime is very limited, considering very narrow data conditions. For instance, the effect of…

Machine Learning · Computer Science 2022-10-18 Xudong Han , Aili Shen , Trevor Cohn , Timothy Baldwin , Lea Frermann