English
Related papers

Related papers: On Measuring Fairness in Generative Models

200 papers

This work takes a critical stance on previous studies concerning fairness evaluation in Large Language Model (LLM)-based recommender systems, which have primarily assessed consumer fairness by comparing recommendation lists generated with…

Information Retrieval · Computer Science 2025-02-24 Yashar Deldjoo , Tommaso di Noia

This paper examines the issue of fairness in the estimation of graphical models (GMs), particularly Gaussian, Covariance, and Ising models. These models play a vital role in understanding complex relationships in high-dimensional data.…

Machine Learning · Computer Science 2024-11-11 Zhuoping Zhou , Davoud Ataee Tarzanagh , Bojian Hou , Qi Long , Li Shen

We study fairness in collaborative-filtering recommender systems, which are sensitive to discrimination that exists in historical data. Biased data can lead collaborative filtering methods to make unfair predictions against minority groups…

Computers and Society · Computer Science 2017-12-15 Sirui Yao , Bert Huang

Machine learning classifiers are widely used to make decisions with a major impact on people's lives (e.g. accepting or denying a loan, hiring decisions, etc). In such applications,the learned classifiers need to be both accurate and fair…

Machine Learning · Computer Science 2023-10-05 James Brookhouse , Alex Freitas

The presence of social biases in Natural Language Processing (NLP) and Information Retrieval (IR) systems is an ongoing challenge, which underlines the importance of developing robust approaches to identifying and evaluating such biases. In…

Information Retrieval · Computer Science 2025-06-30 Maryam Mousavian , Zahra Abbasiantaeb , Mohammad Aliannejadi , Fabio Crestani

We propose a new family of fairness definitions for classification problems that combine some of the best properties of both statistical and individual notions of fairness. We posit not only a distribution over individuals, but also a…

Machine Learning · Computer Science 2019-12-18 Michael Kearns , Aaron Roth , Saeed Sharifi-Malvajerdi

Fairness has been a critical issue that affects the adoption of deep learning models in real practice. To improve model fairness, many existing methods have been proposed and evaluated to be effective in their own contexts. However, there…

Machine Learning · Computer Science 2024-03-26 Junjie Yang , Jiajun Jiang , Zeyu Sun , Junjie Chen

As the decisions made or influenced by machine learning models increasingly impact our lives, it is crucial to detect, understand, and mitigate unfairness. But even simply determining what "unfairness" should mean in a given context is…

Machine Learning · Computer Science 2020-10-16 Tom Begley , Tobias Schwedes , Christopher Frye , Ilya Feige

Fair clustering is the process of grouping similar entities together, while satisfying a mathematically well-defined fairness metric as a constraint. Due to the practical challenges in precise model specification, the prescribed fairness…

Machine Learning · Statistics 2021-02-09 Sainyam Galhotra , Sandhya Saisubramanian , Shlomo Zilberstein

Machine learning software is being used in many applications (finance, hiring, admissions, criminal justice) having a huge social impact. But sometimes the behavior of this software is biased and it shows discrimination based on some…

Software Engineering · Computer Science 2020-08-31 Joymallya Chakraborty , Kewen Peng , Tim Menzies

We study fairness in collaborative-filtering recommender systems, which are sensitive to discrimination that exists in historical data. Biased data can lead collaborative-filtering methods to make unfair predictions for users from minority…

Information Retrieval · Computer Science 2017-12-04 Sirui Yao , Bert Huang

Fairness is a critical component of Trustworthy AI. In this paper, we focus on Machine Learning (ML) and the performance of model predictions when dealing with skin color. Unlike other sensitive attributes, the nature of skin color differs…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Kuniko Paxton , Koorosh Aslansefat , Dhavalkumar Thakker , Yiannis Papadopoulos

Fairness-aware learning involves designing algorithms that do not discriminate with respect to some sensitive feature (e.g., race or gender). Existing work on the problem operates under the assumption that the sensitive feature available in…

Machine Learning · Computer Science 2020-01-10 Alexandre Louis Lamy , Ziyuan Zhong , Aditya Krishna Menon , Nakul Verma

Retrieval-Augmented Generation (RAG) has recently gained significant attention for its enhanced ability to integrate external knowledge sources into open-domain question answering (QA) tasks. However, it remains unclear how these models…

Computation and Language · Computer Science 2025-03-28 Xuyang Wu , Shuowei Li , Hsin-Tai Wu , Zhiqiang Tao , Yi Fang

The increased use of Large Language Models (LLMs) in sensitive domains leads to growing interest in how their confidence scores correspond to fairness and bias. This study examines the alignment between LLM-predicted confidence and…

Computation and Language · Computer Science 2026-01-13 Ahmed Sabir , Markus Kängsepp , Rajesh Sharma

In medical image analysis, model predictions can be affected by sensitive attributes, such as race and gender, leading to fairness concerns and potential biases in diagnostic outcomes. To mitigate this, we present a causal modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Bowei Tian , Yexiao He , Meng Liu , Yucong Dai , Ziyao Wang , Shwai He , Guoheng Sun , Zheyu Shen , Wanghao Ye , Yongkai Wu , Ang Li

Disaggregated performance metrics across demographic groups are a hallmark of fairness assessments in computer vision. These metrics successfully incentivized performance improvements on person-centric tasks such as face analysis and are…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Melissa Hall , Bobbie Chern , Laura Gustafson , Denisse Ventura , Harshad Kulkarni , Candace Ross , Nicolas Usunier

The rapid advancement of AI technologies and their accelerated adoption in software development necessitates a systematic evaluation of their environmental impact alongside functional correctness. While prior studies have examined…

Software Engineering · Computer Science 2025-11-12 Mohammadjavad Mehditabar , Saurabhsingh Rajput , Antonio Mastropaolo , Tushar Sharma

Predictive artificial intelligence (AI) offers an opportunity to improve clinical practice and patient outcomes, but risks perpetuating biases if fairness is inadequately addressed. However, the definition of "fairness" remains unclear. We…

Fairness-aware classification is receiving increasing attention in the machine learning fields. Recently research proposes to formulate the fairness-aware classification as constrained optimization problems. However, several limitations…

Machine Learning · Computer Science 2018-09-14 Yongkai Wu , Lu Zhang , Xintao Wu