English
Related papers

Related papers: BiasGuard: Guardrailing Fairness in Machine Learni…

200 papers

Fairness-aware machine learning has recently attracted various communities to mitigate discrimination against certain societal groups in data-driven tasks. For fair supervised learning, particularly in pre-processing, there have been two…

Machine Learning · Computer Science 2026-01-21 Jinwon Sohn , Guang Lin , Qifan Song

Increasing use of large language models (LLMs) demand performant guardrails to ensure the safety of inputs and outputs of LLMs. When these safeguards are trained on imbalanced data, they can learn the societal biases. We present a…

Computation and Language · Computer Science 2024-10-23 Olivia Sturman , Aparna Joshi , Bhaktipriya Radharapu , Piyush Kumar , Renee Shelby

Ensuring fairness in machine learning models is a critical challenge. Existing debiasing methods often compromise performance, rely on static correction strategies, and struggle with data sparsity, particularly within minority groups.…

Machine Learning · Computer Science 2025-10-23 Songqi Zhou , Zeyuan Liu , Benben Jiang

Multiple fairness constraints have been proposed in the literature, motivated by a range of concerns about how demographic groups might be treated unfairly by machine learning classifiers. In this work we consider a different motivation;…

Machine Learning · Computer Science 2024-08-23 Avrim Blum , Kevin Stangl

In this work, we propose an Automated Machine Learning (AutoML) system to search for models not only with good prediction accuracy but also fair. We first investigate the necessity and impact of unfairness mitigation in the AutoML context.…

Machine Learning · Computer Science 2022-11-28 Qingyun Wu , Chi Wang

Counterfactual fairness is an approach to AI fairness that tries to make decisions based on the outcomes that an individual with some kind of sensitive status would have had without this status. This paper proposes Double Machine Learning…

Machine Learning · Computer Science 2023-03-22 Patrick Rehill

When machine-learning algorithms are used in high-stakes decisions, we want to ensure that their deployment leads to fair and equitable outcomes. This concern has motivated a fast-growing literature that focuses on diagnosing and addressing…

Computers and Society · Computer Science 2023-09-26 Talia Gillis , Bryce McLaughlin , Jann Spiess

Despite numerous efforts to mitigate their biases, ML systems continue to harm already-marginalized people. While predominant ML approaches assume bias can be removed and fair models can be created, we show that these are not always…

Computation and Language · Computer Science 2025-04-02 Lucy Havens , Benjamin Bach , Melissa Terras , Beatrice Alex

Bias is known to be an impediment to fair decisions in many domains such as human resources, the public sector, health care etc. Recently, hope has been expressed that the use of machine learning methods for taking such decisions would…

Machine Learning · Computer Science 2019-09-05 Jindong Gu , Daniela Oelke

Motivated by the growing importance of reducing unfairness in ML predictions, Fair-ML researchers have presented an extensive suite of algorithmic 'fairness-enhancing' remedies. Most existing algorithms, however, are agnostic to the sources…

Machine Learning · Computer Science 2022-12-14 Nil-Jana Akpinar , Manish Nagireddy , Logan Stapleton , Hao-Fei Cheng , Haiyi Zhu , Steven Wu , Hoda Heidari

Unfair predictions of machine learning (ML) models impede their broad acceptance in real-world settings. Tackling this arduous challenge first necessitates defining what it means for an ML model to be fair. This has been addressed by the ML…

Machine Learning · Computer Science 2024-08-30 Selim Kuzucu , Jiaee Cheong , Hatice Gunes , Sinan Kalkan

A growing specter in the rise of machine learning is whether the decisions made by machine learning models are fair. While research is already underway to formalize a machine-learning concept of fairness and to design frameworks for…

Machine Learning · Computer Science 2020-09-28 Tao Zhang , Tianqing Zhu , Jing Li , Mengde Han , Wanlei Zhou , Philip S. Yu

Large Language Model-enhanced Recommender Systems (LLM-enhanced RSs) have emerged as a powerful approach to improving recommendation quality by leveraging LLMs to generate item representations. Despite these advancements, the integration of…

Information Retrieval · Computer Science 2025-07-08 Jiaming Zhang , Yuyuan Li , Yiqun Xu , Li Zhang , Xiaohua Feng , Zhifei Ren , Chaochao Chen

Agents backed by large language models (LLMs) increasingly rely on external tools drawn from marketplaces where multiple providers offer functionally equivalent options. This raises a critical fairness concern: systematic bias in tool…

Artificial Intelligence · Computer Science 2026-03-12 Thierry Blankenstein , Jialin Yu , Zixuan Li , Vassilis Plachouras , Sunando Sengupta , Philip Torr , Yarin Gal , Alasdair Paren , Adel Bibi

Timely and effective load shedding in power systems is critical for maintaining supply-demand balance and preventing cascading blackouts. To eliminate load shedding bias against specific regions in the system, optimization-based methods are…

Systems and Control · Electrical Eng. & Systems 2025-02-28 Yuqi Zhou , Joseph Severino , Sanjana Vijayshankar , Juliette Ugirumurera , Jibo Sanyal

The widespread adoption of ML systems across critical domains like hiring, finance, and healthcare raises growing concerns about their potential for discriminatory decision-making based on protected attributes. While efforts to ensure…

Artificial Intelligence · Computer Science 2024-06-27 Hussaini Mamman , Shuib Basri , Abdullateef Balogun , Abubakar Abdullahi Imam , Ganesh Kumar , Luiz Fernando Capretz

A significant level of stigma and inequality exists in mental healthcare, especially in under-served populations. Inequalities are reflected in the data collected for scientific purposes. When not properly accounted for, machine learning…

Fairness-aware machine learning has garnered significant attention in recent years because of extensive use of machine learning in sensitive applications like judiciary systems. Various heuristics, and optimization frameworks have been…

Machine Learning · Statistics 2023-04-28 Abhishek Roy , Prasant Mohapatra

Educational technologies nowadays increasingly use data and Machine Learning (ML) models. This gives the students, instructors, and administrators support and insights for the optimum policy. However, it is well acknowledged that ML models…

Machine Learning · Computer Science 2022-08-02 Modar Sulaiman , Kallol Roy

Machine learning best practice statements have proliferated, but there is a lack of consensus on what the standards should be. For fairness standards in particular, there is little guidance on how fairness might be achieved in practice.…

Computers and Society · Computer Science 2020-08-06 Jesse Russell