English
Related papers

Related papers: Fairness Aware Reward Optimization

200 papers

Algorithmic decision making systems are ubiquitous across a wide variety of online as well as offline services. These systems rely on complex learning methods and vast amounts of data to optimize the service functionality, satisfaction of…

Machine Learning · Statistics 2017-03-27 Muhammad Bilal Zafar , Isabel Valera , Manuel Gomez Rodriguez , Krishna P. Gummadi

The learning-to-rank problem aims at ranking items to maximize exposure of those most relevant to a user query. A desirable property of such ranking systems is to guarantee some notion of fairness among specified item groups. While fairness…

Machine Learning · Computer Science 2021-11-23 James Kotary , Ferdinando Fioretto , Pascal Van Hentenryck , Ziwei Zhu

Fairness in machine learning (ML) has a critical importance for building trustworthy machine learning system as artificial intelligence (AI) systems increasingly impact various aspects of society, including healthcare decisions and legal…

Machine Learning · Computer Science 2025-06-19 Modar Sulaiman , Kallol Roy

Human preference alignment is essential to improve the interaction quality of large language models (LLMs). Existing alignment methods depend on manually annotated preference data to guide the LLM optimization directions. However,…

Computation and Language · Computer Science 2024-06-04 Pengyu Cheng , Yifan Yang , Jian Li , Yong Dai , Tianhao Hu , Peixin Cao , Nan Du , Xiaolong Li

Pre-trained foundation models can be adapted for specific tasks using Low-Rank Adaptation (LoRA). However, the fairness properties of these adapted classifiers remain underexplored. Existing fairness-aware fine-tuning methods rely on direct…

Machine Learning · Computer Science 2025-03-10 Parameswaran Kamalaruban , Mark Anderson , Stuart Burrell , Maeve Madigan , Piotr Skalski , David Sutton

Explicit and implicit bias clouds human judgement, leading to discriminatory treatment of minority groups. A fundamental goal of algorithmic fairness is to avoid the pitfalls in human judgement by learning policies that improve the overall…

Machine Learning · Computer Science 2020-11-02 Yuzi He , Keith Burghardt , Siyi Guo , Kristina Lerman

The use of algorithmic (learning-based) decision making in scenarios that affect human lives has motivated a number of recent studies to investigate such decision making systems for potential unfairness, such as discrimination against…

Machine Learning · Computer Science 2021-05-11 Junaid Ali , Muhammad Bilal Zafar , Adish Singla , Krishna P. Gummadi

Algorithmic fairness has gained prominence due to societal and regulatory concerns about biases in Machine Learning models. Common group fairness metrics like Equalized Odds for classification or Demographic Parity for both classification…

Machine Learning · Statistics 2023-11-01 François HU , Philipp Ratz , Arthur Charpentier

As the operations of autonomous systems generally affect simultaneously several users, it is crucial that their designs account for fairness considerations. In contrast to standard (deep) reinforcement learning (RL), we investigate the…

Artificial Intelligence · Computer Science 2020-08-19 Umer Siddique , Paul Weng , Matthieu Zimmer

Now that machine learning algorithms lie at the center of many resource allocation pipelines, computer scientists have been unwittingly cast as partial social planners. Given this state of affairs, important questions follow. What is the…

Machine Learning · Computer Science 2019-05-02 Lily Hu , Yiling Chen

Developing learning methods which do not discriminate subgroups in the population is a central goal of algorithmic fairness. One way to reach this goal is by modifying the data representation in order to meet certain fairness constraints.…

Machine Learning · Statistics 2020-02-03 Luca Oneto , Michele Donini , Andreas Maurer , Massimiliano Pontil

The rapid growth of data in the recent years has led to the development of complex learning algorithms that are often used to make decisions in real world. While the positive impact of the algorithms has been tremendous, there is a need to…

Machine Learning · Computer Science 2022-01-03 Ankit Kulshrestha , Ilya Safro

It has been shown that dimension reduction methods such as PCA may be inherently prone to unfairness and treat data from different sensitive groups such as race, color, sex, etc., unfairly. In pursuit of fairness-enhancing dimensionality…

Machine Learning · Computer Science 2020-03-10 Mohammad Mahdi Kamani , Farzin Haddadpour , Rana Forsati , Mehrdad Mahdavi

Fairness,the impartial treatment towards individuals or groups regardless of their inherent or acquired characteristics [20], is a critical challenge for the successful implementation of Artificial Intelligence (AI) in multiple fields like…

Neural and Evolutionary Computing · Computer Science 2025-05-19 Catalina M Jaramillo , Paul Squires , Julian Togelius

Ranking systems are the key components of modern Information Retrieval (IR) applications, such as search engines and recommender systems. Besides the ranking relevance to users, the exposure fairness to item providers has also been…

Information Retrieval · Computer Science 2023-08-22 Tao Yang , Zhichao Xu , Zhenduo Wang , Qingyao Ai

Model fairness is an essential element for Trustworthy AI. While many techniques for model fairness have been proposed, most of them assume that the training and deployment data distributions are identical, which is often not true in…

Machine Learning · Computer Science 2023-02-07 Yuji Roh , Kangwook Lee , Steven Euijong Whang , Changho Suh

People are rated and ranked, towards algorithmic decision making in an increasing number of applications, typically based on machine learning. Research on how to incorporate fairness into such tasks has prevalently pursued the paradigm of…

Machine Learning · Computer Science 2019-02-07 Preethi Lahoti , Krishna P. Gummadi , Gerhard Weikum

Large Language Models (LLMs) suffer from order bias, where their performance is affected by the arrangement order of input elements. This unfairness limits the model's applications in scenarios such as in-context learning and…

Machine Learning · Computer Science 2026-05-13 Xu Chu , Guanyu Wang , Zhijie Tan , Xinrong Chen , Ziyu Li , Tong Mo , Weiping Li

Recent advances in parameter-efficient fine-tuning methods, such as Low Rank Adaptation (LoRA), have gained significant attention for their ability to efficiently adapt large foundational models to various downstream tasks. These methods…

Artificial Intelligence · Computer Science 2024-10-24 Rohan Sukumaran , Aarash Feizi , Adriana Romero-Sorian , Golnoosh Farnadi

Despite the success of large-scale empirical risk minimization (ERM) at achieving high accuracy across a variety of machine learning tasks, fair ERM is hindered by the incompatibility of fairness constraints with stochastic optimization. We…

Machine Learning · Computer Science 2023-01-13 Andrew Lowy , Sina Baharlouei , Rakesh Pavan , Meisam Razaviyayn , Ahmad Beirami