English
Related papers

Related papers: Evaluating Fairness in Argument Retrieval

200 papers

Although popularized AI fairness metrics, e.g., demographic parity, have uncovered bias in AI-assisted decision-making outcomes, they do not consider how much effort one has spent to get to where one is today in the input feature space.…

Artificial Intelligence · Computer Science 2025-09-12 Tin Trung Nguyen , Jiannan Xu , Zora Che , Phuong-Anh Nguyen-Le , Rushil Dandamudi , Donald Braman , Furong Huang , Hal Daumé , Zubin Jelveh

Algorithmic fairness has emerged as a central issue in ML, and it has become standard practice to adjust ML algorithms so that they will satisfy fairness requirements such as Equal Opportunity. In this paper we consider the effects of…

Machine Learning · Computer Science 2025-10-28 Ronen Gradwohl , Eilam Shapira , Moshe Tennenholtz

As recommender systems are being designed and deployed for an increasing number of socially-consequential applications, it has become important to consider what properties of fairness these systems exhibit. There has been considerable…

Information Retrieval · Computer Science 2020-09-08 Nasim Sonboli , Robin Burke , Nicholas Mattei , Farzad Eskandanian , Tian Gao

Argumentation is a process of evaluating and comparing a set of arguments. A way to compare them consists in using a ranking-based semantics which rank-order arguments from the most to the least acceptable ones. Recently, a number of such…

Artificial Intelligence · Computer Science 2016-02-03 Elise Bonzon , Jérôme Delobelle , Sébastien Konieczny , Nicolas Maudet

In last decades, legal case search has received more and more attention. Legal practitioners need to work or enhance their efficiency by means of class case search. In the process of searching, legal practitioners often need the search…

Information Retrieval · Computer Science 2023-01-31 Ruizhe Zhang , Qingyao Ai , Yueyue Wu , Yixiao Ma , Yiqun Liu

To study discrimination in automated decision-making systems, scholars have proposed several definitions of fairness, each expressing a different fair ideal. These definitions require practitioners to make complex decisions regarding which…

Computers and Society · Computer Science 2021-02-23 Kweku Kwegyir-Aggrey , Rebecca Santorella , Sarah M. Brown

Ranking algorithms play a pivotal role in decision-making processes across diverse domains, from search engines to job applications. When rankings directly impact individuals, ensuring fairness becomes essential, particularly for groups…

We present a new data-driven model of fairness that, unlike existing static definitions of individual or group fairness is guided by the unfairness complaints received by the system. Our model supports multiple fairness criteria and takes…

Machine Learning · Computer Science 2020-08-24 Pranjal Awasthi , Corinna Cortes , Yishay Mansour , Mehryar Mohri

Though recommender systems are defined by personalization, recent work has shown the importance of additional, beyond-accuracy objectives, such as fairness. Because users often expect their recommendations to be purely personalized, these…

Information Retrieval · Computer Science 2021-03-17 Nasim Sonboli , Jessie J. Smith , Florencia Cabral Berenfus , Robin Burke , Casey Fiesler

With the surge in user-generated textual information, there has been a recent increase in the use of summarization algorithms for providing an overview of the extensive content. Traditional metrics for evaluation of these algorithms (e.g.…

Information Retrieval · Computer Science 2021-02-03 Anurag Shandilya , Abhisek Dash , Abhijnan Chakraborty , Kripabandhu Ghosh , Saptarshi Ghosh

Recently, Large Language Models (LLMs) have demonstrated a superior ability to serve as ranking models. However, concerns have arisen as LLMs will exhibit discriminatory ranking behaviors based on users' sensitive attributes (\eg gender).…

Information Retrieval · Computer Science 2024-09-26 Chen Xu , Wenjie Wang , Yuxin Li , Liang Pang , Jun Xu , Tat-Seng Chua

Over the past decades, researchers had put lots of effort investigating ranking techniques used to rank query results retrieved during information retrieval, or to rank the recommended products in recommender systems. In this project, we…

Information Retrieval · Computer Science 2022-08-23 Jiashu Wu

With the recent trend of applying machine learning in every aspect of human life, it is important to incorporate fairness into the core of the predictive algorithms. We address the problem of predicting the quality of public speeches while…

Machine Learning · Computer Science 2019-11-27 Rupam Acharyya , Shouman Das , Ankani Chattoraj , Md. Iftekhar Tanveer

Online dating platforms have fundamentally transformed the formation of romantic relationships, with millions of users worldwide relying on algorithmic matching systems to find compatible partners. However, current recommendation systems in…

Information Retrieval · Computer Science 2026-01-29 Madhav Kotecha

Systems based on machine learning may exhibit discriminatory behavior based on sensitive characteristics such as gender, sex, religion, or race. In light of this, various notions of fairness and methods to quantify discrimination were…

Machine Learning · Computer Science 2024-12-23 Drago Plecko , Elias Bareinboim

People are rated and ranked, towards algorithmic decision making in an increasing number of applications, typically based on machine learning. Research on how to incorporate fairness into such tasks has prevalently pursued the paradigm of…

Machine Learning · Computer Science 2019-02-07 Preethi Lahoti , Krishna P. Gummadi , Gerhard Weikum

Large language models (LLMs) are increasingly being deployed in high-stakes applications like hiring, yet their potential for unfair decision-making remains understudied in generative and retrieval settings. In this work, we examine the…

Computation and Language · Computer Science 2025-09-05 Preethi Seshadri , Hongyu Chen , Sameer Singh , Seraphina Goldfarb-Tarrant

The applications of personalized recommender systems are rapidly expanding: encompassing social media, online shopping, search engine results, and more. These systems offer a more efficient way to navigate the vast array of items available.…

Information Retrieval · Computer Science 2023-09-22 Jennifer Chien , David Danks

Defining fairness in AI remains a persistent challenge, largely due to its deeply context-dependent nature and the lack of a universal definition. While numerous mathematical formulations of fairness exist, they sometimes conflict with one…

Computers and Society · Computer Science 2025-05-05 Kessia Nepomuceno , Fabio Petrillo

Recommender systems are gaining increasing and critical impacts on human and society since a growing number of users use them for information seeking and decision making. Therefore, it is crucial to address the potential unfairness problems…

Information Retrieval · Computer Science 2021-11-08 Yunqi Li , Hanxiong Chen , Shuyuan Xu , Yingqiang Ge , Yongfeng Zhang