English
Related papers

Related papers: Evaluating Fairness in Argument Retrieval

200 papers

With the rapid growth in language processing applications, fairness has emerged as an important consideration in data-driven solutions. Although various fairness definitions have been explored in the recent literature, there is lack of…

Machine Learning · Computer Science 2022-03-17 Satyapriya Krishna , Rahul Gupta , Apurv Verma , Jwala Dhamala , Yada Pruksachatkun , Kai-Wei Chang

Academic search engines allow scientists to explore related work relevant to a given query. Often, the user is also aware of the "aspect" to retrieve a relevant document. In such cases, existing search engines can be used by expanding the…

Information Retrieval · Computer Science 2020-01-30 Prajna Upadhyay , Srikanta Bedathur , Tanmoy Chakraborty , Maya Ramanath

Recommender systems are one of the most widely used services on several online platforms to suggest potential items to the end-users. These services often use different machine learning techniques for which fairness is a concerning factor,…

Artificial Intelligence · Computer Science 2020-11-11 Aadi Swadipto Mondal , Rakesh Bal , Sayan Sinha , Gourab K Patro

Fairness in recommender systems (RSs) is commonly categorised into group fairness and individual fairness. However, there is no established scientific understanding of the relationship between the two fairness types, as prior work on both…

Information Retrieval · Computer Science 2025-09-01 Theresia Veronika Rampisela , Maria Maistro , Tuukka Ruotsalo , Falk Scholer , Christina Lioma

Candidate retrieval is a fundamental issue in recommendation system. Given user's recommendation request, relevant candidates need to be retrieved in realtime for subsequent ranking operations. Considering that the retrieval operation is…

Information Retrieval · Computer Science 2019-10-22 Zheng Liu , Yu Xing , Jianxun Lian , Defu Lian , Ziyao Li , Xing Xie

In this paper we propose a causal modeling approach to intersectional fairness, and a flexible, task-specific method for computing intersectionally fair rankings. Rankings are used in many contexts, ranging from Web search results to…

Machine Learning · Computer Science 2020-06-17 Ke Yang , Joshua R. Loftus , Julia Stoyanovich

This paper proposes a theoretical framework which models the information provided by retrieval systems in terms of Information Theory. The proposed framework allows to formalize: (i) system effectiveness as an information theoretic…

Information Retrieval · Computer Science 2018-09-17 Enrique Amigó , Fernando Giner , Stefano Mizzaro , Damiano Spina

In the RAG paradigm, the information retrieval module provides context for generators by retrieving and ranking multiple documents to support the aggregation of evidence. However, existing ranking models are primarily optimized for…

Information Retrieval · Computer Science 2026-03-10 Yongqi Fan , Yuxiang Chu , Zhentao Xia , Xiaoyang Chen , Jie Liu , Haijin Liang , Jin Ma , Ben He , Yingfei Sun , Dezhi Ye , Tong Ruan

RAG systems have transformed how LLMs access external knowledge, but we find that current implementations exhibit a bias toward factual, objective content, as evidenced by existing benchmarks and datasets that prioritize objective…

Artificial Intelligence · Computer Science 2026-04-15 Aditya Agrawal , Alwarappan Nakkiran , Darshan Fofadiya , Alex Karlsson , Harsha Aduri

Recent research at the intersection of AI explainability and fairness has focused on how explanations can improve human-plus-AI task performance as assessed by fairness measures. We propose to characterize what constitutes an explanation…

Computation and Language · Computer Science 2023-10-24 Tin Nguyen , Jiannan Xu , Aayushi Roy , Hal Daumé , Marine Carpuat

In most recent studies, gender bias in document ranking is evaluated with the NFaiRR metric, which measures bias in a ranked list based on an aggregation over the unbiasedness scores of each ranked document. This perspective in measuring…

Computation and Language · Computer Science 2024-03-12 Amin Abolghasemi , Leif Azzopardi , Arian Askari , Maarten de Rijke , Suzan Verberne

Ensuring algorithmic fairness remains a significant challenge in machine learning, particularly as models are increasingly applied across diverse domains. While numerous fairness criteria exist, they often lack generalizability across…

Machine Learning · Computer Science 2025-11-04 Zhecheng Sheng , Jiawei Zhang , Enmao Diao

In this paper, we present a submission to the Touche lab's Task 2 on Argument Retrieval for Comparative Questions. Our team Katana supplies several approaches based on decision tree ensembles algorithms to rank comparative documents in…

Information Retrieval · Computer Science 2023-05-03 Viktoriia Chekalina , Alexander Panchenko

While machine learning and ranking-based systems are in widespread use for sensitive decision-making processes (e.g., determining job candidates, assigning credit scores), they are rife with concerns over unintended biases in their…

Machine Learning · Computer Science 2022-08-31 Aparajita Haldar , Teddy Cunningham , Hakan Ferhatosmanoglu

Algorithmic recourse aims to disclose the inner workings of the black-box decision process in situations where decisions have significant consequences, by providing recommendations to empower beneficiaries to achieve a more favorable…

Machine Learning · Computer Science 2023-02-14 Ahmad-Reza Ehyaei , Amir-Hossein Karimi , Bernhard Schölkopf , Setareh Maghsudi

It is often argued that one goal of explaining automated decision systems (ADS) is to facilitate positive perceptions (e.g., fairness or trustworthiness) of users towards such systems. This viewpoint, however, makes the implicit assumption…

Human-Computer Interaction · Computer Science 2021-08-17 Jakob Schoeffer , Niklas Kuehl

Many set selection and ranking algorithms have recently been enhanced with diversity constraints that aim to explicitly increase representation of historically disadvantaged populations, or to improve the overall representativeness of the…

Artificial Intelligence · Computer Science 2019-06-06 Ke Yang , Vasilis Gkatzelis , Julia Stoyanovich

Research on computational argumentation is currently being intensively investigated. The goal of this community is to find the best pro and con arguments for a user given topic either to form an opinion for oneself, or to persuade others to…

Computation and Language · Computer Science 2020-04-24 Stefan Ollinger , Lorik Dumani , Premtim Sahitaj , Ralph Bergmann , Ralf Schenkel

Ranking is at the core of Information Retrieval. Classic ranking optimization studies often treat ranking as a sorting problem with the assumption that the best performance of ranking would be achieved if we rank items according to their…

Information Retrieval · Computer Science 2023-04-18 Qingyao Ai , Xuanhui Wang , Michael Bendersky

Fairness has emerged as an important consideration in algorithmic decision-making. Unfairness occurs when an agent with higher merit obtains a worse outcome than an agent with lower merit. Our central point is that a primary cause of…

Machine Learning · Computer Science 2021-11-11 Ashudeep Singh , David Kempe , Thorsten Joachims