English
Related papers

Related papers: Properties of Group Fairness Metrics for Rankings

200 papers

Ranked lists are frequently used by information retrieval (IR) systems to present results believed to be relevant to the users information need. Fairness is a relatively new but important aspect of these rankings to measure, joining a rich…

Information Retrieval · Computer Science 2022-01-11 Amifa Raj , Michael D. Ekstrand

There is increasing attention to evaluating the fairness of search system ranking decisions. These metrics often consider the membership of items to particular groups, often identified using protected attributes such as gender or ethnicity.…

Information Retrieval · Computer Science 2021-08-12 Ömer Kırnap , Fernando Diaz , Asia Biega , Michael Ekstrand , Ben Carterette , Emine Yılmaz

Group fairness metrics are an established way of assessing the fairness of prediction-based decision-making systems. However, these metrics are still insufficiently linked to philosophical theories, and their moral meaning is often unclear.…

Computers and Society · Computer Science 2023-05-03 Joachim Baumann , Corinna Hertweck , Michele Loi , Christoph Heitz

Confronted with the challenge of identifying the most suitable metric to validate the merits of newly proposed models, the decision-making process is anything but straightforward. Given that comparing rankings introduces its own set of…

Information Retrieval · Computer Science 2024-08-30 Chiara Balestra , Andreas Mayr , Emmanuel Müller

While the field of algorithmic fairness has brought forth many ways to measure and improve the fairness of machine learning models, these findings are still not widely used in practice. We suspect that one reason for this is that the field…

Computers and Society · Computer Science 2022-03-16 Corinna Hertweck , Christoph Heitz

Fairness in recommender systems (RSs) is commonly categorised into group fairness and individual fairness. However, there is no established scientific understanding of the relationship between the two fairness types, as prior work on both…

Information Retrieval · Computer Science 2025-09-01 Theresia Veronika Rampisela , Maria Maistro , Tuukka Ruotsalo , Falk Scholer , Christina Lioma

Fairness is an emerging and challenging topic in recommender systems. In recent years, various ways of evaluating and therefore improving fairness have emerged. In this study, we examine existing evaluation measures of fairness in…

Information Retrieval · Computer Science 2024-05-21 Theresia Veronika Rampisela , Maria Maistro , Tuukka Ruotsalo , Christina Lioma

Rankings are ubiquitous in the online world today. As we have transitioned from finding books in libraries to ranking products, jobs, job applicants, opinions and potential romantic partners, there is a substantial precedent that ranking…

Information Retrieval · Computer Science 2018-10-18 Ashudeep Singh , Thorsten Joachims

Rankings of people and items has been highly used in selection-making, match-making, and recommendation algorithms that have been deployed on ranging of platforms from employment websites to searching tools. The ranking position of a…

Social and Information Networks · Computer Science 2021-03-03 Akrati Saxena , George Fletcher , Mykola Pechenizkiy

There has been significant research in the last five years on ensuring the providers of items in a recommender system are treated fairly, particularly in terms of the exposure the system provides to their work through its results. However,…

Information Retrieval · Computer Science 2023-09-20 Amifa Raj , Michael D. Ekstrand

Society is increasingly relying on predictive models in fields like criminal justice, credit risk management, or hiring. To prevent such automated systems from discriminating against people belonging to certain groups, fairness measures…

Algorithmic fairness is receiving significant attention in the academic and broader literature due to the increasing use of predictive algorithms, including those based on artificial intelligence. One benefit of this trend is that algorithm…

Computers and Society · Computer Science 2020-01-28 Pratyush Garg , John Villasenor , Virginia Foggo

In this work, we introduce a novel metric for auditing group fairness in ranked lists. Our approach offers two benefits compared to the state of the art. First, we offer a blueprint for modeling of user attention. Rather than assuming a…

Computers and Society · Computer Science 2019-05-14 Piotr Sapiezynski , Wesley Zeng , Ronald E. Robertson , Alan Mislove , Christo Wilson

The Fairness, Accountability, and Transparency in Machine Learning (FAT-ML) literature proposes a varied set of group fairness metrics to measure discrimination against socio-demographic groups that are characterized by a protected feature,…

Machine Learning · Computer Science 2020-03-11 Marius Miron , Songül Tolan , Emilia Gómez , Carlos Castillo

Search and recommendation systems, such as search engines, recruiting tools, online marketplaces, news, and social media, output ranked lists of content, products, and sometimes, people. Credit ratings, standardized tests, risk assessments…

Information Retrieval · Computer Science 2021-02-19 Sruthi Gorantla , Amit Deshpande , Anand Louis

We study fairness in collaborative-filtering recommender systems, which are sensitive to discrimination that exists in historical data. Biased data can lead collaborative filtering methods to make unfair predictions against minority groups…

Computers and Society · Computer Science 2017-12-15 Sirui Yao , Bert Huang

We study critical systems that allocate scarce resources to satisfy basic needs, such as homeless services that provide housing. These systems often support communities disproportionately affected by systemic racial, gender, or other…

Computers and Society · Computer Science 2022-12-06 Nathanael Jo , Bill Tang , Kathryn Dullerud , Sina Aghaei , Eric Rice , Phebe Vayanos

Machine Learning or Artificial Intelligence algorithms have gained considerable scrutiny in recent times owing to their propensity towards imitating and amplifying existing prejudices in society. This has led to a niche but growing body of…

Machine Learning · Computer Science 2022-05-06 Avijit Ghosh , Lea Genuit , Mary Reagan

Prior research on exposure fairness in the context of recommender systems has focused mostly on disparities in the exposure of individual or groups of items to individual users of the system. The problem of how individual or groups of items…

Information Retrieval · Computer Science 2022-05-03 Haolun Wu , Bhaskar Mitra , Chen Ma , Fernando Diaz , Xue Liu

Many set selection and ranking algorithms have recently been enhanced with diversity constraints that aim to explicitly increase representation of historically disadvantaged populations, or to improve the overall representativeness of the…

Artificial Intelligence · Computer Science 2019-06-06 Ke Yang , Vasilis Gkatzelis , Julia Stoyanovich
‹ Prev 1 2 3 10 Next ›