English
Related papers

Related papers: Fair Active Ranking from Pairwise Preferences

200 papers

Many online platforms, ranging from online retail stores to social media platforms, employ algorithms to optimize their offered assortment of items (e.g., products and contents). These algorithms often focus exclusively on achieving the…

Data Structures and Algorithms · Computer Science 2025-02-24 Qinyi Chen , Negin Golrezaei , Fransisca Susan

There is increasing attention to evaluating the fairness of search system ranking decisions. These metrics often consider the membership of items to particular groups, often identified using protected attributes such as gender or ethnicity.…

Information Retrieval · Computer Science 2021-08-12 Ömer Kırnap , Fernando Diaz , Asia Biega , Michael Ekstrand , Ben Carterette , Emine Yılmaz

We present pairwise fairness metrics for ranking models and regression models that form analogues of statistical fairness notions such as equal opportunity, equal accuracy, and statistical parity. Our pairwise formulation supports both…

Machine Learning · Computer Science 2020-01-08 Harikrishna Narasimhan , Andrew Cotter , Maya Gupta , Serena Wang

Ranking algorithms find extensive usage in diverse areas such as web search, employment, college admission, voting, etc. The related rank aggregation problem deals with combining multiple rankings into a single aggregate ranking. However,…

Data Structures and Algorithms · Computer Science 2023-08-22 Diptarka Chakraborty , Syamantak Das , Arindam Khan , Aditya Subramanian

The study of fair algorithms has become mainstream in machine learning and artificial intelligence due to its increasing demand in dealing with biases and discrimination. Along this line, researchers have considered fair versions of…

Data Structures and Algorithms · Computer Science 2023-01-11 Sayan Bandyapadhyay , Fedor V. Fomin , Tanmay Inamdar , Kirill Simonov

Online learning to rank (OL2R) has attracted great research interests in recent years, thanks to its advantages in avoiding expensive relevance labeling as required in offline supervised ranking model learning. Such a solution explores the…

Information Retrieval · Computer Science 2021-11-02 Yiling Jia , Hongning Wang

Ranking items by their probability of relevance has long been the goal of conventional ranking systems. While this maximizes traditional criteria of ranking performance, there is a growing understanding that it is an oversimplification in…

Information Retrieval · Computer Science 2021-09-14 Lequn Wang , Thorsten Joachims

In many real life situations, including job and loan applications, gatekeepers must make justified and fair real-time decisions about a person's fitness for a particular opportunity. In this paper, we aim to accomplish approximate group…

Machine Learning · Computer Science 2021-05-26 Yi Sun , Ivan Ramirez , Alfredo Cuesta-Infante , Kalyan Veeramachaneni

Intuitively, an ideal collaborative filtering (CF) model should learn from users' full rankings over all items to make optimal top-K recommendations. Due to the absence of such full rankings in practice, most CF models rely on pairwise loss…

Information Retrieval · Computer Science 2024-12-25 Yuhan Zhao , Rui Chen , Li Chen , Shuang Zhang , Qilong Han , Hongtao Song

Learning to rank is an effective recommendation approach since its introduction around 2010. Famous algorithms such as Bayesian Personalized Ranking and Collaborative Less is More Filtering have left deep impact in both academia and…

Information Retrieval · Computer Science 2022-12-21 Hao Wang

We consider the problem of active coarse ranking, where the goal is to sort items according to their means into clusters of pre-specified sizes, by adaptively sampling from their reward distributions. This setting is useful in many social…

Machine Learning · Computer Science 2018-02-21 Sumeet Katariya , Lalit Jain , Nandana Sengupta , James Evans , Robert Nowak

We consider sequential or active ranking of a set of n items based on noisy pairwise comparisons. Items are ranked according to the probability that a given item beats a randomly chosen item, and ranking refers to partitioning the items…

Machine Learning · Computer Science 2016-09-26 Reinhard Heckel , Nihar B. Shah , Kannan Ramchandran , Martin J. Wainwright

We consider the problem of identifying the defectives from a population of items via a non-adaptive group testing framework with a random pooling-matrix design. We analyze the sufficient number of tests needed for approximate set…

Information Theory · Computer Science 2024-12-03 Sameera Bharadwaja H. , Chandra R. Murthy

How should we decide which fairness criteria or definitions to adopt in machine learning systems? To answer this question, we must study the fairness preferences of actual users of machine learning systems. Stringent parity constraints on…

Artificial Intelligence · Computer Science 2020-12-09 Angie Peng , Jeff Naecker , Ben Hutchinson , Andrew Smart , Nyalleng Moorosi

Machine learning-driven rankings, where individuals (or items) are ranked in response to a query, mediate search exposure or attention in a variety of safety-critical settings. Thus, it is important to ensure that such rankings are fair.…

Machine Learning · Computer Science 2025-02-18 Aparna Balagopalan , Kai Wang , Olawale Salaudeen , Asia Biega , Marzyeh Ghassemi

Increasing concerns about disparate effects of AI have motivated a great deal of work on fair machine learning. Existing works mainly focus on independence- and separation-based measures (e.g., demographic parity, equality of opportunity,…

Machine Learning · Statistics 2022-06-07 Xianli Zeng , Edgar Dobriban , Guang Cheng

Traditional ranking algorithms are designed to retrieve the most relevant items for a user's query, but they often inherit biases from data that can unfairly disadvantage vulnerable groups. Fairness in information access systems (IAS) is…

Information Retrieval · Computer Science 2025-06-05 Thomas Jaenich , Alejandro Moreo , Alessandro Fabris , Graham McDonald , Andrea Esuli , Iadh Ounis , Fabrizio Sebastiani

In strategic classification, agents manipulate their features, at a cost, to receive a positive classification outcome from the learner's classifier. The goal of the learner in such settings is to learn a classifier that is robust to…

Machine Learning · Computer Science 2024-10-04 Emily Diana , Saeed Sharifi-Malvajerdi , Ali Vakilian

Ranking functions that are used in decision systems often produce disparate results for different populations because of bias in the underlying data. Addressing, and compensating for, these disparate outcomes is a critical problem for fair…

Machine Learning · Computer Science 2024-04-23 Abraham Gale , Amélie Marian

Ensuring fairness in algorithmic ranking systems is a critical challenge with significant societal implications for hiring, recommendations, web search, and data management. Standard methods for aggregating multiple preference orders into a…

Data Structures and Algorithms · Computer Science 2026-05-25 Diptarka Chakraborty , Arya Mazumdar , Barna Saha , Alvin Hong Yao Yan