English
Related papers

Related papers: A Nutritional Label for Rankings

200 papers

Ranking, recommendation, and retrieval systems are widely used in online platforms and other societal systems, including e-commerce, media-streaming, admissions, gig platforms, and hiring. In the recent past, a large "fair ranking" research…

Information Retrieval · Computer Science 2022-02-01 Gourab K Patro , Lorenzo Porcaro , Laura Mitchell , Qiuyue Zhang , Meike Zehlike , Nikhil Garg

The last decade has seen a revolution in the theory and application of machine learning and pattern recognition. Through these advancements, variable ranking has emerged as an active and growing research area and it is now beginning to be…

Computer Vision and Pattern Recognition · Computer Science 2017-06-20 Giorgio Roffo

Machine learning-driven rankings, where individuals (or items) are ranked in response to a query, mediate search exposure or attention in a variety of safety-critical settings. Thus, it is important to ensure that such rankings are fair.…

Machine Learning · Computer Science 2025-02-18 Aparna Balagopalan , Kai Wang , Olawale Salaudeen , Asia Biega , Marzyeh Ghassemi

Ranking systems have an unprecedented influence on how and what information people access, and their impact on our society is being analyzed from different perspectives, such as users' discrimination. A notable example is represented by…

Information Retrieval · Computer Science 2022-08-24 Guilherme Ramos , Ludovico Boratto , Mirko Marras

Ranking is a natural and ubiquitous way to facilitate decision-making in various applications. However, different rankings are often used for the same set of entities, with each ranking method placing emphasis on different factors. These…

Human-Computer Interaction · Computer Science 2020-04-15 Abishek Puri , Bon Kyung Ku , Yong Wang , Huamin Qu

Recommendation algorithms typically build models based on historical user-item interactions (e.g., clicks, likes, or ratings) to provide a personalized ranked list of items. These interactions are often distributed unevenly over different…

Information Retrieval · Computer Science 2021-03-16 Ziwei Zhu , Jianling Wang , James Caverlee

Competition is ubiquitous in many complex biological, social, and technological systems, playing an integral role in the evolutionary dynamics of the systems. It is often useful to determine the dominance hierarchy or the rankings of the…

Physics and Society · Physics 2019-01-09 Seungkyu Shin , Sebastian E. Ahnert , Juyong Park

Entity rankings (e.g., institutions, journals) are a core component of academia and related industries. Existing approaches to institutional rankings have relied on a variety of data sources, and approaches to computing outcomes, but remain…

Digital Libraries · Computer Science 2025-04-08 Sean C. Rife , Joshua M. Nicholson , Beatriz Bosques , Domenic Rosati , Ashish Uppala , Igor A. Osipov

There has been great interest in fairness in machine learning, especially in relation to classification problems. In ranking-related problems, such as in online advertising, recommender systems, and HR automation, much work on fairness…

Machine Learning · Computer Science 2025-04-21 Andrii Kliachkin , Eleni Psaroudaki , Jakub Marecek , Dimitris Fotakis

World University rankings have become well-established tools that students, university managers and policy makers read and use. Each ranking claims to have a unique methodology capable of measuring the 'quality' of universities. The purpose…

Digital Libraries · Computer Science 2019-06-11 Nicolas Robinson-Garcia , Daniel Torres-Salinas , Enrique Herrera-Viedma , Domingo Docampo

When ranking big data observations such as colleges in the United States, diverse consumers reveal heterogeneous preferences. The objective of this paper is to sort out a linear ordering for these observations and to recommend strategies to…

Machine Learning · Statistics 2020-03-30 Xingwei Hu

Fairness of exposure is a commonly used notion of fairness for ranking systems. It is based on the idea that all items or item groups should get exposure proportional to the merit of the item or the collective merit of the items in the…

Information Retrieval · Computer Science 2022-05-26 Maria Heuss , Fatemeh Sarvi , Maarten de Rijke

Online learning to rank is a sequential decision-making problem where in each round the learning agent chooses a list of items and receives feedback in the form of clicks from the user. Many sample-efficient algorithms have been proposed…

Machine Learning · Statistics 2019-03-20 Tor Lattimore , Branislav Kveton , Shuai Li , Csaba Szepesvari

Ranking systems are ubiquitous in modern Internet services, including online marketplaces, social media, and search engines. Traditionally, ranking systems only focus on how to get better relevance estimation. When relevance estimation is…

Information Retrieval · Computer Science 2022-12-20 Tao Yang , Zhichao Xu , Zhenduo Wang , Anh Tran , Qingyao Ai

Ranks estimated from data are uncertain and this poses a challenge in many applications. However, estimated ranks are deterministic functions of estimated parameters, so the uncertainty in the ranks must be determined by the uncertainty in…

Methodology · Statistics 2023-06-22 Justin Rising

Rankings have become the primary interface in two-sided online markets. Many have noted that the rankings not only affect the satisfaction of the users (e.g., customers, listeners, employers, travelers), but that the position in the ranking…

Information Retrieval · Computer Science 2022-08-31 Yuta Saito , Thorsten Joachims

How to rank web pages, scientists and online resources has recently attracted increasing attention from both physicists and computer scientists. In this paper, we study the ranking problem of rating systems where users vote objects by…

Information Retrieval · Computer Science 2010-01-14 Luo-Luo Jiang , Matus Medo , Joseph R. Wakeling , Yi-Cheng Zhang , Tao Zhou

People are rated and ranked, towards algorithmic decision making in an increasing number of applications, typically based on machine learning. Research on how to incorporate fairness into such tasks has prevalently pursued the paradigm of…

Machine Learning · Computer Science 2019-02-07 Preethi Lahoti , Krishna P. Gummadi , Gerhard Weikum

Artificial intelligence (AI) systems built on incomplete or biased data will often exhibit problematic outcomes. Current methods of data analysis, particularly before model development, are costly and not standardized. The Dataset Nutrition…

Databases · Computer Science 2018-05-11 Sarah Holland , Ahmed Hosny , Sarah Newman , Joshua Joseph , Kasia Chmielinski

User-generated reviews serve as crucial references in shopper's decision-making process. Moreover, they improve product sales and validate the reputation of the website as a whole. Thus, it becomes important to design reviews ranking…

Information Retrieval · Computer Science 2020-09-08 Akhil Sai Peddireddy