English
Related papers

Related papers: Statistical Discrimination in Ratings-Guided Marke…

200 papers

Ranking metrics are a family of metrics largely used to evaluate recommender systems. However they typically suffer from the fact the reward is affected by the order in which recommended items are displayed to the user. A classical way to…

Machine Learning · Statistics 2019-09-18 Alexandre Gilotte

Traditional approaches to ranking in web search follow the paradigm of rank-by-score: a learned function gives each query-URL combination an absolute score and URLs are ranked according to this score. This paradigm ensures that if the score…

Machine Learning · Computer Science 2012-07-03 Or Sheffet , Nina Mishra , Samuel Ieong

This PhD thesis investigates the societal impact of machine learning (ML). ML increasingly informs consequential decisions and recommendations, significantly affecting many aspects of our lives. As these data-driven systems are often…

Machine Learning · Computer Science 2025-10-29 Joachim Baumann

Machine learning-driven rankings, where individuals (or items) are ranked in response to a query, mediate search exposure or attention in a variety of safety-critical settings. Thus, it is important to ensure that such rankings are fair.…

Machine Learning · Computer Science 2025-02-18 Aparna Balagopalan , Kai Wang , Olawale Salaudeen , Asia Biega , Marzyeh Ghassemi

The unparalleled ability of machine learning algorithms to learn patterns from data also enables them to incorporate biases embedded within. A biased model can then make decisions that disproportionately harm certain groups in society. Much…

Machine Learning · Computer Science 2022-06-28 José Pombal , Pedro Saleiro , Mário A. T. Figueiredo , Pedro Bizarro

The creation of benchmarks to evaluate the safety of Large Language Models is one of the key activities within the trusted AI community. These benchmarks allow models to be compared for different aspects of safety such as toxicity, bias,…

Artificial Intelligence · Computer Science 2025-06-23 Lina Berrayana , Sean Rooney , Luis Garcés-Erice , Ioana Giurgiu

Most approaches in algorithmic fairness constrain machine learning methods so the resulting predictions satisfy one of several intuitive notions of fairness. While this may help private companies comply with non-discrimination laws or avoid…

Machine Learning · Statistics 2018-06-08 Matt J. Kusner , Chris Russell , Joshua R. Loftus , Ricardo Silva

Fairness in machine learning has been studied by many researchers. In particular, fairness in recommender systems has been investigated to ensure the recommendations meet certain criteria with respect to certain sensitive features such as…

Information Retrieval · Computer Science 2020-03-27 Himan Abdollahpouri , Robin Burke , Masoud Mansoury

Fairness metrics are used to assess discrimination and bias in decision-making processes across various domains, including machine learning models and human decision-makers in real-world applications. This involves calculating the…

Machine Learning · Computer Science 2024-11-05 Manh Khoi Duong , Stefan Conrad

Recent work has explored how to train machine learning models which do not discriminate against any subgroup of the population as determined by sensitive attributes such as gender or race. To avoid disparate treatment, sensitive attributes…

Machine Learning · Statistics 2018-09-06 Niki Kilbertus , Adrià Gascón , Matt J. Kusner , Michael Veale , Krishna P. Gummadi , Adrian Weller

Rankings on online platforms help their end-users find the relevant information -- people, news, media, and products -- quickly. Fair ranking tasks, which ask to rank a set of items to maximize utility subject to satisfying group-fairness…

Computers and Society · Computer Science 2023-06-22 Sruthi Gorantla , Anay Mehrotra , Amit Deshpande , Anand Louis

In the last years decision-focused learning framework, also known as predict-and-optimize, have received increasing attention. In this setting, the predictions of a machine learning model are used as estimated cost coefficients in the…

Machine Learning · Computer Science 2022-06-20 Jayanta Mandi , Víctor Bucarey , Maxime Mulamba , Tias Guns

Scoring systems, as a type of predictive model, have significant advantages in interpretability and transparency and facilitate quick decision-making. As such, scoring systems have been extensively used in a wide variety of industries such…

Machine Learning · Computer Science 2022-11-23 Yi Yang , Ying Wu , Mei Li , Xiangyu Chang , Yong Tan

When a model's performance differs across socially or culturally relevant groups--like race, gender, or the intersections of many such groups--it is often called "biased." While much of the work in algorithmic fairness over the last several…

Methodology · Statistics 2022-07-01 Kristian Lum , Yunfeng Zhang , Amanda Bower

Many set selection and ranking algorithms have recently been enhanced with diversity constraints that aim to explicitly increase representation of historically disadvantaged populations, or to improve the overall representativeness of the…

Artificial Intelligence · Computer Science 2019-06-06 Ke Yang , Vasilis Gkatzelis , Julia Stoyanovich

Our study revisits the problem of accuracy-fairness tradeoff in binary classification. We argue that comparison of non-discriminatory classifiers needs to account for different rates of positive predictions, otherwise conclusions about…

Machine Learning · Computer Science 2015-05-22 Indre Zliobaite

Search engines intentionally influence user behavior by picking and ranking the list of results. Users engage with the highest results both because of their prominent placement and because they are typically the most relevant documents.…

Information Retrieval · Computer Science 2022-07-14 Richard Demsyn-Jones

How reliably can we trust the scores obtained from social bias benchmarks as faithful indicators of problematic social biases in a given language model? In this work, we study this question by contrasting social biases with non-social…

Computation and Language · Computer Science 2023-06-21 Nikil Roashan Selvam , Sunipa Dev , Daniel Khashabi , Tushar Khot , Kai-Wei Chang

Algorithmic decision making systems are ubiquitous across a wide variety of online as well as offline services. These systems rely on complex learning methods and vast amounts of data to optimize the service functionality, satisfaction of…

Machine Learning · Statistics 2017-03-27 Muhammad Bilal Zafar , Isabel Valera , Manuel Gomez Rodriguez , Krishna P. Gummadi

Machine learning has grown in popularity to help assign resources and make decisions about users, which can result in discrimination. This includes hiring markets, where employers have increasingly been interested in using automated tools…

Computer Science and Game Theory · Computer Science 2024-12-20 Serafina Kamp , Benjamin Fish