English
Related papers

Related papers: Calibrating Explore-Exploit Trade-off for Fair Onl…

200 papers

Reinforcement learning (RL) often faces the challenges of uninformed search problems where the agent should explore without access to the domain knowledge such as characteristics of the environment or external rewards. To tackle these…

Machine Learning · Computer Science 2023-10-31 Daesol Cho , Seungjae Lee , H. Jin Kim

Modern NLP systems exhibit a range of biases, which a growing literature on model debiasing attempts to correct. However current progress is hampered by a plurality of definitions of bias, means of quantification, and oftentimes vague…

Computation and Language · Computer Science 2023-02-14 Xudong Han , Timothy Baldwin , Trevor Cohn

Online allocation problems with resource constraints have a rich history in operations research. In this paper, we introduce the \emph{regularized online allocation problem}, a variant that includes a non-linear regularizer acting on the…

Optimization and Control · Mathematics 2021-11-08 Santiago Balseiro , Haihao Lu , Vahab Mirrokni

There has been significant research in the last five years on ensuring the providers of items in a recommender system are treated fairly, particularly in terms of the exposure the system provides to their work through its results. However,…

Information Retrieval · Computer Science 2023-09-20 Amifa Raj , Michael D. Ekstrand

Optimizing ranking systems based on user interactions is a well-studied problem. State-of-the-art methods for optimizing ranking systems based on user interactions are divided into online approaches - that learn by directly interacting with…

Information Retrieval · Computer Science 2020-12-09 Harrie Oosterhuis , Maarten de Rijke

Evaluating retrieval-ranking systems is crucial for developing high-performing models. While online A/B testing is the gold standard, its high cost and risks to user experience require effective offline methods. However, relying on…

Information Retrieval · Computer Science 2025-04-08 Seyedeh Baharan Khatami , Sayan Chakraborty , Ruomeng Xu , Babak Salimi

Recommender systems are tasked to infer users' evolving preferences and rank items aligned with their intents, which calls for in-depth reasoning beyond pattern-based scoring. Recent efforts start to leverage large language models (LLMs)…

Information Retrieval · Computer Science 2026-02-16 Kehan Zheng , Deyao Hong , Qian Li , Jun Zhang , Huan Yu , Jie Jiang , Hongning Wang

Online dating platforms have gained widespread popularity as a means for individuals to seek potential romantic relationships. While recommender systems have been designed to improve the user experience in dating platforms by providing…

Information Retrieval · Computer Science 2024-02-21 Yuying Zhao , Yu Wang , Yi Zhang , Pamela Wisniewski , Charu Aggarwal , Tyler Derr

We explore the fairness issue that arises in recommender systems. Biased data due to inherent stereotypes of particular groups (e.g., male students' average rating on mathematics is often higher than that on humanities, and vice versa for…

Machine Learning · Computer Science 2022-10-13 Jaewoong Cho , Moonseok Choi , Changho Suh

Peer-to-peer (P2P) energy trading is becoming central to modern distribution systems as rooftop PV and home energy management systems become pervasive, yet most existing market and reinforcement learning designs emphasize efficiency or…

Systems and Control · Electrical Eng. & Systems 2025-08-27 Shrenik Jadhav , Birva Sevak , Srijita Das , Akhtar Hussain , Wencong Su , Van-Hai Bui

The upper confidence reinforcement learning (UCRL2) algorithm introduced in (Jaksch et al., 2010) is a popular method to perform regret minimization in unknown discrete Markov Decision Processes under the average-reward criterion. Despite…

Machine Learning · Computer Science 2021-04-14 Hippolyte Bourel , Odalric-Ambrym Maillard , Mohammad Sadegh Talebi

We study the problem of online dynamic pricing with two types of fairness constraints: a "procedural fairness" which requires the proposed prices to be equal in expectation among different groups, and a "substantive fairness" which requires…

Machine Learning · Computer Science 2022-09-27 Jianyu Xu , Dan Qiao , Yu-Xiang Wang

We present a framework for quantifying and mitigating algorithmic bias in mechanisms designed for ranking individuals, typically used as part of web-scale search and recommendation systems. We first propose complementary measures to…

Information Retrieval · Computer Science 2019-09-04 Sahin Cem Geyik , Stuart Ambler , Krishnaram Kenthapadi

In online reinforcement learning (online RL), balancing exploration and exploitation is crucial for finding an optimal policy in a sample-efficient way. To achieve this, existing sample-efficient online RL algorithms typically consist of…

Machine Learning · Computer Science 2023-10-26 Zhihan Liu , Miao Lu , Wei Xiong , Han Zhong , Hao Hu , Shenao Zhang , Sirui Zheng , Zhuoran Yang , Zhaoran Wang

Large-scale online recommendation systems must facilitate the allocation of a limited number of items among competing users while learning their preferences from user feedback. As a principled way of incorporating market constraints and…

Machine Learning · Computer Science 2022-12-15 Yigit Efe Erginbas , Soham Phade , Kannan Ramchandran

Online educational platforms are playing a primary role in mediating the success of individuals' careers. Therefore, while building overlying content recommendation services, it becomes essential to guarantee that learners are provided with…

Information Retrieval · Computer Science 2022-08-24 Mirko Marras , Ludovico Boratto , Guilherme Ramos , Gianni Fenu

We introduce a novel re-ranking model that aims to augment the functionality of standard search engines to support classroom search activities for children (ages 6 to 11). This model extends the known listwise learning-to-rank framework by…

Information Retrieval · Computer Science 2023-08-30 Garrett Allen , Katherine Landau Wright , Jerry Alan Fails , Casey Kennington , Maria Soledad Pera

Learning how to aggregate ranking lists has been an active research area for many years and its advances have played a vital role in many applications ranging from bioinformatics to internet commerce. The problem of discerning reliability…

Methodology · Statistics 2021-04-16 Wanchuang Zhu , Yingkai Jiang , Jun S. Liu , Ke Deng

We address the challenge of building domain-specific knowledge models for industrial use cases, where labelled data and taxonomic information is initially scarce. Our focus is on inductive link prediction models as a basis for practical…

Machine Learning · Computer Science 2023-01-03 Felix Hamann , Adrian Ulges , Maurice Falk

Large Language Models (LLMs) enhanced with Retrieval-Augmented Generation (RAG) have achieved substantial improvements in accuracy by grounding their responses in external documents that are relevant to the user's query. However, relatively…

Information Retrieval · Computer Science 2026-03-26 Mahdi Dehghan , Graham McDonald