English
Related papers

Related papers: RewardRank: Optimizing True Learning-to-Rank Utili…

200 papers

Learning to Rank (LTR) is one of the most widely used machine learning applications. It is a key component in platforms with profound societal impacts, including job search, healthcare information retrieval, and social media content feeds.…

Machine Learning · Computer Science 2024-02-09 My H. Dinh , James Kotary , Ferdinando Fioretto

Learning-to-rank (LTR) has become a key technology in E-commerce applications. Most existing LTR approaches follow a supervised learning paradigm from offline labeled data collected from the online system. However, it has been noticed that…

Machine Learning · Computer Science 2021-01-01 Guangda Huzhang , Zhen-Jia Pang , Yongqing Gao , Yawen Liu , Weijie Shen , Wen-Ji Zhou , Qing Da , An-Xiang Zeng , Han Yu , Yang Yu , Zhi-Hua Zhou

Web applications where users are presented with a limited selection of items have long employed ranking models to put the most relevant results first. Any feedback received from users is typically assumed to reflect a relative judgement on…

Information Retrieval · Computer Science 2023-06-12 Maarten Buyl , Paul Missault , Pierre-Antoine Sondag

As a critical task for large-scale commercial recommender systems, reranking has shown the potential of improving recommendation results by uncovering mutual influence among items. Reranking rearranges items in the initial ranking lists…

Information Retrieval · Computer Science 2022-02-15 Yunjia Xi , Weiwen Liu , Xinyi Dai , Ruiming Tang , Weinan Zhang , Qing Liu , Xiuqiang He , Yong Yu

To support complex search tasks, where the initial information requirements are complex or may change during the search, a search engine must adapt the information delivery as the user's information requirements evolve. To support this…

Information Retrieval · Computer Science 2021-05-24 Jianghong Zhou , Eugene Agichtein

Ad ranking systems must simultaneously optimize multiple objectives including click-through rate (CTR), conversion rate (CVR), revenue, and user experience metrics. However, production systems face critical challenges: score scale…

Machine Learning · Computer Science 2026-02-24 Xikai Yang , Sebastian Sun , Yilin Li , Yue Xing , Ming Wang , Yang Wang

Existing online learning to rank (OL2R) solutions are limited to linear models, which are incompetent to capture possible non-linear relations between queries and documents. In this work, to unleash the power of representation learning in…

Information Retrieval · Computer Science 2022-01-19 Yiling Jia , Hongning Wang

Implicit feedback (e.g., click, dwell time) is an attractive source of training data for Learning-to-Rank, but its naive use leads to learning results that are distorted by presentation bias. For the special case of optimizing average rank…

Information Retrieval · Computer Science 2019-08-28 Aman Agarwal , Kenta Takatsu , Ivan Zaitsev , Thorsten Joachims

Most existing unbiased learning-to-rank (ULTR) approaches are based on the user examination hypothesis, which assumes that users will click a result only if it is both relevant and observed (typically modeled by position). However, in…

Information Retrieval · Computer Science 2025-02-19 Lulu Yu , Keping Bi , Jiafeng Guo , Shihao Liu , Dawei Yin , Xueqi Cheng

The goal of unbiased learning to rank (ULTR) is to leverage implicit user feedback for optimizing learning-to-rank systems. Among existing solutions, automatic ULTR algorithms that jointly learn user bias models (i.e., propensity models)…

Information Retrieval · Computer Science 2023-07-11 Dan Luo , Lixin Zou , Qingyao Ai , Zhiyu Chen , Chenliang Li , Dawei Yin , Brian D. Davison

Learning-to-rank (LTR) is a set of supervised machine learning algorithms that aim at generating optimal ranking order over a list of items. A lot of ranking models have been studied during the past decades. And most of them treat each…

Information Retrieval · Computer Science 2020-06-09 RuiXing Wang , Kuan Fang , RiKang Zhou , Zhan Shen , LiWen Fan

In this paper, we study the problem of safe online learning to re-rank, where user feedback is used to improve the quality of displayed lists. Learning to rank has traditionally been studied in two settings. In the offline setting, rankers…

Machine Learning · Computer Science 2019-07-02 Chang Li , Branislav Kveton , Tor Lattimore , Ilya Markov , Maarten de Rijke , Csaba Szepesvari , Masrour Zoghi

Click-based learning to rank (LTR) tackles the mismatch between click frequencies on items and their actual relevance. The approach of previous work has been to assume a model of click behavior and to subsequently introduce a method for…

Information Retrieval · Computer Science 2022-06-27 Harrie Oosterhuis

Improving user retention with reinforcement learning~(RL) has attracted increasing attention due to its significant importance in boosting user engagement. However, training the RL policy from scratch without hurting users' experience is…

Information Retrieval · Computer Science 2023-03-14 Kesen Zhao , Lixin Zou , Xiangyu Zhao , Maolin Wang , Dawei yin

Improved search quality enhances users' satisfaction, which directly impacts sales growth of an E-Commerce (E-Com) platform. Traditional Learning to Rank (LTR) algorithms require relevance judgments on products. In E-Com, getting such…

Information Retrieval · Computer Science 2020-07-10 Muhammad Umer Anwaar , Dmytro Rybalko , Martin Kleinsteuber

Unbiased learning to rank (ULTR) aims to mitigate various biases existing in user clicks, such as position bias, trust bias, presentation bias, and learn an effective ranker. In this paper, we introduce our winning approach for the…

Information Retrieval · Computer Science 2023-02-16 Lulu Yu , Yiting Wang , Xiaojie Sun , Keping Bi , Jiafeng Guo

Rewards serve as a measure of user satisfaction and act as a limiting factor in interactive recommender systems. In this research, we focus on the problem of learning to reward (LTR), which is fundamental to reinforcement learning. Previous…

Machine Learning · Computer Science 2023-10-31 Jialin Liu , Xinyan Su , Zeyu He , Xiangyu Zhao , Jun Li

Learning to rank (LTR) plays a crucial role in various Information Retrieval (IR) tasks. Although supervised LTR methods based on fine-grained relevance labels (e.g., document-level annotations) have achieved significant success, their…

Information Retrieval · Computer Science 2025-08-21 Yiteng Tu , Zhichao Xu , Tao Yang , Weihang Su , Yujia Zhou , Yiqun Liu , Fen Lin , Qin Liu , Qingyao Ai

The unbiased learning to rank (ULTR) problem has been greatly advanced by recent deep learning techniques and well-designed debias algorithms. However, promising results on the existing benchmark datasets may not be extended to the…

Artificial Intelligence · Computer Science 2022-09-21 Lixin Zou , Haitao Mao , Xiaokai Chu , Jiliang Tang , Wenwen Ye , Shuaiqiang Wang , Dawei Yin

Reinforcement learning (RL) requires access to a reward function that incentivizes the right behavior, but these are notoriously hard to specify for complex tasks. Preference-based RL provides an alternative: learning policies using a…

Machine Learning · Computer Science 2021-11-05 Kimin Lee , Laura Smith , Anca Dragan , Pieter Abbeel