English
Related papers

Related papers: Optimize What You Evaluate With: A Simple Yet Effe…

200 papers

Learning to Rank (LTR) is one of the most widely used machine learning applications. It is a key component in platforms with profound societal impacts, including job search, healthcare information retrieval, and social media content feeds.…

Machine Learning · Computer Science 2024-02-09 My H. Dinh , James Kotary , Ferdinando Fioretto

Learning to rank with implicit feedback is one of the most important tasks in many real-world information systems where the objective is some specific utility, e.g., clicks and revenue. However, we point out that existing methods based on…

Information Retrieval · Computer Science 2020-11-03 Xinyi Dai , Jiawei Hou , Qing Liu , Yunjia Xi , Ruiming Tang , Weinan Zhang , Xiuqiang He , Jun Wang , Yong Yu

Optimising a ranking-based metric, such as Average Precision (AP), is notoriously challenging due to the fact that it is non-differentiable, and hence cannot be optimised directly using gradient-descent methods. To this end, we introduce an…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Andrew Brown , Weidi Xie , Vicky Kalogeiton , Andrew Zisserman

Recent developments in Direct Preference Optimization (DPO) allow large language models (LLMs) to function as implicit ranking models by maximizing the margin between preferred and non-preferred responses. In practice, user feedback on such…

Machine Learning · Computer Science 2025-09-09 Junda Wu , Rohan Surana , Zhouhang Xie , Yiran Shen , Yu Xia , Tong Yu , Ryan A. Rossi , Prithviraj Ammanabrolu , Julian McAuley

We propose a new model for supervised learning to rank. In our model, the relevance labels are assumed to follow a categorical distribution whose probabilities are constructed based on a scoring function. We optimize the training objective…

Machine Learning · Computer Science 2020-02-19 Siamak Zamani Dadaneh , Shahin Boluki , Mingyuan Zhou , Xiaoning Qian

Learning to rank (LTR) plays a crucial role in various Information Retrieval (IR) tasks. Although supervised LTR methods based on fine-grained relevance labels (e.g., document-level annotations) have achieved significant success, their…

Information Retrieval · Computer Science 2025-08-21 Yiteng Tu , Zhichao Xu , Tao Yang , Weihang Su , Yujia Zhou , Yiqun Liu , Fen Lin , Qin Liu , Qingyao Ai

Recommender systems are tasked to infer users' evolving preferences and rank items aligned with their intents, which calls for in-depth reasoning beyond pattern-based scoring. Recent efforts start to leverage large language models (LLMs)…

Information Retrieval · Computer Science 2026-02-16 Kehan Zheng , Deyao Hong , Qian Li , Jun Zhang , Huan Yu , Jie Jiang , Hongning Wang

The widely used retrieve-and-rerank pipeline faces two critical limitations: they are constrained by the initial retrieval quality of the top-k documents, and the growing computational demands of LLM-based rerankers restrict the number of…

Information Retrieval · Computer Science 2025-09-10 Haike Xu , Tong Chen

This paper concerns a deep learning approach to relevance ranking in information retrieval (IR). Existing deep IR models such as DSSM and CDSSM directly apply neural networks to generate ranking scores, without explicit understandings of…

Information Retrieval · Computer Science 2019-07-23 Liang Pang , Yanyan Lan , Jiafeng Guo , Jun Xu , Jingfang Xu , Xueqi Cheng

Learning-to-rank (LTR) is a set of supervised machine learning algorithms that aim at generating optimal ranking order over a list of items. A lot of ranking models have been studied during the past decades. And most of them treat each…

Information Retrieval · Computer Science 2020-06-09 RuiXing Wang , Kuan Fang , RiKang Zhou , Zhan Shen , LiWen Fan

Implicit feedback data, such as user clicks, is commonly used in learning-to-rank (LTR) systems because it is easy to collect and it often reflects user preferences. However, this data is prone to various biases, and training an LTR…

Information Retrieval · Computer Science 2026-01-30 Md Aminul Islam , Kathryn Vasilaky , Elena Zheleva

Most learning to rank research has assumed that the utility of different documents is independent, which results in learned ranking functions that return redundant results. The few approaches that avoid this have rather unsatisfyingly…

Machine Learning · Computer Science 2012-09-04 Aleksandrs Slivkins , Filip Radlinski , Sreenivas Gollapudi

Low-rank regularization (LRR) has been widely applied in various machine learning tasks, but the associated optimization is challenging. Directly optimizing the rank function under constraints is NP-hard in general. To overcome this…

Machine Learning · Computer Science 2025-05-22 Naiqi Li , Yuqiu Xie , Peiyuan Liu , Tao Dai , Yong Jiang , Shu-Tao Xia

Interpretable Learning to Rank (LtR) is an emerging field within the research area of explainable AI, aiming at developing intelligible and accurate predictive models. While most of the previous research efforts focus on creating post-hoc…

Information Retrieval · Computer Science 2022-06-02 Claudio Lucchese , Franco Maria Nardini , Salvatore Orlando , Raffaele Perego , Alberto Veneri

The importance of accurate recommender systems has been widely recognized by academia and industry. However, the recommendation quality is still rather low. Recently, a linear sparse and low-rank representation of the user-item matrix has…

Information Retrieval · Computer Science 2016-02-29 Zhao Kang , Qiang Cheng

The last decade has seen a revolution in the theory and application of machine learning and pattern recognition. Through these advancements, variable ranking has emerged as an active and growing research area and it is now beginning to be…

Computer Vision and Pattern Recognition · Computer Science 2017-06-20 Giorgio Roffo

Learning to rank has been intensively studied and widely applied in information retrieval. Typically, a global ranking function is learned from a set of labeled data, which can achieve good performance on average but may be suboptimal for…

Information Retrieval · Computer Science 2018-04-25 Qingyao Ai , Keping Bi , Jiafeng Guo , W. Bruce Croft

In order to find experts, different approaches build rankings of people, assuming that they are ranked by level of expertise, and use typical Information Retrieval (IR) measures to evaluate their effectiveness. However, we figured out that…

Information Retrieval · Computer Science 2016-03-17 Matthieu Vergne

Offline Reinforcement Learning (RL) aims to learn a near-optimal policy from a fixed dataset of transitions collected by another policy. This problem has attracted a lot of attention recently, but most existing methods with strong…

Machine Learning · Computer Science 2023-05-23 Germano Gabbianelli , Gergely Neu , Nneka Okolo , Matteo Papini

Web page ranking and collaborative filtering require the optimization of sophisticated performance measures. Current Support Vector approaches are unable to optimize them directly and focus on pairwise comparisons instead. We present a new…

Information Retrieval · Computer Science 2007-05-23 Quoc Le , Alexander Smola