English
Related papers

Related papers: New Insights into Metric Optimization for Ranking-…

200 papers

Item recommendation is the task of predicting a personalized ranking on a set of items (e.g. websites, movies, products). In this paper, we investigate the most common scenario with implicit feedback (e.g. clicks, purchases). There are many…

Information Retrieval · Computer Science 2012-05-14 Steffen Rendle , Christoph Freudenthaler , Zeno Gantner , Lars Schmidt-Thieme

Recent advances in neural networks have inspired people to design hybrid recommendation algorithms that can incorporate both (1) user-item interaction information and (2) content information including image, audio, and text. Despite their…

Machine Learning · Computer Science 2017-06-27 Ting Chen , Yizhou Sun , Yue Shi , Liangjie Hong

A choice of optimization objective is immensely pivotal in the design of a recommender system as it affects the general modeling process of a user's intent from previous interactions. Existing approaches mainly adhere to three categories of…

Machine Learning · Computer Science 2024-08-02 Hyunsoo Chung , Jungtaek Kim , Hyungeun Jo , Hyungwon Choi

Discovering relevant patterns for a particular user remains a challenging tasks in data mining. Several approaches have been proposed to learn user-specific pattern ranking functions. These approaches generalize well, but at the expense of…

Artificial Intelligence · Computer Science 2022-03-08 Nassim Belmecheri , Noureddine Aribi , Nadjib Lazaar , Yahia Lebbah , Samir Loudni

Sequential Recommender Systems (SRSs) are a popular type of recommender system that learns from a user's history to predict the next item they are likely to interact with. However, user interactions can be affected by noise stemming from…

Information Retrieval · Computer Science 2024-04-18 Andrea Bacciu , Federico Siciliano , Nicola Tonellotto , Fabrizio Silvestri

We analyze the unintended effects that recommender systems have on the preferences of users that they are learning. We consider a contextual multi-armed bandit recommendation algorithm that learns optimal product recommendations based on…

Machine Learning · Computer Science 2026-02-11 Prabhat Lankireddy , Jayakrishnan Nair , D Manjunath

Recent developments in Direct Preference Optimization (DPO) allow large language models (LLMs) to function as implicit ranking models by maximizing the margin between preferred and non-preferred responses. In practice, user feedback on such…

Machine Learning · Computer Science 2025-09-09 Junda Wu , Rohan Surana , Zhouhang Xie , Yiran Shen , Yu Xia , Tong Yu , Ryan A. Rossi , Prithviraj Ammanabrolu , Julian McAuley

Learning to Rank (LTR) algorithms are usually evaluated using Information Retrieval metrics like Normalised Discounted Cumulative Gain (NDCG) or Mean Average Precision. As these metrics rely on sorting predicted items' scores (and thus, on…

Information Retrieval · Computer Science 2021-05-25 Przemysław Pobrotyn , Radosław Białobrzeski

The goal of a next basket recommendation (NBR) system is to recommend items for the next basket for a user, based on the sequence of their prior baskets. Recently, a number of methods with complex modules have been proposed that claim…

Information Retrieval · Computer Science 2023-03-10 Ming Li , Sami Jullien , Mozhdeh Ariannezhad , Maarten de Rijke

Recommender systems play a crucial role in mitigating the problem of information overload by suggesting users' personalized items or services. The vast majority of traditional recommender systems consider the recommendation procedure as a…

Machine Learning · Computer Science 2019-06-28 Xiangyu Zhao , Liang Zhang , Long Xia , Zhuoye Ding , Dawei Yin , Jiliang Tang

Many real-world systems problems require reasoning about the long term consequences of actions taken to configure and manage the system. These problems with delayed and often sequentially aggregated reward, are often inherently…

Machine Learning · Computer Science 2019-09-06 Ameer Haj-Ali , Nesreen K. Ahmed , Ted Willke , Joseph Gonzalez , Krste Asanovic , Ion Stoica

The article discusses the concept of hyperparametric optimization of recommendation algorithms using an integral assessment that combines various performance indicators into a single consolidated criterion. This approach is opposed to…

Machine Learning · Computer Science 2025-08-29 Roman S. Kulshin , Anatoly A. Sidorov

Multi-behavior recommendation systems enhance effectiveness by leveraging auxiliary behaviors (such as page views and favorites) to address the limitations of traditional models that depend solely on sparse target behaviors like purchases.…

Information Retrieval · Computer Science 2024-08-23 Haojie Li , Zhiyong Cheng , Xu Yu , Jinhuan Liu , Guanfeng Liu , Junwei Du

Because researchers typically do not have the time or space to present more than a few evaluation metrics in any published study, it can be difficult to assess relative effectiveness of prior methods for unreported metrics when baselining a…

Information Retrieval · Computer Science 2018-02-02 Mucahid Kutlu , Vivek Khetan , Matthew Lease

In this paper, we analyse how learning is measured and optimized in Educational Recommender Systems (ERS). In particular, we examine the target metrics and evaluation methods used in the existing ERS research, with a particular focus on the…

Human-Computer Interaction · Computer Science 2024-07-16 Nursultan Askarbekuly , Ivan Luković

Offline evaluation is a popular approach to determine the best algorithm in terms of the chosen quality metric. However, if the chosen metric calculates something unexpected, this miscommunication can lead to poor decisions and wrong…

Information Retrieval · Computer Science 2022-06-28 Yan-Martin Tamm , Rinchin Damdinov , Alexey Vasilev

This paper focuses on the problem of finding a particular data recommendation strategy based on the user preferences and a system expected revenue. To this end, we formulate this problem as an optimization by designing the recommendation…

Information Theory · Computer Science 2024-12-20 Shanyun Liu , Yunquan Dong , Pingyi Fan , Rui She , Shuo Wan

Listwise learning-to-rank methods form a powerful class of ranking algorithms that are widely adopted in applications such as information retrieval. These algorithms learn to rank a set of items by optimizing a loss that is a function of…

Machine Learning · Computer Science 2021-02-08 Sebastian Bruch

In evaluation campaigns, participants often explore variations of popular, state-of-the-art baselines as a low-risk strategy to achieve competitive results. While effective, this can lead to local "hill climbing" rather than more radical…

Information Retrieval · Computer Science 2023-01-31 Mehmet Deniz Türkmen , Matthew Lease , Mucahid Kutlu

Personalized recommendation systems (RS) are extensively used in many services. Many of these are based on learning algorithms where the RS uses the recommendation history and the user response to learn an optimal strategy. Further, these…

Information Retrieval · Computer Science 2018-03-26 Rahul Meshram , D. Manjunath , Nikhil Karamchandani