English
Related papers

Related papers: Rank-Preference Consistency as the Appropriate Met…

200 papers

Well-calibrated predictions of user preferences are essential for many applications. Since recommender systems typically select the top-N items for users, calibration for those top-N items, rather than for all items, is important. We show…

Information Retrieval · Computer Science 2024-08-22 Masahiro Sato

Conversational recommender systems (CRS) have shown great success in accurately capturing a user's current and detailed preference through the multi-round interaction cycle while effectively guiding users to a more personalized…

Information Retrieval · Computer Science 2022-08-23 Allen Lin , Jianling Wang , Ziwei Zhu , James Caverlee

Recommendation to groups of users is a challenging and currently only passingly studied task. Especially the evaluation aspect often appears ad-hoc and instead of truly evaluating on groups of users, synthesizes groups by merging individual…

Artificial Intelligence · Computer Science 2017-08-01 Zsolt Mezei , Carsten Eickhoff

A ranking is an ordered sequence of items, in which an item with higher ranking score is more preferred than the items with lower ranking scores. In many information systems, rankings are widely used to represent the preferences over a set…

Artificial Intelligence · Computer Science 2017-09-22 Zhiwei Lin , Yi Li , Xiaolian Guo

The selection of the best classification algorithm for a given dataset is a very widespread problem. It is also a complex one, in the sense it requires to make several important methodological choices. Among them, in this work we focus on…

Machine Learning · Computer Science 2012-07-18 Vincent Labatut , Hocine Cherifi

Recommender systems are one of the most pervasive applications of machine learning in industry, with many services using them to match users to products or information. As such it is important to ask: what are the possible fairness risks,…

Computers and Society · Computer Science 2019-03-12 Alex Beutel , Jilin Chen , Tulsee Doshi , Hai Qian , Li Wei , Yi Wu , Lukasz Heldt , Zhe Zhao , Lichan Hong , Ed H. Chi , Cristos Goodrow

Individual user fairness is commonly understood as treating similar users similarly. In Recommender Systems (RSs), several evaluation measures exist for quantifying individual user fairness. These measures evaluate fairness via either: (i)…

Computers and Society · Computer Science 2026-02-04 Theresia Veronika Rampisela , Maria Maistro , Tuukka Ruotsalo , Christina Lioma

In this paper, we examine the statistical soundness of comparative assessments within the field of recommender systems in terms of reliability and human uncertainty. From a controlled experiment, we get the insight that users provide…

Human-Computer Interaction · Computer Science 2017-06-28 Kevin Jasberg , Sergej Sizov

Recommendation systems (RSs) are increasingly used to guide job seekers on online platforms, yet the algorithms currently deployed are typically optimized for predictive objectives such as clicks, applications, or hires, rather than job…

Research and development on conversational recommender systems (CRSs) critically depends on sound and reliable evaluation methodologies. However, the interactive nature of these systems poses significant challenges for automatic evaluation.…

Information Retrieval · Computer Science 2025-10-08 Nolwenn Bernard , Krisztian Balog

The past two decades have witnessed the rapid development of personalized recommendation techniques. Despite significant progress made in both research and practice of recommender systems, to date, there is a lack of a widely-recognized…

Information Retrieval · Computer Science 2022-07-19 Jieming Zhu , Quanyu Dai , Liangcai Su , Rong Ma , Jinyang Liu , Guohao Cai , Xi Xiao , Rui Zhang

Recommender systems (RecSys) have become essential in modern society, driving user engagement and satisfaction across diverse online platforms. Most RecSys focuses on designing a powerful encoder to embed users and items into…

Information Retrieval · Computer Science 2025-03-25 Xi Wu , Dan Zhang , Chao Zhou , Liangwei Yang , Tianyu Lin , Jibing Gong

In academic research, recommender systems are often evaluated on benchmark datasets, without much consideration about the global timeline. Hence, we are unable to answer questions like: Do loyal users enjoy better recommendations than…

Information Retrieval · Computer Science 2022-07-05 Yitong Ji , Aixin Sun , Jie Zhang , Chenliang Li

Online user reviews describing various products and services are now abundant on the web. While the information conveyed through review texts and ratings is easily comprehensible, there is a wealth of hidden information in them that is not…

Information Retrieval · Computer Science 2016-04-20 Rahul Kamath , Masanao Ochi , Yutaka Matsuo

Confronted with the challenge of identifying the most suitable metric to validate the merits of newly proposed models, the decision-making process is anything but straightforward. Given that comparing rankings introduces its own set of…

Information Retrieval · Computer Science 2024-08-30 Chiara Balestra , Andreas Mayr , Emmanuel Müller

Following recent successes in exploiting both latent factor and word embedding models in recommendation, we propose a novel Regularized Multi-Embedding (RME) based recommendation model that simultaneously encapsulates the following ideas…

Information Retrieval · Computer Science 2018-09-05 Thanh Tran , Kyumin Lee , Yiming Liao , Dongwon Lee

In Recommender System (RS), explanations help users understand why items are recommended and can enhance a system's transparency, persuasiveness, engagement, and trust, which are known as explanation goals. However, evaluating the…

Information Retrieval · Computer Science 2025-12-17 André Levi Zanon , Marcelo Garcia Manzato , Leonardo Rocha

Personalized alignment from preference data has focused primarily on improving personal reward model (RM) accuracy, with the implicit assumption that better preference ranking translates to better personalized behavior. However, in…

Artificial Intelligence · Computer Science 2026-01-09 Fady Rezk , Yuangang Pan , Chuan-Sheng Foo , Xun Xu , Nancy Chen , Henry Gouk , Timothy Hospedales

User simulation is increasingly vital to develop and evaluate recommender systems (RSs). While Large Language Models (LLMs) offer promising avenues to simulate user behavior, they often struggle with the absence of specific task alignment…

Human-Computer Interaction · Computer Science 2026-04-20 Tianjun Wei , Huizhong Guo , Yingpeng Du , Zhu Sun , Huang Chen , Dongxia Wang , Jie Zhang

Recommender models aim to capture user preferences from historical feedback and then predict user-specific feedback on candidate items. However, the presence of various unmeasured confounders causes deviations between the user preferences…

Information Retrieval · Computer Science 2024-04-03 Hangtong Xu , Yuanbo Xu , Yongjian Yang