English
Related papers

Related papers: RecSys Arena: Pair-wise Recommender System Evaluat…

200 papers

Designing service systems requires selecting among alternative configurations -- choosing the best chatbot variant, the optimal routing policy, or the most effective quality control procedure. In many service systems, the primary evidence…

Machine Learning · Computer Science 2026-03-12 Ruicheng Ao , Hongyu Chen , Siyang Gao , Hanwei Li , David Simchi-Levi

Generating user-friendly explanations regarding why an item is recommended has become increasingly common, largely due to advances in language generation technology, which can enhance user trust and facilitate more informed decision-making…

Information Retrieval · Computer Science 2024-01-04 Yucong Luo , Mingyue Cheng , Hao Zhang , Junyu Lu , Qi Liu , Enhong Chen

In real-world recommender systems, different retrieval objectives are typically addressed using task-specific datasets with carefully designed model architectures. We demonstrate that Large Language Models (LLMs) can function as universal…

Information Retrieval · Computer Science 2025-05-20 Junguang Jiang , Yanwen Huang , Bin Liu , Xiaoyu Kong , Xinhang Li , Ziru Xu , Han Zhu , Jian Xu , Bo Zheng

Recent advances in decision-making policies have led to significant progress in fields such as autonomous driving and robotics. However, testing these policies remains crucial with the existence of critical scenarios that may threaten their…

Machine Learning · Computer Science 2024-12-17 Weichao Xu , Huaxin Pei , Jingxuan Yang , Yuchen Shi , Yi Zhang , Qianchuan Zhao

Question answering systems (QA) utilizing Large Language Models (LLMs) heavily depend on the retrieval component to provide them with domain-specific information and reduce the risk of generating inaccurate responses or hallucinations.…

Computation and Language · Computer Science 2024-06-11 Ashkan Alinejad , Krtin Kumar , Ali Vahdat

Large language models (LLMs) are being widely applied across various fields, but as tasks become more complex, evaluating their responses is increasingly challenging. Compared to human evaluators, the use of LLMs to support performance…

Artificial Intelligence · Computer Science 2025-04-25 Yuran Li , Jama Hussein Mohamud , Chongren Sun , Di Wu , Benoit Boulet

Given the increasing demand for mental health assistance, artificial intelligence (AI), particularly large language models (LLMs), may be valuable for integration into automated clinical support systems. In this work, we leverage a decision…

Computation and Language · Computer Science 2024-05-09 Aylin Gunal , Baihan Lin , Djallel Bouneffouf

In this paper, we argue that the paradigm commonly adopted for offline evaluation of sequential recommender systems is unsuitable for evaluating reinforcement learning-based recommenders. We find that most of the existing offline evaluation…

Information Retrieval · Computer Science 2023-01-04 Romain Deffayet , Thibaut Thonet , Jean-Michel Renders , Maarten de Rijke

In online advertising, recommender systems try to propose items from a list of products to potential customers according to their interests. Such systems have been increasingly deployed in E-commerce due to the rapid growth of information…

Artificial Intelligence · Computer Science 2021-02-02 Milad Vaali Esfahaani , Yanbo Xue , Peyman Setoodeh

In recent years, integrated short-video and live-streaming platforms have gained massive global adoption, offering dynamic content creation and consumption. Unlike pre-recorded short videos, live-streaming enables real-time interaction…

Information Retrieval · Computer Science 2025-04-08 Yueyang Liu , Jiangxia Cao , Shen Wang , Shuang Wen , Xiang Chen , Xiangyu Wu , Shuang Yang , Zhaojie Liu , Kun Gai , Guorui Zhou

Conventional recommendation systems frequently fail to fully exploit the high-dimensional semantic signals inherent in multimedia content, thereby limiting the fidelity of user preference modeling. While Multimodal Large Language Models…

Information Retrieval · Computer Science 2026-05-12 Yiming Zhu , Xu Liu , Ziyun Xu , Zheng Wu , Joena Zhang , Sirius Chen , Chenheli Hua , Silvester Yao , Qichao Que , Wentao Shi , Junfeng Pan , Linhong Zhu

Recommender systems utilizing explicit feedback have witnessed significant advancements and widespread applications over the past years. However, generating recommendations in few-shot scenarios remains a persistent challenge. Recently,…

Information Retrieval · Computer Science 2023-12-22 Zhoumeng Wang

While other areas of machine learning have seen more and more automation, designing a high-performing recommender system still requires a high level of human effort. Furthermore, recent work has shown that modern recommender system…

Information Retrieval · Computer Science 2022-10-10 Duncan McElfresh , Sujay Khandagale , Jonathan Valverde , John P. Dickerson , Colin White

E-commerce pre-sales dialogue aims to understand and elicit user needs and preferences for the items they are seeking so as to provide appropriate recommendations. Conversational recommender systems (CRSs) learn user representation and…

Computation and Language · Computer Science 2024-10-21 Yuanxing Liu , Wei-Nan Zhang , Yifan Chen , Yuchi Zhang , Haopeng Bai , Fan Feng , Hengbin Cui , Yongbin Li , Wanxiang Che

The rapid evolution of Large Language Models (LLMs) has outpaced the development of model evaluation, highlighting the need for continuous curation of new, challenging benchmarks. However, manual curation of high-quality, human-aligned…

Machine Learning · Computer Science 2024-10-16 Tianle Li , Wei-Lin Chiang , Evan Frick , Lisa Dunlap , Tianhao Wu , Banghua Zhu , Joseph E. Gonzalez , Ion Stoica

Evaluating recommender systems remains a long-standing challenge, as offline methods based on historical user interactions and train-test splits often yield unstable and inconsistent results due to exposure bias, popularity bias, sampled…

A critical challenge in recommender systems is to establish reliable relationships between offline and online metrics that predict real-world performance. Motivated by recent advances in Pareto front approximation, we introduce a pragmatic…

Information Retrieval · Computer Science 2025-07-15 Timo Wilm , Philipp Normann

Modern recommender systems aim to deeply understand users' complex preferences through their past interactions. While deep collaborative filtering approaches using Graph Neural Networks (GNNs) excel at capturing user-item relationships,…

Information Retrieval · Computer Science 2025-06-03 Yangqin Jiang , Yuhao Yang , Lianghao Xia , Da Luo , Kangyi Lin , Chao Huang

Automatic evaluation is an integral aspect of dialogue system research. The traditional reference-based NLG metrics are generally found to be unsuitable for dialogue assessment. Consequently, recent studies have suggested various unique,…

Computation and Language · Computer Science 2024-01-23 Chen Zhang , Luis Fernando D'Haro , Yiming Chen , Malu Zhang , Haizhou Li

Recommendation systems power engagement and monetization across feeds, ads, and short-video platforms, but translating the latest advances in Large Language Models into Recommendation Systems (RecSys) gains remains rare, particularly in…