English
Related papers

Related papers: Where Do We Go From Here? Guidelines For Offline R…

200 papers

Large foundational models, through upstream pre-training and downstream fine-tuning, have achieved immense success in the broad AI community due to improved model performance and significant reductions in repetitive engineering. By…

Information Retrieval · Computer Science 2024-03-19 Jiaqi Zhang , Yu Cheng , Yongxin Ni , Yunzhu Pan , Zheng Yuan , Junchen Fu , Youhua Li , Jie Wang , Fajie Yuan

Deep learning based recommender systems have been extensively explored in recent years. However, the large number of models proposed each year poses a big challenge for both researchers and practitioners in reproducing the results for…

Information Retrieval · Computer Science 2019-05-28 Shuai Zhang , Yi Tay , Lina Yao , Bin Wu , Aixin Sun

Recommender systems have become important tools to support users in identifying relevant content in an overloaded information space. To ease the development of recommender systems, a number of recommender frameworks have been proposed that…

Information Retrieval · Computer Science 2019-01-03 Dominik Kowald , Simone Kopeinik , Elisabeth Lex

Recommender models are hard to evaluate, particularly under offline setting. In this paper, we provide a comprehensive and critical analysis of the data leakage issue in recommender system offline evaluation. Data leakage is caused by not…

Information Retrieval · Computer Science 2023-08-07 Yitong Ji , Aixin Sun , Jie Zhang , Chenliang Li

Large language models (LLMs) are increasingly integrated into recommender systems, motivating recent interest in agentic and reasoning-based recommendation. However, most existing approaches still rely on fixed workflows, applying the same…

Information Retrieval · Computer Science 2026-02-12 Fuchun Li , Qian Li , Xingyu Gao , Bocheng Pan , Yang Wu , Jun Zhang , Huan Yu , Jie Jiang , Jinsheng Xiao , Hailong Shi

Recommender systems have demonstrated significant impact across diverse domains, yet ensuring the reproducibility of experimental findings remains a persistent challenge. A primary obstacle lies in the fragmented and often opaque data…

Recommendation has become a prominent area of research in the field of Information Retrieval (IR). Evaluation is also a traditional research topic in this community. Motivated by a few counter-intuitive observations reported in recent…

Information Retrieval · Computer Science 2023-08-22 Aixin Sun

While the OneRec series has successfully unified the fragmented recommendation pipeline into an end-to-end generative framework, a significant gap remains between recommendation systems and general intelligence. Constrained by isolated…

In recommender systems, collecting, storing, and processing large-scale interaction data is increasingly costly in terms of time, energy, and computation, yet it remains unclear when additional data stops providing meaningful gains. This…

Information Retrieval · Computer Science 2026-04-10 Youssef Abdou

Realistic recommender systems are often required to adapt to ever-changing data and tasks or to explore different models systematically. To address the need, we present AutoRec, an open-source automated machine learning (AutoML) platform…

Information Retrieval · Computer Science 2020-07-15 Ting-Hsiang Wang , Qingquan Song , Xiaotian Han , Zirui Liu , Haifeng Jin , Xia Hu

Existing benchmark datasets for recommender systems (RS) either are created at a small scale or involve very limited forms of user feedback. RS models evaluated on such datasets often lack practical values for large-scale real-world…

Information Retrieval · Computer Science 2023-06-06 Guanghu Yuan , Fajie Yuan , Yudong Li , Beibei Kong , Shujie Li , Lei Chen , Min Yang , Chenyun Yu , Bo Hu , Zang Li , Yu Xu , Xiaohu Qie

In this paper, we argue that the paradigm commonly adopted for offline evaluation of sequential recommender systems is unsuitable for evaluating reinforcement learning-based recommenders. We find that most of the existing offline evaluation…

Information Retrieval · Computer Science 2023-01-04 Romain Deffayet , Thibaut Thonet , Jean-Michel Renders , Maarten de Rijke

We present an interactive visualisation tool for recommending travel trajectories. This system is based on new machine learning formulations and algorithms for the sequence recommendation problem. The system starts from a map-based…

Human-Computer Interaction · Computer Science 2017-07-20 Dawei Chen , Dongwoo Kim , Lexing Xie , Minjeong Shin , Aditya Krishna Menon , Cheng Soon Ong , Iman Avazpour , John Grundy

Even though offline evaluation is just an imperfect proxy of online performance -- due to the interactive nature of recommenders -- it will probably remain the primary way of evaluation in recommender systems research for the foreseeable…

Information Retrieval · Computer Science 2023-07-28 Balázs Hidasi , Ádám Tibor Czapp

Modeling user-item interaction patterns is an important task for personalized recommendations. Many recommender systems are based on the assumption that there exists a linear relationship between users and items while neglecting the…

Information Retrieval · Computer Science 2018-07-12 Shuai Zhang , Lina Yao , Aixin Sun , Sen Wang , Guodong Long , Manqing Dong

Learning large-scale pre-trained models on broad-ranging data and then transfer to a wide range of target tasks has become the de facto paradigm in many machine learning (ML) communities. Such big models are not only strong performers in…

Information Retrieval · Computer Science 2025-09-23 Jie Wang , Fajie Yuan , Mingyue Cheng , Joemon M. Jose , Chenyun Yu , Beibei Kong , Zhijin Wang , Bo Hu , Zang Li

Reinforcement learning-based recommender systems have recently gained popularity. However, the design of the reward function, on which the agent relies to optimize its recommendation policy, is often not straightforward. Exploring the…

Information Retrieval · Computer Science 2023-08-29 Siyu Wang , Xiaocong Chen , Dietmar Jannach , Lina Yao

Modern recommender systems must adapt to dynamic, need-specific objectives for diverse recommendation scenarios, yet most traditional recommenders are optimized for a single static target and struggle to reconfigure behavior on demand.…

Machine Learning · Computer Science 2026-03-13 Yijun Pan , Weikang Qiu , Qiyao Ma , Mingxuan Ju , Tong Zhao , Neil Shah , Rex Ying

The typical offline protocol to evaluate recommendation algorithms is to collect a dataset of user-item interactions and then use a part of this dataset to train a model, and the remaining data to measure how closely the model…

Information Retrieval · Computer Science 2026-05-15 Maria João Lavoura , Robert Jungnickel , João Vinagre

The number of proposed recommender algorithms continues to grow. The authors propose new approaches and compare them with existing models, called baselines. Due to the large number of recommender models, it is difficult to estimate which…

Information Retrieval · Computer Science 2023-06-27 Veronika Ivanova , Oleg Lashinin , Marina Ananyeva , Sergey Kolesnikov
‹ Prev 1 2 3 10 Next ›