English
Related papers

Related papers: RecNextEval: A Reference Implementation for Tempor…

200 papers

Evaluation beyond aggregate performance metrics, e.g. F1-score, is crucial to both establish an appropriate level of trust in machine learning models and identify future model improvements. In this paper we demonstrate CrossCheck, an…

Human-Computer Interaction · Computer Science 2020-04-20 Dustin Arendt , Zhuanyi Huang , Prasha Shrestha , Ellyn Ayton , Maria Glenski , Svitlana Volkova

We present our solution to the job recommendation task for RecSys Challenge 2016. The main contribution of our work is to combine temporal learning with sequence modeling to capture complex user-item activity patterns to improve job…

Machine Learning · Computer Science 2016-08-16 Kuan Liu , Xing Shi , Anoop Kumar , Linhong Zhu , Prem Natarajan

Offline evaluation of recommender systems is often affected by hidden, under-documented choices in data preparation. Seemingly minor decisions in filtering, handling repeats, cold-start treatment, and splitting strategy design can…

Information Retrieval · Computer Science 2026-02-24 Anna Volodkevich , Dmitry Anikin , Danil Gusak , Anton Klenitskiy , Evgeny Frolov , Alexey Vasilev

This paper introduces RecAI, a practical toolkit designed to augment or even revolutionize recommender systems with the advanced capabilities of Large Language Models (LLMs). RecAI provides a suite of tools, including Recommender AI Agent,…

Information Retrieval · Computer Science 2024-03-12 Jianxun Lian , Yuxuan Lei , Xu Huang , Jing Yao , Wei Xu , Xing Xie

Many studies in recommender systems (RecSys) adopt a general problem definition, i.e., to recommend preferred items to users based on past interactions. Such abstraction often lacks the domain-specific nuances necessary for practical…

Information Retrieval · Computer Science 2025-10-31 Aixin Sun

In order to support the study of recent advances in recommender systems, this paper presents an extended recommendation library consisting of eight packages for up-to-date topics and architectures. First of all, from a data perspective, we…

State-of-the-art saliency prediction methods develop upon model architectures or loss functions; while training to generate one target saliency map. However, publicly available saliency prediction datasets can be utilized to create more…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Sandeep Mishra , Oindrila Saha

Recommender-systems research has accelerated model and evaluation advances, yet largely neglects automating the research process itself. We argue for a shift from narrow AutoRecSys tools -- focused on algorithm selection and hyper-parameter…

Information Retrieval · Computer Science 2025-10-22 Joeran Beel , Bela Gipp , Tobias Vente , Moritz Baumgart , Philipp Meister

Recommender Systems have shown to be an effective way to alleviate the over-choice problem and provide accurate and tailored recommendations. However, the impressive number of proposed recommendation algorithms, splitting strategies,…

Deep learning based recommender systems have been extensively explored in recent years. However, the large number of models proposed each year poses a big challenge for both researchers and practitioners in reproducing the results for…

Information Retrieval · Computer Science 2019-05-28 Shuai Zhang , Yi Tay , Lina Yao , Bin Wu , Aixin Sun

Simulation has emerged as a popular method to study the long-term societal consequences of recommender systems. This approach allows researchers to specify their theoretical model explicitly and observe the evolution of system-level…

Computers and Society · Computer Science 2021-07-29 Eli Lucherini , Matthew Sun , Amy Winecoff , Arvind Narayanan

As with most Machine Learning systems, recommender systems are typically evaluated through performance metrics computed over held-out data points. However, real-world behavior is undoubtedly nuanced: ad hoc error analysis and…

Information Retrieval · Computer Science 2022-03-29 Patrick John Chia , Jacopo Tagliabue , Federico Bianchi , Chloe He , Brian Ko

Various forms of Peer-Learning Environments are increasingly being used in post-secondary education, often to help build repositories of student generated learning objects. However, large classes can result in an extensive repository, which…

Computers and Society · Computer Science 2017-04-04 Hassan Khosravi , Kendra Cooper , Kirsty Kitto

The past two decades have witnessed the rapid development of personalized recommendation techniques. Despite significant progress made in both research and practice of recommender systems, to date, there is a lack of a widely-recognized…

Information Retrieval · Computer Science 2022-07-19 Jieming Zhu , Quanyu Dai , Liangcai Su , Rong Ma , Jinyang Liu , Guohao Cai , Xi Xiao , Rui Zhang

Recurrent recommender systems have been successful in capturing the temporal dynamics in users' activity trajectories. However, recurrent neural networks (RNNs) are known to have difficulty learning long-term dependencies. As a consequence,…

Information Retrieval · Computer Science 2022-01-27 Bo Chang , Can Xu , Matthieu Lê , Jingchen Feng , Ya Le , Sriraj Badam , Ed Chi , Minmin Chen

Recursive query processing has experienced a recent resurgence, as a result of its use in many modern application domains, including data integration, graph analytics, security, program analysis, networking and decision making. Due to the…

Databases · Computer Science 2018-12-11 Zhiwei Fan , Jianqiao Zhu , Zuyu Zhang , Aws Albarghouthi , Paraschos Koutris , Jignesh Patel

This paper calls attention to the missing component of the recommender system evaluation process: Statistical Inference. There is active research in several components of the recommender system evaluation process: selecting baselines,…

Information Retrieval · Computer Science 2021-09-15 Ngozi Ihemelandu , Michael D. Ekstrand

Reasoning in interactive problem solving scenarios requires models to construct reasoning threads that reflect user understanding and align with structured domain knowledge. However, current reasoning models often lack explicit semantic…

Artificial Intelligence · Computer Science 2025-08-19 Daniel Burkhardt , Xiangwei Cheng

Accurate evaluation of weather forecasting models is critical for their reliable deployment in real-world applications. However, existing benchmarks predominantly rely on reanalysis products such as ERA5, which are generated through delayed…

Machine Learning · Computer Science 2026-05-26 Ruize Li , Zhibin Wen , Tao Han , Hao Chen , Fenghua Ling , Wei Zhang , Song Guo , Lei Bai

Industrial recommendation systems (RS) rely on the multi-stage pipeline to balance effectiveness and efficiency when delivering items from a vast corpus to users. Existing RS benchmark datasets primarily focus on the exposure space, where…

Information Retrieval · Computer Science 2024-10-29 Qi Liu , Kai Zheng , Rui Huang , Wuchao Li , Kuo Cai , Yuan Chai , Yanan Niu , Yiqun Hui , Bing Han , Na Mou , Hongning Wang , Wentian Bao , Yunen Yu , Guorui Zhou , Han Li , Yang Song , Defu Lian , Kun Gai