English
Related papers

Related papers: Maximum In-Support Return Modeling for Dynamic Rec…

200 papers

Deep learning-based recommendation systems (e.g., DLRMs) are widely used AI models to provide high-quality personalized recommendations. Training data used for modern recommendation systems commonly includes categorical features taking on…

Information Retrieval · Computer Science 2026-01-06 Gopi Krishna Jha , Anthony Thomas , Nilesh Jain , Sameh Gobriel , Tajana Rosing , Ravi Iyer

As representation learning becomes a powerful technique to reduce sample complexity in reinforcement learning (RL) in practice, theoretical understanding of its advantage is still limited. In this paper, we theoretically characterize the…

Machine Learning · Computer Science 2022-06-14 Yuan Cheng , Songtao Feng , Jing Yang , Hong Zhang , Yingbin Liang

We present two elegant solutions for modeling continuous-time dynamics, in a novel model-based reinforcement learning (RL) framework for semi-Markov decision processes (SMDPs), using neural ordinary differential equations (ODEs). Our models…

Machine Learning · Computer Science 2020-10-27 Jianzhun Du , Joseph Futoma , Finale Doshi-Velez

Sequential recommendation systems aim to predict users' next preferences based on their interaction histories, but existing approaches face critical limitations in efficiency and multi-scale pattern recognition. While Transformer-based…

Information Retrieval · Computer Science 2025-05-08 Qianru Zhang , Liang Qu , Honggang Wen , Dong Huang , Siu-Ming Yiu , Nguyen Quoc Viet Hung , Hongzhi Yin

Model-based offline reinforcement learning (RL) has emerged as a promising approach for recommender systems, enabling effective policy learning by interacting with frozen world models. However, the reward functions in these world models,…

Information Retrieval · Computer Science 2025-05-13 Yi Zhang , Ruihong Qiu , Xuwei Xu , Jiajun Liu , Sen Wang

Recommender systems play a vital role in alleviating information overload and enriching users' online experience. In the era of large language models (LLMs), LLM-based recommender systems have emerged as a prevalent paradigm for advancing…

Information Retrieval · Computer Science 2025-11-19 Zihuai Zhao , Yujuan Ding , Wenqi Fan , Qing Li

Large language models (LLMs) have shown great promise in recommender systems, where supervised fine-tuning (SFT) is commonly used for adaptation. Subsequent studies further introduce preference learning to incorporate negative samples into…

Information Retrieval · Computer Science 2026-02-20 Bingqian Li , Bowen Zheng , Xiaolei Wang , Long Zhang , Jinpeng Wang , Sheng Chen , Wayne Xin Zhao , Ji-rong Wen

When users are dissatisfied with recommendations from a recommender system, they often lack fine-grained controls for changing them. Large language models (LLMs) offer a solution by allowing users to guide their recommendations through…

Artificial Intelligence · Computer Science 2025-10-15 Micah Carroll , Adeline Foote , Kevin Feng , Marcus Williams , Anca Dragan , W. Bradley Knox , Smitha Milli

Conventional recommendation systems (RSs) are typically optimized to enhance performance metrics uniformly across all training samples. This makes it hard for data-driven RSs to cater to a diverse set of users due to the varying properties…

Information Retrieval · Computer Science 2024-05-03 Kirandeep Kaur , Chirag Shah

When Reinforcement Learning (RL) agents are deployed in practice, they might impact their environment and change its dynamics. We propose a new framework to model this phenomenon, where the current environment depends on the deployed policy…

Machine Learning · Computer Science 2024-06-03 Ben Rank , Stelios Triantafyllou , Debmalya Mandal , Goran Radanovic

The recent advancements in Large Language Models (LLMs) have generated considerable interest in their utilization for sequential recommendation tasks. While collaborative signals from similar users are central to recommendation modeling,…

Information Retrieval · Computer Science 2025-04-15 Tong Zhang

Offline reinforcement learning (RL) aims to find a near-optimal policy using pre-collected datasets. In real-world scenarios, data collection could be costly and risky; therefore, offline RL becomes particularly challenging when the…

Machine Learning · Computer Science 2024-12-18 Ruizhe Shi , Yuyao Liu , Yanjie Ze , Simon S. Du , Huazhe Xu

Deep Reinforcement Learning (DRL) agents frequently face challenges in adapting to tasks outside their training distribution, including issues with over-fitting, catastrophic forgetting and sample inefficiency. Although the application of…

Artificial Intelligence · Computer Science 2023-11-21 Yizhao Jin , Greg Slabaugh , Simon Lucas

The modern recommender systems are facing an increasing challenge of modelling and predicting the dynamic and context-rich user preferences. Traditional collaborative filtering and content-based methods often struggle to capture the…

Information Retrieval · Computer Science 2025-07-21 Yitong Li , Raoul Grasman

Large Language Models (LLMs) have been integrated into recommender systems to enhance user behavior comprehension. The Retrieval Augmented Generation (RAG) technique is further incorporated into these systems to retrieve more relevant items…

Information Retrieval · Computer Science 2025-03-27 Sichun Luo , Jian Xu , Xiaojie Zhang , Linrong Wang , Sicong Liu , Hanxu Hou , Linqi Song

The significant advancements in large language models (LLMs) give rise to a promising research direction, i.e., leveraging LLMs as recommenders (LLMRec). The efficacy of LLMRec arises from the open-world knowledge and reasoning capabilities…

Information Retrieval · Computer Science 2024-07-02 Hangyu Wang , Jianghao Lin , Bo Chen , Yang Yang , Ruiming Tang , Weinan Zhang , Yong Yu

Retrieval-augmented generation (RAG) systems combine large language models (LLMs) with external knowledge retrieval, making them highly effective for knowledge-intensive tasks. A crucial but often under-explored component of these systems…

Computation and Language · Computer Science 2025-05-19 Jiashuo Sun , Xianrui Zhong , Sizhe Zhou , Jiawei Han

Recent advances in Large Language Models (LLMs) have opened new possibilities for recommendation systems, though current approaches such as TALLRec face challenges in explainability and cold-start scenarios. We present ExplainRec, a…

Information Retrieval · Computer Science 2025-11-20 Bo Ma , LuYao Liu , ZeHua Hu , Simon Lau

The lack of training data gives rise to the system cold-start problem in recommendation systems, making them struggle to provide effective recommendations. To address this problem, Large Language Models (LLMs) can model recommendation tasks…

Information Retrieval · Computer Science 2024-12-25 Wenlin Zhang , Chuhan Wu , Xiangyang Li , Yuhao Wang , Kuicai Dong , Yichao Wang , Xinyi Dai , Xiangyu Zhao , Huifeng Guo , Ruiming Tang

Conversational recommender systems (CRS) dynamically obtain the user preferences via multi-turn questions and answers. The existing CRS solutions are widely dominated by deep reinforcement learning algorithms. However, deep reinforcement…

Information Retrieval · Computer Science 2022-09-01 A S M Ahsan-Ul Haque , Hongning Wang