English
Related papers

Related papers: Causal Decision Transformer for Recommender System…

200 papers

In preference-based reinforcement learning (PbRL), a reward function is learned from a type of human feedback called preference. To expedite preference collection, recent works have leveraged \emph{offline preferences}, which are…

Machine Learning · Computer Science 2024-03-18 Guoxi Zhang , Han Bao , Hisashi Kashima

Large language model (LLM)-based recommender models that bridge users and items through textual prompts for effective semantic reasoning have gained considerable attention. However, few methods consider the underlying rationales behind…

Computation and Language · Computer Science 2025-01-09 Xinfeng Wang , Jin Cui , Yoshimi Suzuki , Fumiyo Fukumoto

Although recommenders can ship items to users automatically based on the users' preferences, they often cause unfairness to groups or individuals. For instance, when users can be divided into two groups according to a sensitive social…

Information Retrieval · Computer Science 2024-10-07 Zhenhao Jiang , Jicong Fan

Modeling the complex interactions between users and items as well as amongst items themselves is at the core of designing successful recommender systems. One classical setting is predicting users' personalized sequential behavior (or…

Information Retrieval · Computer Science 2017-07-11 Ruining He , Wang-Cheng Kang , Julian McAuley

Retrieval-augmented generation (RAG) enhances the text generation capabilities of large language models (LLMs) by integrating external knowledge and up-to-date information. However, traditional RAG systems are limited by static workflows…

Offline Meta Reinforcement Learning (OMRL) aims to learn transferable knowledge from offline datasets to enhance the learning process for new target tasks. Context-based Reinforcement Learning (RL) adopts a context encoder to expediently…

Machine Learning · Computer Science 2023-05-24 Chenyang Zhao , Zihao Zhou , Bin Liu

Offline Reinforcement learning is commonly used for sequential decision-making in domains such as healthcare and education, where the rewards are known and the transition dynamics $T$ must be estimated on the basis of batch data. A key…

Machine Learning · Computer Science 2023-08-10 Leo Benac , Sonali Parbhoo , Finale Doshi-Velez

Sequential recommendation (SR) models predict a user's next interaction by modeling their historical behaviors. Transformer-based SR methods, notably BERT4Rec, effectively capture these patterns but incur significant computational overhead…

Information Retrieval · Computer Science 2026-02-09 Shankar Veludandi , Gulrukh Kurdistan , Uzma Mushtaque

Recommender systems play a key role in shaping modern web ecosystems. These systems alternate between (1) making recommendations (2) collecting user responses to these recommendations, and (3) retraining the recommendation algorithm based…

Information Retrieval · Computer Science 2022-07-18 Karl Krauth , Yixin Wang , Michael I. Jordan

With the increasing demand for efficient and flexible robotic exploration solutions, Reinforcement Learning (RL) is becoming a promising approach in the field of autonomous robotic exploration. However, current RL-based exploration…

Robotics · Computer Science 2025-03-19 Chunyu Yang , Shengben Bi , Yihui Xu , Xin Zhang

Interacting with the actual environment to acquire data is often costly and time-consuming in robotic tasks. Model-based offline reinforcement learning (RL) provides a feasible solution. On the one hand, it eliminates the requirements of…

Machine Learning · Computer Science 2023-10-17 Pengqin Wang , Meixin Zhu , Shaojie Shen

Modern recommender systems face significant computational challenges due to growing model complexity and traffic scale, making efficient computation allocation critical for maximizing business revenue. Existing approaches typically simplify…

Information Retrieval · Computer Science 2026-01-01 Wan Jiang , Xinyi Zang , Yudong Zhao , Yusi Zou , Yunfei Lu , Junbo Tong , Yang Liu , Ming Li , Jiani Shi , Xin Yang

Driven by advances in Large Language Models (LLMs), integrating them into recommendation tasks has gained interest due to their strong semantic understanding and prompt flexibility. Prior work encoded user-item interactions or metadata into…

Information Retrieval · Computer Science 2025-06-10 Keyu Zhao , Fengli Xu , Yong Li

Adaptations of Transformer models, such as BERT4Rec and SASRec, achieve state-of-the-art performance in the sequential recommendation task according to accuracy-based metrics, such as NDCG. These models treat items as tokens and then…

Information Retrieval · Computer Science 2024-03-11 Aleksandr Petrov , Craig Macdonald

Causal structure learning (CSL) refers to the task of learning causal relationships from data. Advances in CSL now allow learning of causal graphs in diverse application domains, which has the potential to facilitate data-driven causal…

Machine Learning · Statistics 2024-07-09 Luka Kovačević , Izzy Newsham , Sach Mukherjee , John Whittaker

In many predictive decision-making scenarios, such as credit scoring and academic testing, a decision-maker must construct a model that accounts for agents' propensity to "game" the decision rule by changing their features so as to receive…

Machine Learning · Computer Science 2022-08-26 Yonadav Shavit , Benjamin Edelman , Brian Axelrod

Clinical decision support must adapt online under safety constraints. We present an online adaptive tool where reinforcement learning provides the policy, a patient digital twin provides the environment, and treatment effect defines the…

Artificial Intelligence · Computer Science 2025-08-26 Xinyu Qin , Ruiheng Yu , Lu Wang

With the rise of LLMs, there is an increasing need for intelligent recommendation assistants that can handle complex queries and provide personalized, reasoning-driven recommendations. LLM-based recommenders show potential but face…

Information Retrieval · Computer Science 2026-04-10 Jiani Huang , Shijie Wang , Liangbo Ning , Wenqi Fan , Qing Li

Traditional robust recommendation methods view atypical user-item interactions as noise and aim to reduce their impact with some kind of noise filtering technique, which often suffers from two challenges. First, in real world, atypical…

Information Retrieval · Computer Science 2022-01-19 Ziwen Du , Ning Yang , Zhonghua Yu , Philip S. Yu

To improve user experience and profits of corporations, modern industrial recommender systems usually aim to select the items that are most likely to be interacted with (e.g., clicks and purchases). However, they overlook the fact that…

Information Retrieval · Computer Science 2021-05-31 Xu Xie , Zhaoyang Liu , Shiwen Wu , Fei Sun , Cihang Liu , Jiawei Chen , Jinyang Gao , Bin Cui , Bolin Ding