English
Related papers

Related papers: State Encoders in Reinforcement Learning for Recom…

200 papers

Reinforcement Learning has suffered from poor reward specification, and issues for reward hacking even in simple enough domains. Preference Based Reinforcement Learning attempts to solve the issue by utilizing binary feedbacks on queried…

Artificial Intelligence · Computer Science 2023-02-20 Mudit Verma , Subbarao Kambhampati

Real-world decision-making tasks are usually partially observable Markov decision processes (POMDPs), where the state is not fully observable. Recent progress has demonstrated that recurrent reinforcement learning (RL), which consists of a…

Machine Learning · Computer Science 2024-05-27 Fan-Ming Luo , Zuolin Tu , Zefang Huang , Yang Yu

Offline reinforcement learning (RL) allows learning sequential behavior from fixed datasets. Since offline datasets do not cover all possible situations, many methods collect additional data during online fine-tuning to improve performance.…

Machine Learning · Computer Science 2024-06-13 Mohammadreza Nakhaei , Aidan Scannell , Joni Pajarinen

Despite recent success of deep network-based Reinforcement Learning (RL), it remains elusive to achieve human-level efficiency in learning novel tasks. While previous efforts attempt to address this challenge using meta-learning strategies,…

Machine Learning · Computer Science 2022-05-03 Haozhe Wang , Jiale Zhou , Xuming He

Diagnosis-oriented dialogue system queries the patient's health condition and makes predictions about possible diseases through continuous interaction with the patient. A few studies use reinforcement learning (RL) to learn the optimal…

Computation and Language · Computer Science 2022-12-27 Wei Chen , Cheng Zhong , Jiajie Peng , Zhongyu Wei

Human decision-making often involves combining similar states into categories and reasoning at the level of the categories rather than the actual states. Guided by this intuition, we propose a novel method for clustering state features in…

Machine Learning · Computer Science 2022-11-15 Liang Zhang , Justin Lieffers , Adarsh Pyarelal

We introduce a new sequential transformer reinforcement learning architecture RLT4Rec and demonstrate that it achieves excellent performance in a range of item recommendation tasks. RLT4Rec uses a relatively simple transformer architecture…

Information Retrieval · Computer Science 2024-12-11 Dilina Chandika Rajapakse , Douglas Leith

Recommender systems (RecSys) have become critical tools for enhancing user engagement by delivering personalized content across diverse digital platforms. Recent advancements in large language models (LLMs) demonstrate significant potential…

Information Retrieval · Computer Science 2025-10-16 Yi Zhang , Lili Xie , Ruihong Qiu , Jiajun Liu , Sen Wang

Despite the impressive feats demonstrated by Reinforcement Learning (RL), these algorithms have seen little adoption in high-risk, real-world applications due to current difficulties in explaining RL agent actions and building user trust.…

Machine Learning · Computer Science 2023-12-08 Timothy K. Mathes , Jessica Inman , Andrés Colón , Simon Khan

Reinforcement learning (RL) is a general framework for adaptive control, which has proven to be efficient in many domains, e.g., board games, video games or autonomous vehicles. In such problems, an agent faces a sequential decision-making…

Machine Learning · Computer Science 2020-06-16 Olivier Buffet , Olivier Pietquin , Paul Weng

Neuroadaptive haptics offers a path to more immersive extended reality (XR) experiences by dynamically tuning multisensory feedback to user preferences. We present a neuroadaptive haptics system that adapts XR feedback through reinforcement…

Human-Computer Interaction · Computer Science 2025-12-22 Lukas Gehrke , Aleksandrs Koselevs , Marius Klug , Klaus Gramann

Reinforcement learning-based recommender systems (RL4RS) have gained attention for their ability to adapt to dynamic user preferences. However, these systems face challenges, particularly in offline settings, where data inefficiency and…

Information Retrieval · Computer Science 2025-10-16 Xiaocong Chen , Siyu Wang , Lina Yao

Reinforcement learning (RL) offers a capable and intuitive structure for the fundamental sequential decision-making problem. Despite impressive breakthroughs, it can still be difficult to employ RL in practice in many simple applications.…

Artificial Intelligence · Computer Science 2024-01-18 Aida Afshar , Wenchao Li

One of the fundamental challenges in reinforcement learning (RL) is the one of data efficiency: modern algorithms require a very large number of training samples, especially compared to humans, for solving environments with high-dimensional…

Machine Learning · Computer Science 2021-05-10 Hlynur Davíð Hlynsson , Laurenz Wiskott

Long-term user engagement (LTE) optimization in sequential recommender systems (SRS) is shown to be suited by reinforcement learning (RL) which finds a policy to maximize long-term rewards. Meanwhile, RL has its shortcomings, particularly…

Information Retrieval · Computer Science 2023-05-09 Xiong-Hui Chen , Bowei He , Yang Yu , Qingyang Li , Zhiwei Qin , Wenjie Shang , Jieping Ye , Chen Ma

Reinforcement learning-based recommender systems have recently gained popularity. However, due to the typical limitations of simulation environments (e.g., data inefficiency), most of the work cannot be broadly applied in all domains. To…

Information Retrieval · Computer Science 2024-06-04 Xiaocong Chen , Siyu Wang , Lina Yao

Deploying reinforcement learning in the real world remains challenging due to sample inefficiency, sparse rewards, and noisy visual observations. Prior work leverages demonstrations and human feedback to improve learning efficiency and…

Artificial Intelligence · Computer Science 2026-01-23 Xiefeng Wu , Mingyu Hu , Shu Zhang

We propose a general formulation for addressing reinforcement learning (RL) problems in settings with observational data. That is, we consider the problem of learning good policies solely from historical data in which unobserved factors…

Machine Learning · Computer Science 2018-12-31 Chaochao Lu , Bernhard Schölkopf , José Miguel Hernández-Lobato

How to accurately learn task-relevant state representations from high-dimensional observations with visual distractions is a realistic and challenging problem in visual reinforcement learning. Recently, unsupervised representation learning…

Machine Learning · Computer Science 2023-09-25 Dayang Liang , Qihang Chen , Yunlong Liu

The field of quickest change detection (QCD) concerns design and analysis of algorithms to estimate in real time the time at which an important event takes place, and identify properties of the post-change behavior. It is shown in this…

Optimization and Control · Mathematics 2024-09-16 Austin Cooper , Sean Meyn