English
Related papers

Related papers: Compressive Features in Offline Reinforcement Lear…

200 papers

Recommender systems play a crucial role in mitigating the problem of information overload by suggesting users' personalized items or services. The vast majority of traditional recommender systems consider the recommendation procedure as a…

Information Retrieval · Computer Science 2018-08-13 Xiangyu Zhao , Liang Zhang , Zhuoye Ding , Long Xia , Jiliang Tang , Dawei Yin

In this work, we present a scalable reinforcement learning method for training multi-task policies from large offline datasets that can leverage both human demonstrations and autonomously collected data. Our method uses a Transformer to…

Reinforcement learning (RL) in sparse-reward environments remains a significant challenge due to the lack of informative feedback. We propose a simple yet effective method that uses a small number of successful demonstrations to initialize…

Machine Learning · Computer Science 2025-10-29 Seyed Mahdi Basiri Azad , Joschka Boedecker

Reinforcement learning (RL) has gained popularity in the realm of recommender systems due to its ability to optimize long-term rewards and guide users in discovering relevant content. However, the successful implementation of RL in…

Information Retrieval · Computer Science 2024-08-21 Nathan Corecco , Giorgio Piatti , Luca A. Lanzendörfer , Flint Xiaofeng Fan , Roger Wattenhofer

The recent development of reinforcement learning (RL) has boosted the adoption of online RL for wireless radio resource management (RRM). However, online RL algorithms require direct interactions with the environment, which may be…

Information Theory · Computer Science 2023-11-21 Kun Yang , Cong Shen , Jing Yang , Shu-ping Yeh , Jerry Sydir

We propose a new framework for imitation learning -- treating imitation as a two-player ranking-based game between a policy and a reward. In this game, the reward agent learns to satisfy pairwise performance rankings between behaviors,…

Machine Learning · Computer Science 2023-01-18 Harshit Sikchi , Akanksha Saran , Wonjoon Goo , Scott Niekum

We study the budget allocation problem in online marketing campaigns that utilize previously collected offline data. We first discuss the long-term effect of optimizing marketing budget allocation decisions in the offline setting. To…

Machine Learning · Computer Science 2023-09-07 Tianchi Cai , Jiyan Jiang , Wenpeng Zhang , Shiji Zhou , Xierui Song , Li Yu , Lihong Gu , Xiaodong Zeng , Jinjie Gu , Guannan Zhang

Model-based offline reinforcement learning (RL) has emerged as a promising approach for recommender systems, enabling effective policy learning by interacting with frozen world models. However, the reward functions in these world models,…

Information Retrieval · Computer Science 2025-05-13 Yi Zhang , Ruihong Qiu , Xuwei Xu , Jiajun Liu , Sen Wang

Existing dialogue systems rely on Query Suggestion (QS) to enhance user engagement. Recent efforts typically employ large language models with Click-Through Rate (CTR) model, yet fail in cold-start scenarios due to their heavy reliance on…

Computation and Language · Computer Science 2026-03-25 Qi Sun , Kejun Xiao , Huaipeng Zhao , Tao Luo , Xiaoyi Zeng

Reinforcement learning-based recommender systems have recently gained popularity. However, the design of the reward function, on which the agent relies to optimize its recommendation policy, is often not straightforward. Exploring the…

Information Retrieval · Computer Science 2023-08-29 Siyu Wang , Xiaocong Chen , Dietmar Jannach , Lina Yao

Conveying complex objectives to reinforcement learning (RL) agents can often be difficult, involving meticulous design of reward functions that are sufficiently informative yet easy enough to provide. Human-in-the-loop RL methods allow…

Machine Learning · Computer Science 2021-06-10 Kimin Lee , Laura Smith , Pieter Abbeel

In this paper we propose to solve an important problem in recommendation -- user cold start, based on meta leaning method. Previous meta learning approaches finetune all parameters for each new user, which is both computing and storage…

Information Retrieval · Computer Science 2019-12-10 Liang Zhao , Yang Wang , Daxiang Dong , Hao Tian

Learning policies from previously recorded data is a promising direction for real-world robotics tasks, as online learning is often infeasible. Dexterous manipulation in particular remains an open problem in its general form. The…

In this paper, we provide two new stable online algorithms for the problem of prediction in reinforcement learning, \emph{i.e.}, estimating the value function of a model-free Markov reward process using the linear function approximation…

Machine Learning · Computer Science 2018-06-19 Ajin George Joseph , Shalabh Bhatnagar

A major challenge in real-world reinforcement learning (RL) is the sparsity of reward feedback. Often, what is available is an intuitive but sparse reward function that only indicates whether the task is completed partially or fully.…

Machine Learning · Computer Science 2022-02-15 Desik Rengarajan , Gargi Vaidya , Akshay Sarvesh , Dileep Kalathil , Srinivas Shakkottai

The correct specification of reward models is a well-known challenge in reinforcement learning. Hand-crafted reward functions often lead to inefficient or suboptimal policies and may not be aligned with user values. Reinforcement learning…

Artificial Intelligence · Computer Science 2024-10-24 Muhan Lin , Shuyang Shi , Yue Guo , Behdad Chalaki , Vaishnav Tadiparthi , Ehsan Moradi Pari , Simon Stepputtis , Joseph Campbell , Katia Sycara

This paper develops an online inverse reinforcement learning algorithm aimed at efficiently recovering a reward function from ongoing observations of an agent's actions. To reduce the computation time and storage space in reward estimation,…

Robotics · Computer Science 2017-08-01 Kun Li , Joel W. Burdick

We propose a data augmentation method for offline reinforcement learning, motivated by active positioning problems. Particularly, our approach enables the training of off-policy models from a limited number of suboptimal trajectories. We…

Machine Learning · Computer Science 2026-05-14 Tobias Schmähling , Matthias Burkhardt , Tobias Windisch

In this paper we proposed reinforcement learning algorithms with the generalized reward function. In our proposed method we use Q-learning and SARSA algorithms with generalised reward function to train the reinforcement learning agent. We…

Artificial Intelligence · Computer Science 2016-02-17 Harshit Sethy , Amit Patel

The design of recommendations strategies in the adaptive learning system focuses on utilizing currently available information to provide individual-specific learning instructions for learners. As a critical motivate for human behaviors,…

Computers and Society · Computer Science 2019-10-29 Ruijian Han , Kani Chen , Chunxi Tan