中文
相关论文

相关论文: Compressive Features in Offline Reinforcement Lear…

200 篇论文

Deep learning has achieved remarkable successes in solving challenging reinforcement learning (RL) problems when dense reward function is provided. However, in sparse reward environment it still often suffers from the need to carefully…

机器学习 · 计算机科学 2019-02-19 Hao Liu , Alexander Trott , Richard Socher , Caiming Xiong

Motivated by the human-machine interaction such as training chatbots for improving customer satisfaction, we study human-guided human-machine interaction involving private information. We model this interaction as a two-player turn-based…

机器学习 · 统计学 2022-12-26 Zuyue Fu , Zhengling Qi , Zhuoran Yang , Zhaoran Wang , Lan Wang

Reinforcement learning-based recommender systems have recently gained popularity. However, due to the typical limitations of simulation environments (e.g., data inefficiency), most of the work cannot be broadly applied in all domains. To…

信息检索 · 计算机科学 2024-06-04 Xiaocong Chen , Siyu Wang , Lina Yao

With the explosive growth of online products and content, recommendation techniques have been considered as an effective tool to overcome information overload, improve user experience, and boost business revenue. In recent years, we have…

机器学习 · 计算机科学 2020-01-28 Xi Liu , Li Li , Ping-Chun Hsieh , Muhe Xie , Yong Ge , Rui Chen

Reinforcement learning (RL) provides an appealing formalism for learning control policies from experience. However, the classic active formulation of RL necessitates a lengthy active exploration process for each behavior, making it…

机器学习 · 计算机科学 2021-04-27 Ashvin Nair , Abhishek Gupta , Murtaza Dalal , Sergey Levine

Offline-to-online reinforcement learning (RL) improves sample efficiency by leveraging pre-collected datasets prior to online interaction. A key challenge, however, is learning an accurate critic in large state--action spaces with limited…

人工智能 · 计算机科学 2026-05-21 Andrew Choi , Wei Xu

In preference-based reinforcement learning (PbRL), a reward function is learned from a type of human feedback called preference. To expedite preference collection, recent works have leveraged \emph{offline preferences}, which are…

机器学习 · 计算机科学 2024-03-18 Guoxi Zhang , Han Bao , Hisashi Kashima

Reinforcement learning (RL) with sparse and deceptive rewards is challenging because non-zero rewards are rarely obtained. Hence, the gradient calculated by the agent can be stochastic and without valid information. Recent studies that…

机器学习 · 计算机科学 2024-02-08 Guojian Wang , Faguo Wu , Xiao Zhang , Jianxiang Liu

In human-in-the-loop reinforcement learning or environments where calculating a reward is expensive, the costly rewards can make learning efficiency challenging to achieve. The cost of obtaining feedback from humans or calculating expensive…

机器学习 · 计算机科学 2025-03-03 Muhammed Yusuf Satici , David L. Roberts

In this paper, we study collaborative filtering in an interactive setting, in which the recommender agents iterate between making recommendations and updating the user profile based on the interactive feedback. The most challenging problem…

信息检索 · 计算机科学 2020-07-07 Lixin Zou , Long Xia , Yulong Gu , Xiangyu Zhao , Weidong Liu , Jimmy Xiangji Huang , Dawei Yin

Most reinforcement learning practitioners evaluate their policies with online Monte Carlo estimators for either hyperparameter tuning or testing different algorithmic design choices, where the policy is repeatedly executed in the…

机器学习 · 计算机科学 2024-10-03 Shuze Liu , Shangtong Zhang

In safe offline reinforcement learning (RL), the objective is to develop a policy that maximizes cumulative rewards while strictly adhering to safety constraints, utilizing only offline data. Traditional methods often face difficulties in…

机器学习 · 计算机科学 2026-02-11 Prajwal Koirala , Zhanhong Jiang , Soumik Sarkar , Cody Fleming

Imagine if AI decision-support tools not only complemented our ability to make accurate decisions, but also improved our skills, boosted collaboration, and elevated the joy we derive from our tasks. Despite the potential to optimize a broad…

人机交互 · 计算机科学 2024-04-16 Zana Buçinca , Siddharth Swaroop , Amanda E. Paluch , Susan A. Murphy , Krzysztof Z. Gajos

Reinforcement Learning has received wide interest due to its success in competitive games. Yet, its adoption in everyday applications is limited (e.g. industrial, home, healthcare, etc.). In this paper, we address this limitation by…

机器人学 · 计算机科学 2023-06-26 Ben-ya Halevy , Yehudit Aperstein , Dotan Di Castro

In this study, we apply reinforcement learning techniques and propose what we call reinforcement mechanism design to tackle the dynamic pricing problem in sponsored search auctions. In contrast to previous game-theoretical approaches that…

计算机科学与博弈论 · 计算机科学 2017-11-29 Weiran Shen , Binghui Peng , Hanpeng Liu , Michael Zhang , Ruohan Qian , Yan Hong , Zhi Guo , Zongyao Ding , Pengjun Lu , Pingzhong Tang

Recently developed offline reinforcement learning algorithms have made it possible to learn policies directly from pre-collected datasets, giving rise to a new dilemma for practitioners: Since the performance the algorithms are able to…

机器学习 · 计算机科学 2021-11-29 Phillip Swazinna , Steffen Udluft , Thomas Runkler

Reinforcement Learning has suffered from poor reward specification, and issues for reward hacking even in simple enough domains. Preference Based Reinforcement Learning attempts to solve the issue by utilizing binary feedbacks on queried…

人工智能 · 计算机科学 2023-02-20 Mudit Verma , Subbarao Kambhampati

Although diffusion models have achieved strong results in decision-making tasks, their slow inference speed remains a key limitation. While consistency models offer a potential solution, existing applications to decision-making either…

机器学习 · 计算机科学 2026-02-09 Xintong Duan , Yutong He , Fahim Tajwar , Ruslan Salakhutdinov , J. Zico Kolter , Jeff Schneider

We study offline recommender learning from explicit rating feedback in the presence of selection bias. A current promising solution for the bias is the inverse propensity score (IPS) estimation. However, the performance of existing…

机器学习 · 统计学 2022-04-22 Yuta Saito , Masahiro Nomura

The objective of a reinforcement learning agent is to discover better actions through exploration. However, typical exploration techniques aim to maximize rewards, often incurring high costs in both exploration and learning processes. We…

机器学习 · 计算机科学 2024-12-24 Akane Tsuboya , Yu Kono , Tatsuji Takahashi