English
Related papers

Related papers: Hierarchical Reinforcement Learning for Modeling U…

200 papers

When training artificial intelligence (AI) to perform tasks, humans often care not only about whether a task is completed but also how it is performed. As AI agents tackle increasingly complex tasks, aligning their behavior with…

Artificial Intelligence · Computer Science 2026-02-24 Zhiqin Qian , Ryan Diaz , Sangwon Seo , Vaibhav Unhelkar

An ultimate goal of recommender systems (RS) is to improve user engagement. Reinforcement learning (RL) is a promising paradigm for this goal, as it directly optimizes overall performance of sequential recommendation. However, many existing…

Information Retrieval · Computer Science 2023-04-06 Guoxi Zhang , Xing Yao , Xuanji Xiao

Learning an optimal policy from a multi-modal reward function is a challenging problem in reinforcement learning (RL). Hierarchical RL (HRL) tackles this problem by learning a hierarchical policy, where multiple option policies are in…

Machine Learning · Computer Science 2017-12-01 Takayuki Osa , Masashi Sugiyama

We introduce Shielded RecRL, a reinforcement learning approach to generate personalized explanations for recommender systems without sacrificing the system's original ranking performance. Unlike prior RLHF-based recommender methods that…

Information Retrieval · Computer Science 2026-01-08 Ansh Tiwari , Ayush Chauhan

Large Language Models (LLMs) have achieved remarkable success in various fields, prompting several studies to explore their potential in recommendation systems. However, these attempts have so far resulted in only modest improvements over…

Information Retrieval · Computer Science 2024-09-20 Junyi Chen , Lu Chi , Bingyue Peng , Zehuan Yuan

Reinforcement learning (RL) is a powerful machine learning technique that enables an intelligent agent to learn an optimal policy that maximizes the cumulative rewards in sequential decision making. Most of methods in the existing…

Machine Learning · Statistics 2023-01-06 Chengchun Shi , Zhengling Qi , Jianing Wang , Fan Zhou

Most existing methods determine relation types only after all the entities have been recognized, thus the interaction between relation types and entity mentions is not fully modeled. This paper presents a novel paradigm to deal with…

Computation and Language · Computer Science 2018-11-12 Ryuichi Takanobu , Tianyang Zhang , Jiexi Liu , Minlie Huang

Recommender systems are vital for shaping user online experiences. While some believe they may limit new content exploration and promote opinion polarization, a systematic analysis is still lacking. We present a model that explores the…

Physics and Society · Physics 2023-12-15 Giordano De Marzo , Pietro Gravino , Vittorio Loreto

Hierarchical reinforcement learning (HRL) effectively improves agents' exploration efficiency on tasks with sparse reward, with the guide of high-quality hierarchical structures (e.g., subgoals or options). However, how to automatically…

Machine Learning · Computer Science 2022-10-14 Shaohui Peng , Xing Hu , Rui Zhang , Ke Tang , Jiaming Guo , Qi Yi , Ruizhi Chen , Xishan Zhang , Zidong Du , Ling Li , Qi Guo , Yunji Chen

Hierarchical reinforcement learning (HRL) is hypothesized to be able to leverage the inherent hierarchy in learning tasks where traditional reinforcement learning (RL) often fails. In this research, HRL is evaluated and contrasted with…

Artificial Intelligence · Computer Science 2025-08-20 Brendon Johnson , Alfredo Weitzenfeld

Conventional recommendation systems succeed in identifying relevant content but often fail to provide users with surprising or novel items. Multimodal Large Language Models (MLLMs) possess the world knowledge and multimodal understanding…

Information Retrieval · Computer Science 2025-09-23 Haoting Wang , Jianling Wang , Hao Li , Fangjun Yi , Mengyu Fu , Youwei Zhang , Yifan Liu , Liang Liu , Minmin Chen , Ed H. Chi , Lichan Hong , Haokai Lu

Deep reinforcement learning (DRL) has been proven its efficiency in capturing users' dynamic interests in recent literature. However, training a DRL agent is challenging, because of the sparse environment in recommender systems (RS), DRL…

Information Retrieval · Computer Science 2022-09-20 Xiaocong Chen , Siyu Wang , Lina Yao , Lianyong Qi , Yong Li

Offline preference-based reinforcement learning (RL), which focuses on optimizing policies using human preferences between pairs of trajectory segments selected from an offline dataset, has emerged as a practical avenue for RL applications.…

Machine Learning · Computer Science 2024-07-08 Chen-Xiao Gao , Shengjun Fang , Chenjun Xiao , Yang Yu , Zongzhang Zhang

Recommendation systems usually involve exploiting the relations among known features and content that describe items (content-based filtering) or the overlap of similar users who interacted with or rated the target item (collaborative…

Artificial Intelligence · Computer Science 2016-07-06 Shuo Yang , Mohammed Korayem , Khalifeh AlJadda , Trey Grainger , Sriraam Natarajan

A long user history inevitably reflects the transitions of personal interests over time. The analyses on the user history require the robust sequential model to anticipate the transitions and the decays of user interests. The user history…

Information Retrieval · Computer Science 2019-04-30 Kyungwoo Song , Mingi Ji , Sungrae Park , Il-Chul Moon

Traditional recommender systems based on revealed preferences often fail to capture the fundamental duality in user behavior, where consumption choices are driven by both inherent value (enrichment) and instant appeal (temptation).…

Information Retrieval · Computer Science 2025-07-24 Md Sanzeed Anwar , Paramveer S. Dhillon , Grant Schoenebeck

Recommender systems have been widely applied in different real-life scenarios to help us find useful information. In particular, Reinforcement Learning (RL) based recommender systems have become an emerging research topic in recent years,…

Information Retrieval · Computer Science 2023-06-13 Yuanguo Lin , Yong Liu , Fan Lin , Lixin Zou , Pengcheng Wu , Wenhua Zeng , Huanhuan Chen , Chunyan Miao

Click-through rate (CTR) prediction plays an important role in online advertising and recommendation systems, which aims at estimating the probability of a user clicking on a specific item. Feature interaction modeling and user interest…

Information Retrieval · Computer Science 2022-06-02 Zuowu Zheng , Changwang Zhang , Xiaofeng Gao , Guihai Chen

The primary goal in recommendation is to suggest relevant content to users, but optimizing for accuracy often results in recommendations that lack diversity. To remedy this, conventional approaches such as re-ranking improve diversity by…

Machine Learning · Computer Science 2023-06-12 Itay Eilat , Nir Rosenfeld

Hierarchical reinforcement learning (HRL) has seen widespread interest as an approach to tractable learning of complex modular behaviors. However, existing work either assume access to expert-constructed hierarchies, or use…

Machine Learning · Computer Science 2021-10-19 Kurtland Chua , Qi Lei , Jason D. Lee