English
Related papers

Related papers: Dual-space Hierarchical Learning for Goal-guided C…

200 papers

Modern listwise recommendation systems need to consider both long-term user perceptions and short-term interest shifts. Reinforcement learning can be applied on recommendation to study such a problem but is also subject to large search…

Information Retrieval · Computer Science 2025-07-22 Luo Ji , Gao Liu , Mingyang Yin , Hongxia Yang , Jingren Zhou

Hierarchical reinforcement learning (HRL) improves the efficiency of long-horizon reinforcement-learning tasks with sparse rewards by decomposing the task into a hierarchy of subgoals. The main challenge of HRL is efficient discovery of the…

Machine Learning · Computer Science 2025-07-08 Sadegh Khorasani , Saber Salehkaleybar , Negar Kiyavash , Matthias Grossglauser

Class-incremental learning aims to continuously acquire new knowledge while preserving previously learned information, thereby mitigating catastrophic forgetting. Existing methods primarily restrict parameter updates but often overlook…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Mengxin Qin , Xiang Zhang , Kun Wei , Xu Yang , Cheng Deng

Goal-conditioned hierarchical reinforcement learning (HRL) presents a promising approach for enabling effective exploration in complex, long-horizon reinforcement learning (RL) tasks through temporal abstraction. Empirically, heightened…

Machine Learning · Computer Science 2024-04-09 Haoran Wang , Zeshen Tang , Leya Yang , Yaoru Sun , Fang Wang , Siyu Zhang , Yeming Chen

Conversational recommender systems (CRS) aim to capture user's current intentions and provide recommendations through real-time multi-turn conversational interactions. As a human-machine interactive system, it is essential for CRS to…

Information Retrieval · Computer Science 2022-07-05 Shuokai Li , Yongchun Zhu , Ruobing Xie , Zhenwei Tang , Zhao Zhang , Fuzhen Zhuang , Qing He , Hui Xiong

Previous multimodal sentence representation learning methods have achieved impressive performance. However, most approaches focus on aligning images and text at a coarse level, facing two critical challenges:cross-modal misalignment bias…

Computation and Language · Computer Science 2025-07-02 Kang He , Yuzhe Ding , Haining Wang , Fei Li , Chong Teng , Donghong Ji

Large Language Models (LLMs) have achieved remarkable success in various fields, prompting several studies to explore their potential in recommendation systems. However, these attempts have so far resulted in only modest improvements over…

Information Retrieval · Computer Science 2024-09-20 Junyi Chen , Lu Chi , Bingyue Peng , Zehuan Yuan

Recommending novel content, which expands user horizons by introducing them to new interests, has been shown to improve users' long-term experience on recommendation platforms \cite{chen2021values}. Users however are not constantly looking…

Information Retrieval · Computer Science 2023-06-05 Pan Li , Yuyan Wang , Ed H. Chi , Minmin Chen

Heterogeneous sequential recommendation (HSR) aims to learn dynamic behavior dependencies from the diverse behaviors of user-item interactions to facilitate precise sequential recommendation. Despite many efforts yielding promising…

Information Retrieval · Computer Science 2026-04-17 Jing Xiao , Dongqi Wu , Liwei Pan , Yawen Luo , Weike Pan , Zhong Ming

Hierarchical reinforcement learning (HRL) provides a promising solution for complex tasks with sparse rewards of intelligent agents, which uses a hierarchical framework that divides tasks into subgoals and completes them sequentially.…

Artificial Intelligence · Computer Science 2024-11-28 Xinglin Zhou , Yifu Yuan , Shaofu Yang , Jianye Hao

Dialogue data in real scenarios tend to be sparsely available, rendering data-starved end-to-end dialogue systems trained inadequately. We discover that data utilization efficiency in low-resource scenarios can be enhanced by mining…

Computation and Language · Computer Science 2023-05-26 Shimin Li , Xiaotian Zhang , Yanjun Zheng , Linyang Li , Xipeng Qiu

Diffusion-based planners have shown strong performance in short-horizon tasks but often fail in complex, long-horizon settings. We trace the failure to loose coupling between high-level (HL) sub-goal selection and low-level (LL) trajectory…

Robotics · Computer Science 2025-10-14 Ce Hao , Anxing Xiao , Zhiwei Xue , Harold Soh

The burgeoning presence of Large Language Models (LLM) is propelling the development of personalized recommender systems. Most existing LLM-based methods fail to sufficiently explore the multi-view graph structure correlations inherent in…

Information Retrieval · Computer Science 2025-07-30 Xu Guo , Tong Zhang , Yuanzhi Wang , Chenxu Wang , Fuyun Wang , Xudong Wang , Xiaoya Zhang , Xin Liu , Zhen Cui

In Conversational Recommendation Systems (CRS), the central question is how the conversational agent can naturally ask for user preferences and provide suitable recommendations. Existing works mainly follow the hierarchical architecture,…

Computation and Language · Computer Science 2023-10-24 Xian Li , Hongguang Shi , Yunfei Wang , Yeqin Zhang , Xubin Li , Cam-Tu Nguyen

Hierarchical Imitation Learning (HIL) is a promising approach for tackling long-horizon decision-making tasks. While it is a challenging task due to the lack of detailed supervisory labels for sub-goal learning, and reliance on hundreds to…

Artificial Intelligence · Computer Science 2024-10-04 Chengyang Gu , Yuxin Pan , Haotian Bai , Hui Xiong , Yize Chen

Safety in goal directed Reinforcement Learning (RL) settings has typically been handled through constraints over trajectories and have demonstrated good performance in primarily short horizon tasks. In this paper, we are specifically…

Artificial Intelligence · Computer Science 2024-01-10 Yuxiao Lu , Arunesh Sinha , Pradeep Varakantham

Goal-conditioned hierarchical reinforcement learning (HRL) is a promising approach for scaling up reinforcement learning (RL) techniques. However, it often suffers from training inefficiency as the action space of the high-level, i.e., the…

Machine Learning · Computer Science 2021-03-19 Tianren Zhang , Shangqi Guo , Tian Tan , Xiaolin Hu , Feng Chen

Conversational Recommender Systems (CRS) has become an emerging research topic seeking to perform recommendations through interactive conversations, which generally consist of generation and recommendation modules. Prior work on CRS tends…

Computation and Language · Computer Science 2022-09-26 Lingzhi Wang , Shafiq Joty , Wei Gao , Xingshan Zeng , Kam-Fai Wong

Cross-modal retrieval has become a highlighted research topic for retrieval across multimedia data such as image and text. A two-stage learning framework is widely adopted by most existing methods based on Deep Neural Network (DNN): The…

Multimedia · Computer Science 2017-08-09 Yuxin Peng , Jinwei Qi , Xin Huang , Yuxin Yuan

Conversational recommender systems (CRSs) aim to proactively capture user preferences through natural language dialogue and recommend high-quality items. To achieve this, CRS gathers user preferences via a dialog module and builds user…

Artificial Intelligence · Computer Science 2025-11-12 Zhenye Yang , Jinpeng Chen , Huan Li , Xiongnan Jin , Xuanyang Li , Junwei Zhang , Hongbo Gao , Kaimin Wei , Senzhang Wang