English
Related papers

Related papers: Dual-space Hierarchical Learning for Goal-guided C…

200 papers

Many sequential decision-making problems exhibit hierarchical structure, where high-level semantic choices constrain downstream actions and feedback is delayed and ambiguous. Learning in such settings is challenging due to credit…

Artificial Intelligence · Computer Science 2026-05-05 Polydoros Giannouris , Yuechen Jiang , Lingfei Qian , Yuyan Wang , Xueqing Peng , Jimin Huang , Guojun Xiong , Sophia Ananiadou

Conversational recommender systems (CRS) based on Large Language Models (LLMs) need to constantly be aligned to the user preferences to provide satisfying and context-relevant item recommendations. The traditional supervised fine-tuning…

Machine Learning · Computer Science 2025-08-08 Zhongheng Yang , Aijia Sun , Yushang Zhao , Yinuo Yang , Dannier Li , Chengrui Zhou

We present a novel two-layer hierarchical reinforcement learning approach equipped with a Goals Relational Graph (GRG) for tackling the partially observable goal-driven task, such as goal-driven visual navigation. Our GRG captures the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Xin Ye , Yezhou Yang

Conversational recommender system (CRS) interacts with users through multi-turn dialogues in natural language, which aims to provide high-quality recommendations for user's instant information need. Although great efforts have been made to…

Information Retrieval · Computer Science 2023-10-27 Chenzhan Shang , Yupeng Hou , Wayne Xin Zhao , Yaliang Li , Jing Zhang

Goal-conditioned hierarchical reinforcement learning (GCHRL) provides a promising approach to solving long-horizon tasks. Recently, its success has been extended to more general settings by concurrently learning hierarchical policies and…

Machine Learning · Computer Science 2022-03-08 Siyuan Li , Jin Zhang , Jianhao Wang , Yang Yu , Chongjie Zhang

There has been a growing interest in developing data-driven, and in particular deep neural network (DNN) based methods for modern communication tasks. For a few popular tasks such as power control, beamforming, and MIMO detection, these…

Signal Processing · Electrical Eng. & Systems 2022-05-11 Haoran Sun , Wenqiang Pu , Xiao Fu , Tsung-Hui Chang , Mingyi Hong

Multimodal learning aims to capture both shared and private information from multiple modalities. However, existing methods that project all modalities into a single latent space for fusion often overlook the asynchronous, multi-level…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Chunlei Meng , Guanhong Huang , Rong Fu , Runmin Jian , Zhongxue Gan , Chun Ouyang

Conversational recommender systems (CRSs) aim to capture user preferences and provide personalized recommendations through multi-round natural language dialogues. However, most existing CRS models mainly focus on dialogue comprehension and…

Information Retrieval · Computer Science 2024-07-09 Yunjia Xi , Weiwen Liu , Jianghao Lin , Bo Chen , Ruiming Tang , Weinan Zhang , Yong Yu

This paper presents a novel self-supervised learning method for handling conversational documents consisting of transcribed text of human-to-human conversations. One of the key technologies for understanding conversational documents is…

Computation and Language · Computer Science 2021-02-17 Ryo Masumura , Naoki Makishima , Mana Ihori , Akihiko Takashima , Tomohiro Tanaka , Shota Orihashi

Conversational Recommender Systems (CRSs) have attracted growing attention for their ability to deliver personalized recommendations through natural language interactions. To more accurately infer user preferences from multi-turn…

Information Retrieval · Computer Science 2026-01-21 Wei Yuan , Shutong Qiao , Tong Chen , Quoc Viet Hung Nguyen , Zi Huang , Hongzhi Yin

Apart from discriminative models for classification and object detection tasks, the application of deep convolutional neural networks to basic research utilizing natural imaging data has been somewhat limited; particularly in cases where a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 R. Ian Etheredge , Manfred Schartl , Alex Jordan

Sequential Recommendation aims to recommend items that a target user will interact with in the near future based on the historically interacted items. While modeling temporal dynamics is crucial for sequential recommendation, most of the…

Information Retrieval · Computer Science 2021-09-27 Zeyuan Chen , Wei Zhang , Junchi Yan , Gang Wang , Jianyong Wang

While multimodal large language models (MLLMs) have made substantial progress in single-image spatial reasoning, multi-image spatial reasoning, which requires integration of information from multiple viewpoints, remains challenging.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Masanari Oi , Koki Maeda , Ryuto Koike , Daisuke Oba , Nakamasa Inoue , Naoaki Okazaki

We address the problem of learning hierarchical deep neural network policies for reinforcement learning. In contrast to methods that explicitly restrict or cripple lower layers of a hierarchy to force them to use higher-level modulating…

Machine Learning · Computer Science 2018-09-05 Tuomas Haarnoja , Kristian Hartikainen , Pieter Abbeel , Sergey Levine

Recent work in hierarchical reinforcement learning has shown success in scaling to billions of timesteps when learning over a set of predefined option reward functions. We show that, instead of using a single reward function per option, the…

Artificial Intelligence · Computer Science 2026-04-28 Michael Tryfan Matthews , Anssi Kanervisto , Jakob Foerster , Pierluca D'Oro , Scott Fujimoto , Mikael Henaff

Inspired by advances in LLMs, reasoning-enhanced sequential recommendation performs multi-step deliberation before making final predictions, unlocking greater potential for capturing user preferences. However, current methods are…

Information Retrieval · Computer Science 2025-12-17 Yifan Shao , Peilin Zhou , Shoujin Wang , Weizhi Zhang , Xu Cai , Sunghun Kim

Training chatbots using the reinforcement learning paradigm is challenging due to high-dimensional states, infinite action spaces and the difficulty in specifying the reward function. We address such problems using clustered actions instead…

Artificial Intelligence · Computer Science 2019-08-28 Heriberto Cuayáhuitl , Donghyeon Lee , Seonghan Ryu , Sungja Choi , Inchul Hwang , Jihie Kim

Multi-scale inference is commonly used to improve the results of semantic segmentation. Multiple images scales are passed through a network and then the results are combined with averaging or max pooling. In this work, we present an…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Andrew Tao , Karan Sapra , Bryan Catanzaro

Conversational Recommender Systems (CRSs)aim to engage users in dialogue to provide tailored recommendations. While traditional CRSs focus on eliciting preferences and retrieving items, real-world e-commerce interactions involve more…

Information Retrieval · Computer Science 2025-08-08 Tongyoung Kim , Jeongeun Lee , Soojin Yoon , Sunghwan Kim , Dongha Lee

Recently, conversational recommender system (CRS) has become an emerging and practical research topic. Most of the existing CRS methods focus on learning effective preference representations for users from conversation data alone. While, we…

Information Retrieval · Computer Science 2020-08-20 Kun Zhou , Wayne Xin Zhao , Hui Wang , Sirui Wang , Fuzheng Zhang , Zhongyuan Wang , Ji-Rong Wen