English
Related papers

Related papers: Large-scale Interactive Recommendation with Tree-s…

200 papers

Multi-task reinforcement learning (RL) aims to find a single policy that effectively solves multiple tasks at the same time. This paper presents a constrained formulation for multi-task RL where the goal is to maximize the average…

Optimization and Control · Mathematics 2024-05-07 Sihan Zeng , Thinh T. Doan , Justin Romberg

Deep reinforcement learning (DRL) has been proven its efficiency in capturing users' dynamic interests in recent literature. However, training a DRL agent is challenging, because of the sparse environment in recommender systems (RS), DRL…

Information Retrieval · Computer Science 2022-09-20 Xiaocong Chen , Siyu Wang , Lina Yao , Lianyong Qi , Yong Li

Slate recommendation, which presents users with a ranked item list in a single display, is ubiquitous across mainstream online platforms. Recent advances in generative models have shown significant potential for this task via autoregressive…

Information Retrieval · Computer Science 2026-02-25 Yunsheng Pang , Zijian Liu , Yudong Li , Shaojie Zhu , Zijian Luo , Chenyun Yu , Sikai Wu , Shichen Shen , Cong Xu , Bin Wang , Kai Jiang , Hongyong Yu , Chengxiang Zhuo , Zang Li

Sample inefficiency is a long-lasting problem in reinforcement learning (RL). The state-of-the-art estimates the optimal action values while it usually involves an extensive search over the state-action space and unstable optimization.…

Machine Learning · Computer Science 2019-11-27 Kaixiang Lin , Jiayu Zhou

Generative Recommendation (GR) has emerged as a transformative paradigm that reformulates the traditional cascade ranking system into a sequence-to-item generation task, facilitated by the use of discrete Semantic IDs (SIDs). However,…

Information Retrieval · Computer Science 2026-02-25 Zesheng Wang , Longfei Xu , Weidong Deng , Huimin Yan , Kaikui Liu , Xiangxiang Chu

Large Language Models (LLMs) are adept at generating responses based on information within their context. While this ability is useful for interacting with structured data like code files, another popular method, Retrieval-Augmented…

Computation and Language · Computer Science 2025-10-22 Mihir Gupte , Paolo Giusto , Ramesh S

Sequential recommendation systems aim to capture users' evolving preferences from their interaction histories. Recent reasoningenhanced methods have shown promise by introducing deliberate, chain-of-thought-like processes with intermediate…

Information Retrieval · Computer Science 2025-12-17 Yifan Shao , Peilin Zhou

Model-based methods for recommender systems have been studied extensively in recent years. In systems with large corpus, however, the calculation cost for the learnt model to predict all user-item preferences is tremendous, which makes full…

Machine Learning · Statistics 2018-12-24 Han Zhu , Xiang Li , Pengye Zhang , Guozheng Li , Jie He , Han Li , Kun Gai

Interactive Recommendation (IR) has gained significant attention recently for its capability to quickly capture dynamic interest and optimize both short and long term objectives. IR agents are typically implemented through Deep…

Information Retrieval · Computer Science 2025-06-17 Jingyu Li , Zhiyong Feng , Dongxiao He , Hongqi Chen , Qinghang Gao , Guoli Wu

Large Language Models (LLMs) have been integrated into recommendation systems to enhance user behavior comprehension. The Retrieval Augmented Generation (RAG) technique is further incorporated into these systems to retrieve more relevant…

Information Retrieval · Computer Science 2025-02-12 Jian Xu , Sichun Luo , Xiangyu Chen , Haoming Huang , Hanxu Hou , Linqi Song

When using a tool, the grasps used for picking it up, reposing, and holding it in a suitable pose for the desired task could be distinct. Therefore, a key challenge for autonomous in-hand tool manipulation is finding a sequence of grasps…

Robotics · Computer Science 2023-04-06 Ethan K. Gordon , Rana Soltani Zarrin

In the field of high-performance computing (HPC), there has been recent exploration into the use of deep reinforcement learning for cluster scheduling (DRL scheduling), which has demonstrated promising outcomes. However, a significant…

Machine Learning · Computer Science 2024-03-26 Boyang Li , Zhiling Lan , Michael E. Papka

Recent advances in path-based explainable recommendation systems have attracted increasing attention thanks to the rich information provided by knowledge graphs. Most existing explainable recommendations only utilize static knowledge graphs…

Information Retrieval · Computer Science 2021-11-25 Yicong Li , Hongxu Chen , Yile Li , Lin Li , Philip S. Yu , Guandong Xu

We introduce a new framework that performs decision-making in reinforcement learning (RL) as an iterative reasoning process. We model agent behavior as the steady-state distribution of a parameterized reasoning Markov chain (RMC), optimized…

Machine Learning · Computer Science 2022-10-14 Edoardo Cetin , Oya Celiktutan

Policy gradient (PG) is a reinforcement learning (RL) approach that optimizes a parameterized policy model for an expected return using gradient ascent. While PG can work well even in non-Markovian environments, it may encounter plateaus or…

Machine Learning · Computer Science 2024-07-08 Tetsuro Morimura , Kazuhiro Ota , Kenshi Abe , Peinan Zhang

In online advertising, recommender systems try to propose items from a list of products to potential customers according to their interests. Such systems have been increasingly deployed in E-commerce due to the rapid growth of information…

Artificial Intelligence · Computer Science 2021-02-02 Milad Vaali Esfahaani , Yanbo Xue , Peyman Setoodeh

Interpretability of AI models allows for user safety checks to build trust in such AIs. In particular, Decision Trees (DTs) provide a global look at the learned model and transparently reveal which features of the input are critical for…

Machine Learning · Computer Science 2024-01-23 Hector Kohler , Riad Akrour , Philippe Preux

Learned indices have been proposed to replace classic index structures like B-Tree with machine learning (ML) models. They require to replace both the indices and query processing algorithms currently deployed by the databases, and such a…

Databases · Computer Science 2021-10-12 Tu Gu , Kaiyu Feng , Gao Cong , Cheng Long , Zheng Wang , Sheng Wang

Offline reinforcement learning (RL) has emerged as a prevalent and effective methodology for real-world recommender systems, enabling learning policies from historical data and capturing user preferences. In offline RL, reward shaping…

Information Retrieval · Computer Science 2025-07-01 Wenzheng Shu , Yanxiang Zeng , Yongxiang Tang , Teng Sha , Ning Luo , Yanhua Cheng , Xialong Liu , Fan Zhou , Peng Jiang

Mechanical search (MS) in cluttered environments remains a significant challenge for autonomous manipulators, requiring long-horizon planning and robust state estimation under occlusions and partial observability. In this work, we introduce…

Robotics · Computer Science 2025-06-17 Yiting Zhang , Shichen Li , Elena Shrestha