English
Related papers

Related papers: Future-Conditioned Recommendations with Multi-Obje…

200 papers

Decision Transformers have recently emerged as a new and compelling paradigm for offline Reinforcement Learning (RL), completing a trajectory in an autoregressive way. While improvements have been made to overcome initial shortcomings,…

Machine Learning · Computer Science 2024-11-01 Kai Yan , Alexander G. Schwing , Yu-Xiong Wang

Surgical robot task automation has been a promising research topic for improving surgical efficiency and quality. Learning-based methods have been recognized as an interesting paradigm and been increasingly investigated. However, existing…

Robotics · Computer Science 2024-05-30 Jiawei Fu , Yonghao Long , Kai Chen , Wang Wei , Qi Dou

The number of states in a dynamic process is exponential in the number of objects, making reinforcement learning (RL) difficult in complex, multi-object domains. For agents to scale to the real world, they will need to react to and reason…

Machine Learning · Computer Science 2022-10-21 Silviu Pitis , Elliot Creager , Ajay Mandlekar , Animesh Garg

Achieving autonomous agents with robust generalization capabilities across diverse games and tasks remains one of the ultimate goals in AI research. Recent advancements in transformer-based offline reinforcement learning, exemplified by the…

Machine Learning · Computer Science 2025-03-05 Kensuke Tatematsu , Akifumi Wachi

Recommender systems aim to recommend the most suitable items to users from a large number of candidates. Their computation cost grows as the number of user requests and the complexity of services (or models) increases. Under the limitation…

Information Retrieval · Computer Science 2024-01-04 Jiahong Zhou , Shunhui Mao , Guoliang Yang , Bo Tang , Qianlong Xie , Lebin Lin , Xingxing Wang , Dong Wang

Supervised learning approaches to offline reinforcement learning, particularly those utilizing the Decision Transformer, have shown effectiveness in continuous environments and for sparse rewards. However, they often struggle with…

Machine Learning · Computer Science 2024-09-17 Joseph Clinton , Robert Lieck

Offline reinforcement learning (RL) suffers from the distribution shift between the offline dataset and the online environment. In multi-agent RL (MARL), this distribution shift may arise from the nonstationary opponents in the online…

Machine Learning · Computer Science 2025-02-25 Tao Li , Juan Guevara , Xinhong Xie , Quanyan Zhu

The recent offline reinforcement learning (RL) studies have achieved much progress to make RL usable in real-world systems by learning policies from pre-collected datasets without environment interaction. Unfortunately, existing offline RL…

Artificial Intelligence · Computer Science 2022-04-22 Xianyuan Zhan , Xiangyu Zhu , Haoran Xu

Existing deep multi-object tracking (MOT) approaches first learn a deep representation to describe target objects and then associate detection results by optimizing a linear assignment problem. Despite demonstrated successes, it is…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Jun Xiang , Ma Chao , Guohan Xu , Jianhua Hou

Many sequential decision-making tasks involve optimizing multiple conflicting objectives, requiring policies that adapt to different user preferences. In multi-objective reinforcement learning (MORL), one widely studied approach} addresses…

Machine Learning · Computer Science 2026-04-28 Ying-Tu Chen , Wei Hung , Bing-Shu Wu , Zhang-Wei Hong , Ping-Chun Hsieh

Sequential recommendation requires the recommender to capture the evolving behavior characteristics from logged user behavior data for accurate recommendations. However, user behavior sequences are viewed as a script with multiple ongoing…

Information Retrieval · Computer Science 2022-06-15 Zhiyu Yao , Xinyang Chen , Sinan Wang , Qinyan Dai , Yumeng Li , Tanchao Zhu , Mingsheng Long

Transferring knowledge across a sequence of related tasks is an important challenge in reinforcement learning (RL). Despite much encouraging empirical evidence, there has been little theoretical analysis. In this paper, we study a class of…

Machine Learning · Computer Science 2015-09-23 Emma Brunskill , Lihong Li

Sequential Recommendation (SR) aims to predict future user-item interactions based on historical interactions. While many SR approaches concentrate on user IDs and item IDs, the human perception of the world through multi-modal signals,…

Information Retrieval · Computer Science 2024-10-08 Youhua Li , Hanwen Du , Yongxin Ni , Yuanqi He , Junchen Fu , Xiangyan Liu , Qi Guo

Modern recommender systems operate in uniquely dynamic settings: user interests, item pools, and popularity trends shift continuously, and models must adapt in real time without forgetting past preferences. While existing tutorials on…

Information Retrieval · Computer Science 2025-07-08 Hyunsik Yoo , SeongKu Kang , Hanghang Tong

Algorithmic recourse seeks to provide individuals with actionable recommendations that increase their chances of receiving favorable outcomes from automated decision systems (e.g., loan approvals). While prior research has emphasized…

Machine Learning · Computer Science 2026-02-03 Marina Ceccon , Alessandro Fabris , Goran Radanović , Asia J. Biega , Gian Antonio Susto

Planning for both immediate and long-term benefits becomes increasingly important in recommendation. Existing methods apply Reinforcement Learning (RL) to learn planning capacity by maximizing cumulative reward for long-term recommendation.…

Information Retrieval · Computer Science 2024-04-29 Wentao Shi , Xiangnan He , Yang Zhang , Chongming Gao , Xinyue Li , Jizhi Zhang , Qifan Wang , Fuli Feng

The paradigm of decision-making has been revolutionised by reinforcement learning and deep learning. Although this has led to significant progress in domains such as robotics, healthcare, and finance, the use of RL in practice is…

Machine Learning · Computer Science 2026-02-23 Daqian Shao

Acquiring valuable data from the rapidly expanding information on the internet has become a significant concern, and recommender systems have emerged as a widely used and effective tool for helping users discover items of interest. The…

Information Retrieval · Computer Science 2025-02-25 Jinfeng Xu , Zheyu Chen , Shuo Yang , Jinze Li , Wei Wang , Xiping Hu , Steven Hoi , Edith Ngai

Offline reinforcement learning (RL) aims at learning policies from previously collected static trajectory data without interacting with the real environment. Recent works provide a novel perspective by viewing offline RL as a generic…

Machine Learning · Computer Science 2022-10-19 Kerong Wang , Hanye Zhao , Xufang Luo , Kan Ren , Weinan Zhang , Dongsheng Li

This paper investigates manipulation of multiple unknown objects in a crowded environment. Because of incomplete knowledge due to unknown objects and occlusions in visual observations, object observations are imperfect and action success is…

Robotics · Computer Science 2014-07-09 Joni Pajarinen , Ville Kyrki