English
Related papers

Related papers: Offline Evaluation for Reinforcement Learning-base…

200 papers

Recently, robust reinforcement learning (RL) methods against input observation have garnered significant attention and undergone rapid evolution due to RL's potential vulnerability. Although these advanced methods have achieved reasonable…

Machine Learning · Computer Science 2024-09-04 Kosuke Nakanishi , Akihiro Kubo , Yuji Yasui , Shin Ishii

Pretraining reinforcement learning (RL) models on offline datasets is a promising way to improve their training efficiency in online tasks, but challenging due to the inherent mismatch in dynamics and behaviors across various tasks. We…

Machine Learning · Computer Science 2024-06-06 Minting Pan , Yitao Zheng , Yunbo Wang , Xiaokang Yang

In this work, we argue for the importance of an online evaluation budget for a reliable comparison of deep offline RL algorithms. First, we delineate that the online evaluation budget is problem-dependent, where some problems allow for less…

Machine Learning · Computer Science 2022-06-07 Vladislav Kurenkov , Sergey Kolesnikov

Evaluating and optimizing policies in the presence of unobserved confounders is a problem of growing interest in offline reinforcement learning. Using conventional methods for offline RL in the presence of confounding can not only lead to…

Machine Learning · Statistics 2023-11-08 Chinmaya Kausik , Yangyi Lu , Kevin Tan , Maggie Makar , Yixin Wang , Ambuj Tewari

Offline reinforcement learning (RL) tries to learn the near-optimal policy with recorded offline experience without online exploration. Current offline RL research includes: 1) generative modeling, i.e., approximating a policy using fixed…

Machine Learning · Computer Science 2021-06-23 Hua Wei , Deheng Ye , Zhao Liu , Hao Wu , Bo Yuan , Qiang Fu , Wei Yang , Zhenhui Li

Recommender Systems have been the cornerstone of online retailers. Traditionally they were based on rules, relevance scores, ranking algorithms, and supervised learning algorithms, but now it is feasible to use reinforcement learning…

Information Retrieval · Computer Science 2021-10-08 Lucas Farris

In preference-based reinforcement learning (PbRL), a reward function is learned from a type of human feedback called preference. To expedite preference collection, recent works have leveraged \emph{offline preferences}, which are…

Machine Learning · Computer Science 2024-03-18 Guoxi Zhang , Han Bao , Hisashi Kashima

We investigate what specific design choices enable successful online reinforcement learning (RL) on physical robots. Across 100 real-world training runs on three distinct robotic platforms, we systematically ablate algorithmic, systems, and…

Digital human recommendation system has been developed to help customers find their favorite products and is playing an active role in various recommendation contexts. How to timely catch and learn the dynamics of the preferences of the…

Information Retrieval · Computer Science 2022-11-07 Xiong Junwu , Xiaoyun Feng , YunZhou Shi , James Zhang , Zhongzhou Zhao , Wei Zhou

Reinforcement learning (RL) is a branch of machine learning which is employed to solve various sequential decision making problems without proper supervision. Due to the recent advancement of deep learning, the newly proposed Deep-RL…

Artificial Intelligence · Computer Science 2019-04-17 Dhruv Ramani

Evaluation of recommender systems is typically done with finite datasets. This means that conventional evaluation methodologies are only applicable in offline experiments, where data and models are stationary. However, in real world…

Information Retrieval · Computer Science 2015-05-04 João Vinagre , Alípio Mário Jorge , João Gama

In academic literature, recommender systems are often evaluated on the task of next-item prediction. The procedure aims to give an answer to the question: "Given the natural sequence of user-item interactions up to time t, can we predict…

Information Retrieval · Computer Science 2019-07-30 Olivier Jeunen , David Rohde , Flavian Vasile

Link adaptation (LA) is an essential function in modern wireless communication systems that dynamically adjusts the transmission rate of a communication link to match time- and frequency-varying radio link conditions. However, factors such…

Machine Learning · Computer Science 2024-12-02 Samuele Peri , Alessio Russo , Gabor Fodor , Pablo Soldati

Recommender selects and presents top-K items to the user at each online request, and a recommendation session consists of several sequential requests. Formulating a recommendation session as a Markov decision process and solving it by…

Information Retrieval · Computer Science 2024-05-06 Peilun Zhou , Xiaoxiao Xu , Lantao Hu , Han Li , Peng Jiang

How can we train a dialog model to produce better conversations by learning from human feedback, without the risk of humans teaching it harmful chat behaviors? We start by hosting models online, and gather human feedback from real-time,…

We present a novel podcast recommender system deployed at industrial scale. This system successfully optimizes personal listening journeys that unfold over months for hundreds of millions of listeners. In deviating from the pervasive…

Machine Learning · Computer Science 2024-07-30 Lucas Maystre , Daniel Russo , Yu Zhao

Inverse Reinforcement Learning (IRL) -- the problem of learning reward functions from demonstrations of an \emph{expert policy} -- plays a critical role in developing intelligent systems. While widely used in applications, theoretical…

Machine Learning · Statistics 2024-02-13 Lei Zhao , Mengdi Wang , Yu Bai

Recommendation systems have been integrated into the majority of large online systems to filter and rank information according to user profiles. It thus influences the way users interact with the system and, as a consequence, bias the…

Information Retrieval · Computer Science 2015-11-05 Arnaud De Myttenaere , Boris Golden , Bénédicte Le Grand , Fabrice Rossi

Offline reinforcement learning (RL), also known as batch RL, aims to optimize policy from a large pre-recorded dataset without interaction with the environment. This setting offers the promise of utilizing diverse, pre-collected datasets to…

Machine Learning · Computer Science 2021-01-05 Qiang He , Xinwen Hou

Online matching problems arise in many complex systems, from cloud services and online marketplaces to organ exchange networks, where timely, principled decisions are critical for maintaining high system performance. Traditional heuristics…

Machine Learning · Statistics 2025-10-09 Chiara Mignacco , Matthieu Jonckheere , Gilles Stoltz