English
Related papers

Related papers: Surveys without Questions: A Reinforcement Learnin…

200 papers

Preference-based reinforcement learning (PBRL) in the offline setting has succeeded greatly in industrial applications such as chatbots. A two-step learning framework where one applies a reinforcement learning step after a reward modeling…

Reinforcement Learning (RL) has empowered Large Language Models (LLMs) to master autonomous search for complex question answering. However, particularly within multi-turn search scenarios, this interaction introduces a critical challenge:…

Computation and Language · Computer Science 2026-02-13 Wenlin Zhong , Jinluan Yang , Yiquan Wu , Yi Liu , Jianhang Yao , Kun Kuang

Presentation bias is one of the key challenges when learning from implicit feedback in search engines, as it confounds the relevance signal with uninformative signals due to position in the ranking, saliency, and other presentation factors.…

Machine Learning · Computer Science 2018-06-12 Aman Agarwal , Ivan Zaitsev , Thorsten Joachims

The goal of reinforcement learning (RL) is to let an agent learn an optimal control policy in an unknown environment so that future expected rewards are maximized. The model-free RL approach directly learns the policy based on data samples.…

Machine Learning · Statistics 2013-07-22 Syogo Mori , Voot Tangkaratt , Tingting Zhao , Jun Morimoto , Masashi Sugiyama

Preference-based reinforcement learning (PbRL) has shown impressive capabilities in training agents without reward engineering. However, a notable limitation of PbRL is its dependency on substantial human feedback. This dependency stems…

Machine Learning · Computer Science 2024-05-30 Fengshuo Bai , Rui Zhao , Hongming Zhang , Sijia Cui , Ying Wen , Yaodong Yang , Bo Xu , Lei Han

Reinforcement learning (RL) is a general framework for adaptive control, which has proven to be efficient in many domains, e.g., board games, video games or autonomous vehicles. In such problems, an agent faces a sequential decision-making…

Machine Learning · Computer Science 2020-06-16 Olivier Buffet , Olivier Pietquin , Paul Weng

Reinforcement learning (RL) has emerged as a transformative approach for financial trading, enabling dynamic strategy optimization in complex markets. This study explores the integration of sentiment analysis, derived from large language…

Computational Finance · Quantitative Finance 2024-11-19 Ananya Unnikrishnan

Conveying complex objectives to reinforcement learning (RL) agents often requires meticulous reward engineering. Preference-based RL methods are able to learn a more flexible reward model based on human preferences by actively incorporating…

Machine Learning · Computer Science 2022-05-26 Xinran Liang , Katherine Shu , Kimin Lee , Pieter Abbeel

Reinforcement learning (RL) is an innovative approach to financial decision making, offering specialized solutions to complex investment problems where traditional methods fail. This review analyzes 167 articles from 2017--2025, focusing on…

Computational Finance · Quantitative Finance 2025-12-12 Mohammad Rezoanul Hoque , Md Meftahul Ferdaus , M. Kabir Hassan

Reinforcement Learning (RL) traditionally relies on scalar reward signals, limiting its ability to leverage the rich semantic knowledge often available in real-world tasks. In contrast, humans learn efficiently by combining numerical…

To identify the most appropriate recommendation model for an e-commerce business, a live evaluation should be performed on the shopping website to measure the influence of personalization in real-time. The aim of this paper is to introduce…

Information Retrieval · Computer Science 2019-01-28 Namrata Chaudhary , Drimik Roy Chowdhury

Inspired by conversational reading comprehension (CRC), this paper studies a novel task of leveraging reviews as a source to build an agent that can answer multi-turn questions from potential consumers of online businesses. We first build a…

Computation and Language · Computer Science 2019-11-07 Hu Xu , Bing Liu , Lei Shu , Philip S. Yu

Reinforcement learning (RL) solves sequential decision-making problems via a trial-and-error process interacting with the environment. While RL achieves outstanding success in playing complex video games that allow huge trial-and-error,…

Machine Learning · Computer Science 2022-06-22 Fan-Ming Luo , Tian Xu , Hang Lai , Xiong-Hui Chen , Weinan Zhang , Yang Yu

Reinforcement learning (RL) is concerned with how intelligence agents take actions in a given environment to maximize the cumulative reward they receive. In healthcare, applying RL algorithms could assist patients in improving their health…

Machine Learning · Statistics 2025-04-21 Chengchun Shi

Recommender system plays a crucial role in modern E-commerce platform. Due to the lack of historical interactions between users and items, cold-start recommendation is a challenging problem. In order to alleviate the cold-start issue, most…

Information Retrieval · Computer Science 2021-08-23 Luo Ji , Qin Qi , Bingqing Han , Hongxia Yang

Multi-turn interactions between large language models (LLMs) and users naturally include implicit feedback signals. If an LLM responds in an unexpected way to an instruction, the user is likely to signal it by rephrasing the request,…

Computation and Language · Computer Science 2025-05-22 Zizhao Chen , Mustafa Omer Gul , Yiwei Chen , Gloria Geng , Anne Wu , Yoav Artzi

Reinforcement learning (RL) has shown great promise with algorithms learning in environments with large state and action spaces purely from scalar reward signals. A crucial challenge for current deep RL algorithms is that they require a…

Machine Learning · Computer Science 2023-11-23 Shivakanth Sujit , Pedro H. M. Braga , Jorg Bornschein , Samira Ebrahimi Kahou

Presentation bias is one of the key challenges when learning from implicit feedback in search engines, as it confounds the relevance signal. While it was recently shown how counterfactual learning-to-rank (LTR) approaches…

Information Retrieval · Computer Science 2018-12-14 Aman Agarwal , Ivan Zaitsev , Xuanhui Wang , Cheng Li , Marc Najork , Thorsten Joachims

Reinforcement learning (RL) to improve code review comment generation requires handling unstructured outputs, making reinforcement learning (RL) feedback challenging. The two main RL approaches, namely RL with Verifiable Feedback (RLVR) and…

Software Engineering · Computer Science 2025-06-03 Manav Nitin Kapadnis , Atharva Naik , Carolyn Rose

Clickthrough data is a particularly inexpensive and plentiful resource to obtain implicit relevance feedback for improving and personalizing search engines. However, it is well known that the probability of a user clicking on a result is…

Information Retrieval · Computer Science 2007-05-23 Filip Radlinski , Thorsten Joachims