English
Related papers

Related papers: Self-Consistent Models and Values

200 papers

Reinforcement learning (RL) algorithms usually require a substantial amount of interaction data and perform well only for specific tasks in a fixed environment. In some scenarios such as healthcare, however, usually only few records are…

Machine Learning · Computer Science 2020-12-17 Chaochao Lu , Biwei Huang , Ke Wang , José Miguel Hernández-Lobato , Kun Zhang , Bernhard Schölkopf

Reinforcement learning works best when the impact of the agent's actions on its environment can be perfectly simulated or fully appraised from available data. Some systems are however both hard to simulate and very sensitive to small…

Trading and Market Microstructure · Quantitative Finance 2025-01-30 Vincent Ragel , Damien Challet

Designing reliable decision strategies for autonomous urban driving is challenging. Reinforcement learning (RL) has been used to automatically derive suitable behavior in uncertain environments, but it does not provide any guarantee on the…

Reinforcement learning (RL) has improved guided image generation with diffusion models by directly optimizing rewards that capture image quality, aesthetics, and instruction following capabilities. However, the resulting generative policies…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Owen Oertell , Jonathan D. Chang , Yiyi Zhang , Kianté Brantley , Wen Sun

In recent years, on-policy reinforcement learning (RL) has been successfully applied to many different continuous control tasks. While RL algorithms are often conceptually simple, their state-of-the-art implementations take numerous low-…

Reinforcement Learning (RL) remains a central optimisation framework in machine learning. Although RL agents can converge to optimal solutions, the definition of ``optimality'' depends on the environment's statistical properties. The…

Machine Learning · Computer Science 2026-01-14 Bert Verbruggen , Arne Vanhoyweghen , Vincent Ginis

The effectiveness of Reinforcement Learning (RL) in Large Language Models (LLMs) depends on the nature and diversity of the data used before and during RL. In particular, reasoning problems can often be approached in multiple ways that rely…

Artificial Intelligence · Computer Science 2026-05-12 Aswin RRV , Jacob Dineen , Divij Handa , Mihir Parmar , Ben Zhou , Swaroop Mishra , Chitta Baral

Score-based generative models like the diffusion model have been testified to be effective in modeling multi-modal data from image generation to reinforcement learning (RL). However, the inference process of diffusion model can be slow,…

Machine Learning · Computer Science 2024-03-18 Zihan Ding , Chi Jin

Model-Free Reinforcement Learning has achieved meaningful results in stable environments but, to this day, it remains problematic in regime changing environments like financial markets. In contrast, model-based RL is able to capture some…

Machine Learning · Computer Science 2021-04-23 Eric Benhamou , David Saltiel , Serge Tabachnik , Sui Kai Wong , François Chareyron

This work shows that value-aware model learning, known for its numerous theoretical benefits, is also practically viable for solving challenging continuous control tasks in prevalent model-based reinforcement learning algorithms. First, we…

Machine Learning · Computer Science 2022-01-31 Nirbhay Modhe , Harish Kamath , Dhruv Batra , Ashwin Kalyan

Flow Matching (FM) has shown remarkable ability in modeling complex distributions and achieves strong performance in offline imitation learning for cloning expert behaviors. However, despite its behavioral cloning expressiveness, FM-based…

Machine Learning · Computer Science 2025-10-14 Zhenglin Wan , Jingxuan Wu , Xingrui Yu , Chubin Zhang , Mingcong Lei , Bo An , Ivor Tsang

Recent advances at the intersection of reinforcement learning (RL) and visual intelligence have enabled agents that not only perceive complex visual scenes but also reason, generate, and act within them. This survey offers a critical and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Weijia Wu , Chen Gao , Joya Chen , Kevin Qinghong Lin , Qingwei Meng , Yiming Zhang , Yuke Qiu , Hong Zhou , Mike Zheng Shou

Model-based reinforcement learning promises to learn an optimal policy from fewer interactions with the environment compared to model-free reinforcement learning by learning an intermediate model of the environment in order to predict…

Machine Learning · Computer Science 2022-06-08 Abhinav Bhatia , Philip S. Thomas , Shlomo Zilberstein

Reinforcement Learning (RL)-based recommender systems have demonstrated promising performance in meeting user expectations by learning to make accurate next-item recommendations from historical user-item interactions. However, existing…

Information Retrieval · Computer Science 2024-03-26 Jie Wang , Alexandros Karatzoglou , Ioannis Arapakis , Joemon M. Jose

The problem of reinforcement learning is considered where the environment or the model undergoes a change. An algorithm is proposed that an agent can apply in such a problem to achieve the optimal long-time discounted reward. The algorithm…

Systems and Control · Electrical Eng. & Systems 2023-04-25 Wuxia Chen , Taposh Banerjee , Jemin George , Carl Busart

Continually solving new, unsolved tasks is the key to learning diverse behaviors. Through reinforcement learning (RL), we have made massive strides towards solving tasks that have a single goal. However, in the multi-task domain, where an…

Machine Learning · Computer Science 2020-06-18 Yunzhi Zhang , Pieter Abbeel , Lerrel Pinto

Urban autonomous driving decision making is challenging due to complex road geometry and multi-agent interactions. Current decision making methods are mostly manually designing the driving policy, which might result in sub-optimal solutions…

Machine Learning · Computer Science 2019-10-23 Jianyu Chen , Bodi Yuan , Masayoshi Tomizuka

When Reinforcement Learning (RL) agents are deployed in practice, they might impact their environment and change its dynamics. We propose a new framework to model this phenomenon, where the current environment depends on the deployed policy…

Machine Learning · Computer Science 2024-06-03 Ben Rank , Stelios Triantafyllou , Debmalya Mandal , Goran Radanovic

In value-based reinforcement learning (RL), unlike in supervised learning, the agent faces not a single, stationary, approximation problem, but a sequence of value prediction problems. Each time the policy improves, the nature of the…

Machine Learning · Computer Science 2021-01-05 Will Dabney , André Barreto , Mark Rowland , Robert Dadashi , John Quan , Marc G. Bellemare , David Silver

This paper explores the application of a reinforcement learning (RL) framework using the Q-Learning algorithm to enhance dynamic pricing strategies in the retail sector. Unlike traditional pricing methods, which often rely on static demand…

Machine Learning · Computer Science 2024-11-28 Mohit Apte , Ketan Kale , Pranav Datar , Pratiksha Deshmukh