中文
相关论文

相关论文: Revisiting Model-based Value Expansion

200 篇论文

Model-based reinforcement learning (RL) algorithms allow us to combine model-generated data with those collected from interaction with the real system in order to alleviate the data efficiency problem in RL. However, designing such…

机器学习 · 计算机科学 2020-06-25 Yinlam Chow , Brandon Cui , MoonKyung Ryu , Mohammad Ghavamzadeh

This paper investigates how to incorporate expert observations (without explicit information on expert actions) into a deep reinforcement learning setting to improve sample efficiency. First, we formulate an augmented policy loss combining…

机器学习 · 计算机科学 2025-02-28 Erhan Can Ozcan , Vittorio Giammarino , James Queeney , Ioannis Ch. Paschalidis

Recent years have seen the application of deep reinforcement learning techniques to cooperative multi-agent systems, with great empirical success. However, given the lack of theoretical insight, it remains unclear what the employed neural…

多智能体系统 · 计算机科学 2024-12-20 Jacopo Castellini , Frans A. Oliehoek , Rahul Savani , Shimon Whiteson

Model-free reinforcement learning based methods such as Proximal Policy Optimization, or Q-learning typically require thousands of interactions with the environment to approximate the optimum controller which may not always be feasible in…

机器学习 · 计算机科学 2019-05-16 Narendra Patwardhan , Zequn Wang

Deep generative models are effective methods of modeling data. However, it is not easy for a single generative model to faithfully capture the distributions of complex data such as images. In this paper, we propose an approach for boosting…

机器学习 · 计算机科学 2019-05-14 Fan Bao , Hang Su , Jun Zhu

Mathematical and computational tools have proven to be reliable in decision-making processes. In recent times, in particular, machine learning-based methods are becoming increasingly popular as advanced support tools. When dealing with…

最优化与控制 · 数学 2024-02-23 Christina Schenk , Aditya Vasudevan , Maciej Haranczyk , Ignacio Romero

A common technique in reinforcement learning is to evaluate the value function from Monte Carlo simulations of a given policy, and use the estimated value function to obtain a new policy which is greedy with respect to the estimated value…

机器学习 · 计算机科学 2023-03-01 Anna Winnicki , R. Srikant

Multi-objective reinforcement learning (MORL) algorithms extend conventional reinforcement learning (RL) to the more general case of problems with multiple, conflicting objectives, represented by vector-valued rewards. Widely-used scalar RL…

机器学习 · 计算机科学 2026-04-23 Peter Vamplew , Ethan , Watkins , Cameron Foale , Richard Dazeley

Model-based next state prediction and state value prediction are slow to converge. To address these challenges, we do the following: i) Instead of a neural network, we do model-based planning using a parallel memory retrieval system (which…

人工智能 · 计算机科学 2023-02-02 John Chong Min Tan , Mehul Motani

Deep reinforcement learning has proven remarkably useful in training agents from unstructured data. However, the opacity of the produced agents makes it difficult to ensure that they adhere to various requirements posed by human engineers.…

机器学习 · 计算机科学 2022-02-10 Raz Yerushalmi , Guy Amir , Achiya Elyasaf , David Harel , Guy Katz , Assaf Marron

Model-based reinforcement learning (MBRL) is believed to have higher sample efficiency compared with model-free reinforcement learning (MFRL). However, MBRL is plagued by dynamics bottleneck dilemma. Dynamics bottleneck dilemma is the…

机器学习 · 计算机科学 2021-06-25 Xiyao Wang , Junge Zhang , Wenzhen Huang , Qiyue Yin

While research of reinforcement learning applied to financial markets predominantly concentrates on finding optimal behaviours, it is worth to realize that the reinforcement learning returns $G_t$ and state value functions themselves are of…

统计金融 · 定量金融 2024-05-21 Colin D. Grab

This paper investigates a new approach to model-based reinforcement learning using background planning: mixing (approximate) dynamic programming updates and model-free updates, similar to the Dyna architecture. Background planning with…

Continual Learning requires the model to learn from a stream of dynamic, non-stationary data without forgetting previous knowledge. Several approaches have been developed in the literature to tackle the Continual Learning challenge. Among…

机器学习 · 计算机科学 2022-11-30 Gabriele Merlin , Vincenzo Lomonaco , Andrea Cossu , Antonio Carta , Davide Bacciu

The aim of Reinforcement Learning (RL) in real-world applications is to create systems capable of making autonomous decisions by learning from their environment through trial and error. This paper emphasizes the importance of reward…

机器学习 · 计算机科学 2024-12-31 Sinan Ibrahim , Mostafa Mostafa , Ali Jnadi , Hadi Salloum , Pavel Osinenko

Efficiently tackling multiple tasks within complex environment, such as those found in robot manipulation, remains an ongoing challenge in robotics and an opportunity for data-driven solutions, such as reinforcement learning (RL).…

机器人学 · 计算机科学 2024-04-03 Carlos Plou , Ana C. Murillo , Ruben Martinez-Cantin

Efficient Reinforcement Learning usually takes advantage of demonstration or good exploration strategy. By applying posterior sampling in model-free RL under the hypothesis of GP, we propose Gaussian Process Posterior Sampling Reinforcement…

机器学习 · 计算机科学 2018-12-12 Ying Fan , Letian Chen , Yizhou Wang

Value-function approximation methods that operate in batch mode have foundational importance to reinforcement learning (RL). Finite sample guarantees for these methods often crucially rely on two types of assumptions: (1) mild distribution…

机器学习 · 计算机科学 2019-05-02 Jinglin Chen , Nan Jiang

Model-free deep-reinforcement-based learning algorithms have been applied to a range of COPs~\cite{bello2016neural}~\cite{kool2018attention}~\cite{nazari2018reinforcement}. However, these approaches suffer from two key challenges when…

机器学习 · 计算机科学 2022-06-01 Nasrin Sultana , Jeffrey Chan , Tabinda Sarwar , A. K. Qin

Recent breakthroughs in Go play and strategic games have witnessed the great potential of reinforcement learning in intelligently scheduling in uncertain environment, but some bottlenecks are also encountered when we generalize this…

机器学习 · 计算机科学 2018-12-27 Xingxing Liang , Qi Wang , Yanghe Feng , Zhong Liu , Jincai Huang