中文
相关论文

相关论文: Learning State Representations from Random Deep Ac…

200 篇论文

Although deep reinforcement learning agents have produced impressive results in many domains, their decision making is difficult to explain to humans. To address this problem, past work has mainly focused on explaining why an action was…

机器学习 · 计算机科学 2019-10-01 Matthew L. Olson , Lawrence Neal , Fuxin Li , Weng-Keen Wong

Neural networks allow Q-learning reinforcement learning agents such as deep Q-networks (DQN) to approximate complex mappings from state spaces to value functions. However, this also brings drawbacks when compared to other function…

机器学习 · 计算机科学 2018-06-21 Jack Shannon , Marek Grzes

Learning good feature representations is important for deep reinforcement learning (RL). However, with limited experience, RL often suffers from data inefficiency for training. For un-experienced or less-experienced trajectories (i.e.,…

机器学习 · 计算机科学 2021-10-28 Tao Yu , Cuiling Lan , Wenjun Zeng , Mingxiao Feng , Zhizheng Zhang , Zhibo Chen

State representation learning, or the ability to capture latent generative factors of an environment, is crucial for building intelligent agents that can perform a wide variety of tasks. Learning such representations without supervision…

机器学习 · 计算机科学 2020-11-09 Ankesh Anand , Evan Racah , Sherjil Ozair , Yoshua Bengio , Marc-Alexandre Côté , R Devon Hjelm

Representation learning methods are an important tool for addressing the challenges posed by complex observations spaces in sequential decision making problems. Recently, many methods have used a wide variety of types of approaches for…

机器学习 · 计算机科学 2025-06-24 Ayoub Echchahed , Pablo Samuel Castro

Counterfactual explanations, which deal with "why not?" scenarios, can provide insightful explanations to an AI agent's behavior. In this work, we focus on generating counterfactual explanations for deep reinforcement learning (RL) agents…

人工智能 · 计算机科学 2021-02-01 Matthew L. Olson , Roli Khanna , Lawrence Neal , Fuxin Li , Weng-Keen Wong

While research of reinforcement learning applied to financial markets predominantly concentrates on finding optimal behaviours, it is worth to realize that the reinforcement learning returns $G_t$ and state value functions themselves are of…

统计金融 · 定量金融 2024-05-21 Colin D. Grab

In deep Reinforcement Learning (RL), value functions are typically approximated using deep neural networks and trained via mean squared error regression objectives to fit the true value functions. Recent research has proposed an alternative…

机器学习 · 计算机科学 2024-11-19 Denis Tarasov , Kirill Brilliantov , Dmitrii Kharlapenko

This paper shows how a single mechanism allows knowledge to be constructed layer by layer directly from an agent's raw sensorimotor stream. This mechanism, the General Value Function (GVF) or "forecast," captures high-level, abstract…

人工智能 · 计算机科学 2021-12-14 Mark Ring

When using reinforcement learning (RL) algorithms it is common, given a large state space, to introduce some form of approximation architecture for the value function (VF). The exact form of this architecture can have a significant effect…

机器学习 · 计算机科学 2019-02-19 Edward Barker , Charl Ras

A fairly reliable trend in deep reinforcement learning is that the performance scales with the number of parameters, provided a complimentary scaling in amount of training data. As the appetite for large models increases, it is imperative…

机器学习 · 计算机科学 2023-06-14 Bogdan Mazoure , Walter Talbott , Miguel Angel Bautista , Devon Hjelm , Alexander Toshev , Josh Susskind

Reinforcement learning (RL) agents make decisions using nothing but observations from the environment, and consequently, heavily rely on the representations of those observations. Though some recent breakthroughs have used vector-based…

机器学习 · 计算机科学 2024-07-16 Edan Meyer , Adam White , Marlos C. Machado

A good state representation is crucial to solving complicated reinforcement learning (RL) challenges. Many recent works focus on designing auxiliary losses for learning informative representations. Unfortunately, these handcrafted…

机器学习 · 计算机科学 2022-10-13 Tairan He , Yuge Zhang , Kan Ren , Minghuan Liu , Che Wang , Weinan Zhang , Yuqing Yang , Dongsheng Li

Due to its property of not requiring prior knowledge of the environment, reinforcement learning has significant potential for quantum control problems. In this work, we investigate the effectiveness of continuous control policies based on…

量子物理 · 物理学 2023-03-01 Shumin Zhou , Hailan Ma , Sen Kuang , Daoyi Dong

Reinforcement learning (RL) algorithms allow artificial agents to improve their selection of actions to increase rewarding experiences in their environments. Temporal Difference (TD) Learning -- a model-free RL method -- is a leading…

机器学习 · 计算机科学 2019-09-05 Jacob Rafati , David C. Noelle

Image-based reinforcement learning (RL) faces significant challenges in generalization when the visual environment undergoes substantial changes between training and deployment. Under such circumstances, learned policies may not perform…

机器人学 · 计算机科学 2024-07-25 Weiyao Wang , Xinyuan Fang , Gregory D. Hager

Many real-world reinforcement learning (RL) problems necessitate learning complex, temporally extended behavior that may only receive reward signal when the behavior is completed. If the reward-worthy behavior is known, it can be specified…

机器学习 · 计算机科学 2023-01-10 Phillip J. K. Christoffersen , Andrew C. Li , Rodrigo Toro Icarte , Sheila A. McIlraith

In recent years, challenging control problems became solvable with deep reinforcement learning (RL). To be able to use RL for large-scale real-world applications, a certain degree of reliability in their performance is necessary. Reported…

机器学习 · 计算机科学 2020-11-11 Nirnai Rao , Elie Aljalbout , Axel Sauer , Sami Haddadin

We propose and demonstrate a framework called perception as prediction for autonomous driving that uses general value functions (GVFs) to learn predictions. Perception as prediction learns data-driven predictions relating to the impact of…

机器人学 · 计算机科学 2020-01-27 Daniel Graves , Kasra Rezaee , Sean Scheideman

Residual reinforcement learning (RL) has been proposed as a way to solve challenging robotic tasks by adapting control actions from a conventional feedback controller to maximize a reward signal. We extend the residual formulation to learn…

机器学习 · 计算机科学 2021-06-16 Minttu Alakuijala , Gabriel Dulac-Arnold , Julien Mairal , Jean Ponce , Cordelia Schmid