中文
相关论文

相关论文: State Abstraction in MAXQ Hierarchical Reinforceme…

200 篇论文

Previous work in hierarchical reinforcement learning has faced a dilemma: either ignore the values of different possible exit states from a subroutine, thereby risking suboptimal behavior, or represent those values explicitly thereby…

机器学习 · 计算机科学 2012-07-02 Bhaskara Marthi , Stuart Russell , David Andre

This review addresses the problem of learning abstract representations of the measurement data in the context of Deep Reinforcement Learning (DRL). While the data are often ambiguous, high-dimensional, and complex to interpret, many…

机器学习 · 计算机科学 2024-05-31 Nicolò Botteghi , Mannes Poel , Christoph Brune

Formally verifying Deep Reinforcement Learning (DRL) systems is a challenging task due to the dynamic continuity of system behaviors and the black-box feature of embedded neural networks. In this paper, we propose a novel abstraction-based…

人工智能 · 计算机科学 2021-06-15 Peng Jin , Min Zhang , Jianwen Li , Li Han , Xuejun Wen

Recent studies show that deep reinforcement learning (DRL) agents tend to overfit to the task on which they were trained and fail to adapt to minor environment changes. To expedite learning when transferring to unseen tasks, we propose a…

人工智能 · 计算机科学 2024-02-22 Guy Azran , Mohamad H. Danesh , Stefano V. Albrecht , Sarah Keren

We describe a framework for using natural language to design state abstractions for imitation learning. Generalizable policy learning in high-dimensional observation spaces is facilitated by well-designed state representations, which can…

Planning methods can solve temporally extended sequential decision making problems by composing simple behaviors. However, planning requires suitable abstractions for the states and transitions, which typically need to be designed by hand.…

机器学习 · 计算机科学 2019-11-20 Soroush Nasiriany , Vitchyr H. Pong , Steven Lin , Sergey Levine

Latent-state environments with long horizons, such as those faced by recommender systems, pose significant challenges for reinforcement learning (RL). In this work, we identify and analyze several key hurdles for RL in such environments,…

机器学习 · 计算机科学 2019-06-03 Martin Mladenov , Ofer Meshi , Jayden Ooi , Dale Schuurmans , Craig Boutilier

Enabling reinforcement learning (RL) agents to leverage a knowledge base while learning from experience promises to advance RL in knowledge intensive domains. However, it has proven difficult to leverage knowledge that is not manually…

人工智能 · 计算机科学 2022-05-03 Niklas Höpner , Ilaria Tiddi , Herke van Hoof

We introduce the Neural State Machine, seeking to bridge the gap between the neural and symbolic views of AI and integrate their complementary strengths for the task of visual reasoning. Given an image, we first predict a probabilistic…

人工智能 · 计算机科学 2019-11-26 Drew A. Hudson , Christopher D. Manning

Deliberating on large or continuous state spaces have been long standing challenges in reinforcement learning. Temporal Abstraction have somewhat made this possible, but efficiently planing using temporal abstraction still remains an issue.…

人工智能 · 计算机科学 2017-03-21 Peeyush Kumar , Doina Precup

Our work aims at developing reinforcement learning algorithms that do not rely on the Markov assumption. We consider the class of Non-Markov Decision Processes where histories can be abstracted into a finite set of states while preserving…

机器学习 · 计算机科学 2022-05-19 Alessandro Ronca , Gabriel Paludo Licks , Giuseppe De Giacomo

Hierarchical Modular Reinforcement Learning (HMRL), consists of 2 layered learning where Profit Sharing works to plan a prey position in the higher layer and Q-learning method trains the state-actions to the target in the lower layer. In…

机器学习 · 计算机科学 2018-04-10 Takumi Ichimura , Daisuke Igaue

Deep reinforcement learning is quickly changing the field of artificial intelligence. These models are able to capture a high level understanding of their environment, enabling them to learn difficult dynamic tasks in a variety of domains.…

数据库 · 计算机科学 2018-03-26 Jennifer Ortiz , Magdalena Balazinska , Johannes Gehrke , S. Sathiya Keerthi

In the domain of combat simulations, the training and deployment of deep reinforcement learning (RL) agents still face substantial challenges due to the dynamic and intricate nature of such environments. Unfortunately, as the complexity of…

机器学习 · 计算机科学 2024-08-27 Scotty Black , Christian Darken

Not having access to compact and meaningful representations is known to significantly increase the complexity of reinforcement learning (RL). For this reason, it can be useful to perform state representation learning (SRL) before tackling…

机器学习 · 计算机科学 2022-02-16 Astrid Merckling , Nicolas Perrin-Gilbert , Alex Coninx , Stéphane Doncieux

This paper presents a way of solving Markov Decision Processes that combines state abstraction and temporal abstraction. Specifically, we combine state aggregation with the options framework and demonstrate that they work well together and…

人工智能 · 计算机科学 2015-01-19 Kamil Ciosek , David Silver

Hierarchical Reinforcement Learning algorithms have successfully been applied to temporal credit assignment problems with sparse reward signals. However, state-of-the-art algorithms require manual specification of sub-task structures, a…

机器学习 · 计算机科学 2019-09-24 Robert Tjarko Lange , Aldo Faisal

Successful applications of reinforcement learning in real-world problems often require dealing with partially observable states. It is in general very challenging to construct and infer hidden states as they often depend on the agent's…

机器学习 · 计算机科学 2015-11-20 Xiujun Li , Lihong Li , Jianfeng Gao , Xiaodong He , Jianshu Chen , Li Deng , Ji He

Reinforcement Learning (RL) based methods have seen their paramount successes in solving serial decision-making and control problems in recent years. For conventional RL formulations, Markov Decision Process (MDP) and state-action-value…

机器学习 · 计算机科学 2020-06-09 Ziyao Zhang , Liang Ma , Kin K. Leung , Konstantinos Poularakis , Mudhakar Srivatsa

One of the central challenges faced by a reinforcement learning (RL) agent is to effectively learn a (near-)optimal policy in environments with large state spaces having sparse and noisy feedback signals. In real-world applications, an…

机器学习 · 计算机科学 2020-06-24 Parameswaran Kamalaruban , Rati Devidze , Volkan Cevher , Adish Singla