中文
相关论文

相关论文: On Representation Complexity of Model-based and Mo…

200 篇论文

Reinforcement learning often needs to deal with the exponential growth of states and actions when exploring optimal control in high-dimensional spaces (often known as the curse of dimensionality). In this work, we address this issue by…

机器学习 · 计算机科学 2023-06-23 Yining Li , Peizhong Ju , Ness Shroff

Existing methods for optimal control struggle to deal with the complexity commonly encountered in real-world systems, including dimensionality, process error, model bias and data heterogeneity. Instead of tackling these system complexities…

Model-free reinforcement learning (RL) methods are succeeding in a growing number of tasks, aided by recent advances in deep learning. However, they tend to suffer from high sample complexity, which hinders their use in real-world domains.…

机器学习 · 计算机科学 2018-10-08 Thanard Kurutach , Ignasi Clavera , Yan Duan , Aviv Tamar , Pieter Abbeel

Many problems in RL, such as meta-RL, robust RL, generalization in RL, and temporal credit assignment, can be cast as POMDPs. In theory, simply augmenting model-free RL with memory-based architectures, such as recurrent neural networks,…

机器学习 · 计算机科学 2022-06-07 Tianwei Ni , Benjamin Eysenbach , Ruslan Salakhutdinov

With the fast improvement of machine learning, reinforcement learning (RL) has been used to automate human tasks in different areas. However, training such agents is difficult and restricted to expert users. Moreover, it is mostly limited…

机器学习 · 计算机科学 2023-03-21 André Correia , Luís A. Alexandre

In this paper, a review of model-free reinforcement learning for learning of dynamical systems in uncertain environments has discussed. For this purpose, the Markov Decision Process (MDP) will be reviewed. Furthermore, some learning…

机器学习 · 计算机科学 2019-05-21 Mehran Attar , Mohammadreza Dabirian

We study the problem of cross-embodiment inverse reinforcement learning, where we wish to learn a reward function from video demonstrations in one or more embodiments and then transfer the learned reward to a different embodiment (e.g.,…

机器人学 · 计算机科学 2024-08-13 Connor Mattson , Anurag Aribandi , Daniel S. Brown

We provide new perspectives and inference algorithms for Maximum Entropy (MaxEnt) Inverse Reinforcement Learning (IRL), which provides a principled method to find a most non-committal reward function consistent with given expert…

机器学习 · 计算机科学 2021-06-08 Aaron J. Snoswell , Surya P. N. Singh , Nan Ye

In reinforcement learning (RL), agents continually interact with the environment and use the feedback to refine their behavior. To guide policy optimization, reward models are introduced as proxies of the desired objectives, such that when…

机器学习 · 计算机科学 2025-06-19 Rui Yu , Shenghua Wan , Yucen Wang , Chen-Xiao Gao , Le Gan , Zongzhang Zhang , De-Chuan Zhan

With the increasing need for handling large state and action spaces, general function approximation has become a key technique in reinforcement learning (RL). In this paper, we propose a general framework that unifies model-based and…

机器学习 · 计算机科学 2022-10-03 Zixiang Chen , Chris Junchi Li , Angela Yuan , Quanquan Gu , Michael I. Jordan

Continuous state spaces and stochastic, switching dynamics characterize a number of rich, realworld domains, such as robot navigation across varying terrain. We describe a reinforcementlearning algorithm for learning in these domains and…

机器学习 · 计算机科学 2012-06-18 Emma Brunskill , Bethany Leffler , Lihong Li , Michael L. Littman , Nicholas Roy

Reinforcement learning holds tremendous promise in accelerator controls. The primary goal of this paper is to show how this approach can be utilised on an operational level on accelerator physics problems. Despite the success of model-free…

机器学习 · 计算机科学 2022-01-27 Simon Hirlaender , Niky Bruchon

Efficiently tackling multiple tasks within complex environment, such as those found in robot manipulation, remains an ongoing challenge in robotics and an opportunity for data-driven solutions, such as reinforcement learning (RL).…

机器人学 · 计算机科学 2024-04-03 Carlos Plou , Ana C. Murillo , Ruben Martinez-Cantin

Quantum Machine Learning (QML) is considered to be one of the most promising applications of near term quantum devices. However, the optimization of quantum machine learning models presents numerous challenges arising from the imperfections…

机器学习 · 计算机科学 2022-05-17 Owen Lockwood

We study learning optimal policies from a logged dataset, i.e., offline RL, with function approximation. Despite the efforts devoted, existing algorithms with theoretic finite-sample guarantees typically assume exploratory data coverage or…

机器学习 · 计算机科学 2023-05-25 Chenjie Mao

Q-learning is a popular Reinforcement Learning (RL) algorithm which is widely used in practice with function approximation (Mnih et al., 2015). In contrast, existing theoretical results are pessimistic about Q-learning. For example, (Baird,…

机器学习 · 计算机科学 2021-10-20 Naman Agarwal , Syomantak Chaudhuri , Prateek Jain , Dheeraj Nagaraj , Praneeth Netrapalli

Model-free reinforcement learning (RL) is a powerful approach for learning control policies directly from high-dimensional state and observation. However, it tends to be data-inefficient, which is especially costly in robotic learning…

机器人学 · 计算机科学 2020-10-14 Xubo Lyu , Mo Chen

Experimental evidence indicates that simple models outperform complex deep networks on many unsupervised similarity tasks. We provide a simple yet rigorous explanation for this behaviour by introducing the concept of an optimal…

人工智能 · 计算机科学 2018-05-10 Vitalii Zhelezniak , Dan Busbridge , April Shen , Samuel L. Smith , Nils Y. Hammerla

Efficient exploration is one of the key challenges for reinforcement learning (RL) algorithms. Most traditional sample efficiency bounds require strategic exploration. Recently many deep RL algorithms with simple heuristic exploration…

机器学习 · 计算机科学 2019-04-19 Yao Liu , Emma Brunskill

Reinforcement Learning (RL) has demonstrated tremendous empirical success across numerous challenging domains. However, we lack a strong theoretical understanding of the statistical complexity of RL in environments with large state spaces,…

机器学习 · 计算机科学 2025-06-03 Gene Li