中文
相关论文

相关论文: Improving planning and MBRL with temporally-extend…

200 篇论文

This paper studies the control synthesis of motion planning subject to uncertainties. The uncertainties are considered in robot motions and environment properties, giving rise to the probabilistic labeled Markov decision process (PL-MDP). A…

机器人学 · 计算机科学 2023-01-31 Mingyu Cai , Shaoping Xiao , Zhijun Li , Zhen Kan

Effective planning in model-based reinforcement learning (MBRL) and model-predictive control (MPC) relies on the accuracy of the learned dynamics model. In many instances of MBRL and MPC, this model is assumed to be stationary and is…

机器学习 · 计算机科学 2026-05-27 Yizhou Huang , Kevin Xie , Homanga Bharadhwaj , Florian Shkurti

Solving long-horizon, temporally-extended tasks using Reinforcement Learning (RL) is challenging, compounded by the common practice of learning without prior knowledge (or tabula rasa learning). Humans can generate and execute plans with…

机器学习 · 计算机科学 2023-11-10 Bharat Prakash , Tim Oates , Tinoosh Mohsenin

This paper investigates the motion planning of autonomous dynamical systems modeled by Markov decision processes (MDP) with unknown transition probabilities over continuous state and action spaces. Linear temporal logic (LTL) is used to…

机器学习 · 计算机科学 2022-01-25 Mingyu Cai , Mohammadhosein Hasanbeig , Shaoping Xiao , Alessandro Abate , Zhen Kan

Deep Reinforcement Learning (DRL) has achieved remarkable success in complex sequential decision-making tasks, such as playing Atari 2600 games and mastering board games. A critical yet underexplored aspect of DRL is the temporal scale of…

机器学习 · 计算机科学 2025-07-02 Abhishek Verma , Nallarasan V , Balaraman Ravindran

Reinforcement Learning (RL) is a method for learning decision-making tasks that could enable robots to learn and adapt to their situation on-line. For an RL algorithm to be practical for robotic control tasks, it must learn in very few…

人工智能 · 计算机科学 2015-03-19 Todd Hester , Michael Quinlan , Peter Stone

Deep reinforcement learning (DRL) has had success across various domains, but applying it to environments with constraints remains challenging due to poor sample efficiency and slow convergence. Recent literature explored incorporating…

Restless multi-armed bandits (RMAB) have been widely used to model sequential decision making problems with constraints. The decision maker (DM) aims to maximize the expected total reward over an infinite horizon under an "instantaneous…

机器学习 · 计算机科学 2023-12-25 Shufan Wang , Guojun Xiong , Jian Li

Reinforcement learning (RL) has increasingly been applied to solve real-world planning problems, with progress in handling large state spaces and time horizons. However, a key bottleneck in many domains is that RL methods cannot accommodate…

机器学习 · 计算机科学 2025-03-19 Lily Xu , Bryan Wilder , Elias B. Khalil , Milind Tambe

Model-based reinforcement learning (MBRL) methods have shown strong sample efficiency and performance across a variety of tasks, including when faced with high-dimensional visual observations. These methods learn to predict the environment…

Model-Based Reinforcement Learning (MBRL) offers a promising direction for sample efficient learning, often achieving state of the art results for continuous control tasks. However, many existing MBRL methods rely on combining greedy…

机器学习 · 计算机科学 2020-02-10 Philip Ball , Jack Parker-Holder , Aldo Pacchiano , Krzysztof Choromanski , Stephen Roberts

Tree-form sequential decision making (TFSDM) extends classical one-shot decision making by modeling tree-form interactions between an agent and a potentially adversarial environment. It captures the online decision-making problems that each…

计算机科学与博弈论 · 计算机科学 2021-03-09 Gabriele Farina , Robin Schmucker , Tuomas Sandholm

Reinforcement learning is a powerful approach to learn behaviour through interactions with an environment. However, behaviours are usually learned in a purely reactive fashion, where an appropriate action is selected based on an…

机器学习 · 计算机科学 2021-06-10 André Biedenkapp , Raghu Rajan , Frank Hutter , Marius Lindauer

Model-free reinforcement learning (RL) is a powerful, general tool for learning complex behaviors. However, its sample efficiency is often impractically large for solving challenging real-world problems, even with off-policy algorithms such…

机器学习 · 计算机科学 2020-02-25 Vitchyr Pong , Shixiang Gu , Murtaza Dalal , Sergey Levine

Motion planning classically concerns the problem of accomplishing a goal configuration while avoiding obstacles. However, the need for more sophisticated motion planning methodologies, taking temporal aspects into account, has emerged. To…

系统与控制 · 计算机科学 2017-03-08 Lars Lindemann , Dimos V. Dimarogonas

In model-based reinforcement learning (MBRL), most algorithms rely on simulating trajectories from one-step dynamics models learned on data. A critical challenge of this approach is the compounding of one-step prediction errors as length of…

机器学习 · 计算机科学 2023-10-12 Abdelhakim Benechehab , Giuseppe Paolo , Albert Thomas , Maurizio Filippone , Balázs Kégl

Reinforcement Learning (RL) has shown remarkable progress in simulation environments, yet its application to real-world robotic tasks remains limited due to challenges in exploration and generalization. To address these issues, we introduce…

人工智能 · 计算机科学 2024-10-18 Amisha Bhaskar , Zahiruddin Mahammad , Sachin R Jadhav , Pratap Tokekar

In offline model-based reinforcement learning (offline MBRL), we learn a dynamic model from historically collected data, and subsequently utilize the learned model and fixed datasets for policy learning, without further interacting with the…

机器学习 · 计算机科学 2022-10-13 Shentao Yang , Shujian Zhang , Yihao Feng , Mingyuan Zhou

Many potential applications of reinforcement learning (RL) are stymied by the large numbers of samples required to learn an effective policy. This is especially true when applying RL to real-world control tasks, e.g. in the sciences or…

In this work we describe a novel deep reinforcement learning architecture that allows multiple actions to be selected at every time-step in an efficient manner. Multi-action policies allow complex behaviours to be learnt that would…