English
Related papers

Related papers: Dyna-H: a heuristic planning reinforcement learnin…

200 papers

Path-planning algorithms are an important part of a wide variety of robotic applications, such as mobile robot navigation and robot arm manipulation. However, in large search spaces in which local traps may exist, it remains challenging to…

Machine Learning · Computer Science 2019-08-12 Yuka Ariki , Takuya Narihira

We investigate planning in time-critical domains represented as Markov Decision Processes, showing that search based techniques can be a very powerful method for finding close to optimal plans. To reduce the computational cost of planning…

Artificial Intelligence · Computer Science 2013-02-28 Richard Dearden , Craig Boutilier

We consider the problem of planning a collision-free path for a high-dimensional robot. Specifically, we suggest a planning framework where a motion-planning algorithm can obtain guidance from a user. In contrast to existing approaches that…

Robotics · Computer Science 2018-07-24 Fahad Islam , Oren Salzman , Maxim Likhachev

The actions of an autonomous vehicle on the road affect and are affected by those of other drivers, whether overtaking, negotiating a merge, or avoiding an accident. This mutual dependence, best captured by dynamic game theory, creates a…

Robotics · Computer Science 2018-10-16 Jaime F. Fisac , Eli Bronstein , Elis Stefansson , Dorsa Sadigh , S. Shankar Sastry , Anca D. Dragan

Hierarchical Reinforcement Learning (HRL) agents often struggle with long-horizon visual planning due to their reliance on error-prone distance metrics. We propose Discrete Hierarchical Planning (DHP), a method that replaces continuous…

Robotics · Computer Science 2025-12-22 Shashank Sharma , Janina Hoffmann , Vinay Namboodiri

In imitation learning for planning, parameters of heuristic functions are optimized against a set of solved problem instances. This work revisits the necessary and sufficient conditions of strictly optimally efficient heuristics for forward…

Artificial Intelligence · Computer Science 2023-10-31 Leah Chrestien , Tomás Pevný , Stefan Edelkamp , Antonín Komenda

Recent progress in reasoning with large language models (LLMs), such as DeepSeek-R1, demonstrates impressive capabilities in domains like mathematics and coding, by exhibiting complex cognitive behaviors such as verification, goal…

Artificial Intelligence · Computer Science 2025-10-14 Xiao Yu , Baolin Peng , Ruize Xu , Michel Galley , Hao Cheng , Suman Nath , Jianfeng Gao , Zhou Yu

Unmanned Aerial Vehicles need an online path planning capability to move in high-risk missions in unknown and complex environments to complete them safely. However, many algorithms reported in the literature may not return reliable…

We describe how to convert the heuristic search algorithm A* into an anytime algorithm that finds a sequence of improved solutions and eventually converges to an optimal solution. The approach we adopt uses weighted heuristic search to find…

Artificial Intelligence · Computer Science 2011-10-13 E. A. Hansen , R. Zhou

Deep reinforcement learning can match or exceed human performance in stable contexts, but with minor changes to the environment artificial networks, unlike humans, often cannot adapt. Humans rely on a combination of heuristics to simplify…

Artificial Intelligence · Computer Science 2020-06-15 Erik J Peterson , Necati Alp Müyesser , Timothy Verstynen , Kyle Dunovan

Actor-Critic models are a class of model-free deep reinforcement learning (RL) algorithms that have demonstrated effectiveness across various robot learning tasks. While considerable research has focused on improving training stability and…

Robotics · Computer Science 2025-10-01 Hanlan Yang , Itamar Mishani , Luca Pivetti , Zachary Kingston , Maxim Likhachev

With the advent of machine learning, there have been several recent attempts to learn effective and generalizable heuristics. Local Heuristic A* (LoHA*) is one recent method that instead of learning the entire heuristic estimate, learns a…

Robotics · Computer Science 2024-05-07 Rishi Veerapaneni , Jonathan Park , Muhammad Suhail Saleem , Maxim Likhachev

Edge computing hosts applications close to the end users and enables low-latency real-time applications. Modern applications inturn have adopted the microservices architecture which composes applications as loosely coupled smaller…

Networking and Internet Architecture · Computer Science 2021-11-02 Dhruv Garg , Nanjangud C. Narendra , Selome Tesfatsion

Designing good heuristic functions for graph search requires adequate domain knowledge. It is often easy to design heuristics that perform well and correlate with the underlying true cost-to-go values in certain parts of the search space…

Artificial Intelligence · Computer Science 2025-09-01 Ramkumar Natarajan , Muhammad Suhail Saleem , William Xiao , Sandip Aine , Howie Choset , Maxim Likhachev

Optimal path planning requires finding a series of feasible states from the starting point to the goal to optimize objectives. Popular path planning algorithms, such as Effort Informed Trees (EIT*), employ effort heuristics to guide the…

This paper presents a non-manual design engineering method based on heuristic search algorithm to search for candidate agents in the solution space which formed by artificial intelligence agents modeled on the base of bionics.Compared with…

Artificial Intelligence · Computer Science 2018-07-30 Zengkun Li

In both industrial and service domains, a central benefit of the use of robots is their ability to quickly and reliably execute repetitive tasks. However, even relatively simple peg-in-hole tasks are typically subject to stochastic…

Robotics · Computer Science 2023-07-28 Benjamin Alt , Darko Katic , Rainer Jäkel , Michael Beetz

Learning a well-informed heuristic function for hard task planning domains is an elusive problem. Although there are known neural network architectures to represent such heuristic knowledge, it is not obvious what concrete information is…

Artificial Intelligence · Computer Science 2021-12-06 Leah Chrestien , Tomas Pevny , Antonin Komenda , Stefan Edelkamp

Real-time heuristic search algorithms satisfy a constant bound on the amount of planning per action, independent of problem size. As a result, they scale up well as problems become larger. This property would make them well suited for video…

Artificial Intelligence · Computer Science 2014-01-17 Vadim Bulitko , Yngvi Björnsson , Ramon Lawrence

Robot path planning is difficult to solve due to the contradiction between optimality of results and complexity of algorithms, even in 2D environments. To find an optimal path, the algorithm needs to search all the state space, which costs…

Robotics · Computer Science 2020-12-08 Zhaoting Li , Jiankun Wang , Max Q. -H. Meng