English
Related papers

Related papers: Learning Macro-actions for State-Space Planning

200 papers

Formulating expert policies as macro actions promises to alleviate the long-horizon issue via structured exploration and efficient credit assignment. However, traditional option-based multi-policy transfer methods suffer from inefficient…

Systems and Control · Electrical Eng. & Systems 2023-07-26 Zheng Zhang , Qingrui Zhang , Bo Zhu , Xiaohan Wang , Tianjiang Hu

Robots deployed in many real-world settings need to be able to acquire new skills and solve new tasks over time. Prior works on planning with skills often make assumptions on the structure of skills and tasks, such as subgoal skills, shared…

Robotics · Computer Science 2022-04-15 Jacky Liang , Mohit Sharma , Alex LaGrassa , Shivam Vats , Saumya Saxena , Oliver Kroemer

Despite the advances in probabilistic model checking, the scalability of the verification methods remains limited. In particular, the state space often becomes extremely large when instantiating parameterized Markov decision processes…

An increasingly important building block of large scale machine learning systems is based on returning slates; an ordered lists of items given a query. Applications of this technology include: search, information retrieval and recommender…

Machine Learning · Computer Science 2024-01-01 Otmane Sakhi , David Rohde , Nicolas Chopin

Data Mining is the process of extracting useful patterns from the huge amount of database and many data mining techniques are used for mining these patterns. Recently, one of the remarkable facts in higher educational institute is the rapid…

Artificial Intelligence · Computer Science 2014-05-16 Priyanka Saini

The map-matching is an essential preprocessing step for most of the trajectory-based applications. Although it has been an active topic for more than two decades and, driven by the emerging applications, is still under development. There is…

Databases · Computer Science 2019-10-30 Pingfu Chao , Yehong Xu , Wen Hua , Xiaofang Zhou

Most reinforcement learning algorithms are based on a key assumption that Markov decision processes (MDPs) are stationary. However, non-stationary MDPs with dynamic action space are omnipresent in real-world scenarios. Yet problems of…

Machine Learning · Computer Science 2023-04-04 Jiaqi Ye , Xiaodong Li , Pangjing Wu , Feng Wang

Reinforcement learning has received high research interest for developing planning approaches in automated driving. Most prior works consider the end-to-end planning task that yields direct control commands and rarely deploy their algorithm…

Robotics · Computer Science 2023-07-31 Marvin Klimke , Benjamin Völz , Michael Buchholz

Reinforcement learning (RL) involves sequential decision making in uncertain environments. The aim of the decision-making agent is to maximize the benefit of acting in its environment over an extended period of time. Finding an optimal…

Artificial Intelligence · Computer Science 2007-05-23 Istvan Szita , Balint Takacs , Andras Lorincz

Robot motion planning involves computing a sequence of valid robot configurations that take the robot from its initial state to a goal state. Solving a motion planning problem optimally using analytical methods is proven to be PSPACE-Hard.…

Robotics · Computer Science 2021-07-26 Naman Shah , Abhyudaya Srinet , Siddharth Srivastava

We propose a novel planning technique for satisfying tasks specified in temporal logic in partially revealed environments. We define high-level actions derived from the environment and the given task itself, and estimate how each action…

AI Planning, Machine Learning and Process Mining have so far developed into separate research fields. At the same time, many interesting concepts and insights have been gained at the intersection of these areas in recent years. For example,…

Artificial Intelligence · Computer Science 2022-08-19 Peter Fettke , Alexander Rombach

Recent advancements in robotics have transformed industries such as manufacturing, logistics, surgery, and planetary exploration. A key challenge is developing efficient motion planning algorithms that allow robots to navigate complex…

Robotics · Computer Science 2025-08-27 Liding Zhang , Kuanqi Cai , Zewei Sun , Zhenshan Bing , Chaoqun Wang , Luis Figueredo , Sami Haddadin , Alois Knoll

Large language models (LLMs) hold promise for generating plans for complex tasks, but their effectiveness is limited by sequential execution, lack of control flow models, and difficulties in skill retrieval. Addressing these issues is…

Computation and Language · Computer Science 2024-10-18 Andrei Cosmin Redis , Mohammadreza Fani Sani , Bahram Zarrin , Andrea Burattin

Classical and natural language planning tasks remain a difficult domain for modern large language models (LLMs). In this work, we lay the foundations for improving planning capabilities of LLMs. First, we construct a comprehensive benchmark…

Computation and Language · Computer Science 2024-11-05 Bernd Bohnet , Azade Nova , Aaron T Parisi , Kevin Swersky , Katayoon Goshvadi , Hanjun Dai , Dale Schuurmans , Noah Fiedel , Hanie Sedghi

Recent advances in planning have explored using learning methods to help planning. However, little attention has been given to adapting search algorithms to work better with learning systems. In this paper, we introduce partial-space…

Artificial Intelligence · Computer Science 2025-04-30 Ryan Xiao Wang , Felipe Trevizan

Many important real-world problems have action spaces that are high-dimensional, continuous or both, making full enumeration of all possible actions infeasible. Instead, only small subsets of actions can be sampled for the purpose of policy…

In this paper, we propose a learning algorithm that speeds up the search in task and motion planning problems. Our algorithm proposes solutions to three different challenges that arise in learning to improve planning efficiency: what to…

Robotics · Computer Science 2018-07-27 Beomjoon Kim , Zi Wang , Leslie Pack Kaelbling , Tomas Lozano-Perez

An optimization of caching strategies is proposed as a formal approach allowing us a more efficient use of two-level computer memory. This approach is based on a set of mathematical models and a set of theorems, permitting analytical…

Optimization and Control · Mathematics 2007-05-23 V. O. Groppen

Data augmentation methods are indispensable heuristics to boost the performance of deep neural networks, especially in image recognition tasks. Recently, several studies have shown that augmentation strategies found by search algorithms…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Ryuichiro Hataya , Jan Zdenek , Kazuki Yoshizoe , Hideki Nakayama