English
Related papers

Related papers: Learning Macro-actions for State-Space Planning

200 papers

Standard model-free reinforcement learning algorithms optimize a policy that generates the action to be taken in the current time step in order to maximize expected future return. While flexible, it faces difficulties arising from the…

Machine Learning · Computer Science 2022-02-07 Haichao Zhang , Wei Xu , Haonan Yu

In this paper, we provide a novel algorithm for solving planning and learning problems of Markov decision processes. The proposed algorithm follows a policy iteration-type update by using a rank-one approximation of the transition…

Optimization and Control · Mathematics 2025-10-23 Arman Sharifi Kolarijani , Tolga Ok , Peyman Mohajerin Esfahani , Mohamad Amin Sharif Kolarijani

The challenge of spatial resource allocation is pervasive across various domains such as transportation, industry, and daily life. As the scale of real-world issues continues to expand and demands for real-time solutions increase,…

Machine Learning · Computer Science 2024-03-08 Di Zhang , Moyang Wang , Joseph Mango , Xiang Li , Xianrui Xu

The challenge of mapping indoor environments is addressed. Typical heuristic algorithms for solving the motion planning problem are frontier-based methods, that are especially effective when the environment is completely unknown. However,…

Machine Learning · Computer Science 2022-03-01 Elchanan Zwecher , Eran Iceland , Sean R. Levy , Shmuel Y. Hayoun , Oren Gal , Ariel Barel

Sampling-based motion planning techniques have emerged as an efficient algorithmic paradigm for solving complex motion planning problems. These approaches use a set of probing samples to construct an implicit graph representation of the…

Robotics · Computer Science 2019-10-10 Brian Ichter , Edward Schmerling , Tsang-Wei Edward Lee , Aleksandra Faust

The rise of Large Language Models (LLMs) has driven progress in reasoning tasks -- from program synthesis to scientific hypothesis generation -- yet their ability to handle ranked preferences and structured algorithms in combinatorial…

Artificial Intelligence · Computer Science 2025-12-09 Hadi Hosseini , Samarth Khanna , Ronak Singh

We propose an approach to learning agents for active robotic mapping, where the goal is to map the environment as quickly as possible. The agent learns to map efficiently in simulated environments by receiving rewards corresponding to how…

Robotics · Computer Science 2018-01-01 Shane Barratt

Process mining, as a high-level field in data mining, plays a crucial role in enhancing operational efficiency and decision-making across organizations. In this survey paper, we delve into the growing significance and ongoing trends in the…

Artificial Intelligence · Computer Science 2024-07-17 Yiyuan Yang , Zheshun Wu , Yong Chu , Zhenghua Chen , Zenglin Xu , Qingsong Wen

Identifying the specific actions that achieve goals when solving a planning task might be beneficial for various planning applications. Traditionally, this identification occurs post-search, as some actions may temporarily achieve goals…

Artificial Intelligence · Computer Science 2025-08-12 Alberto Pozanco , Marianela Morales , Daniel Borrajo , Manuela Veloso

Machine learning has been successful in building control policies to drive a complex system to desired states in various applications (e.g. games, robotics, etc.). To be specific, a number of parameters of policy can be automatically…

Artificial Intelligence · Computer Science 2025-03-28 Yongshuai Liu , Taeyeong Choi , Xin Liu

For over three decades, the planning community has explored countless methods for data-driven model acquisition. These range in sophistication (e.g., simple set operations to full-blown reformulations), methodology (e.g., logic-based vs.…

Artificial Intelligence · Computer Science 2022-06-15 Ethan Callanan , Rebecca De Venezia , Victoria Armstrong , Alison Paredes , Tathagata Chakraborti , Christian Muise

We propose a general-purpose approach to discovering active learning (AL) strategies from data. These strategies are transferable from one domain to another and can be used in conjunction with many machine learning models. To this end, we…

Machine Learning · Computer Science 2019-04-03 Ksenia Konyushkova , Raphael Sznitman , Pascal Fua

Ordering the selection of training data using active learning can lead to improvements in learning efficiently from smaller corpora. We present an exploration of active learning approaches applied to three grounded language problems of…

Robotics · Computer Science 2020-11-17 Nisha Pillai , Edward Raff , Francis Ferraro , Cynthia Matuszek

Data augmentation is an effective technique for improving the accuracy of modern image classifiers. However, current data augmentation implementations are manually designed. In this paper, we describe a simple procedure called AutoAugment…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Ekin D. Cubuk , Barret Zoph , Dandelion Mane , Vijay Vasudevan , Quoc V. Le

Planning problems where effects of actions are non-deterministic can be modeled as Markov decision processes. Planning problems are usually goal-directed. This paper proposes several techniques for exploiting the goal-directedness to…

Artificial Intelligence · Computer Science 2013-02-08 Nevin Lianwen Zhang , Weihong Zhang

Recent developments in engineering techniques for spatial data collection such as geographic information systems have resulted in an increasing need for methods to analyze large spatial data sets. These sorts of data sets can be found in…

Methodology · Statistics 2020-08-14 Toshihiro Hirano

Planning in stochastic and partially observable environments is a central issue in artificial intelligence. One commonly used technique for solving such a problem is by constructing an accurate model firstly. Although some recent approaches…

Artificial Intelligence · Computer Science 2019-04-08 Yunlong Liu , Jianyang Zheng

Creating a domain model, even for classical, domain-independent planning, is a notoriously hard knowledge-engineering task. A natural approach to solve this problem is to learn a domain model from observations. However, model learning…

Artificial Intelligence · Computer Science 2021-07-12 Brendan Juba , Hai S. Le , Roni Stern

Searching the space of policies directly for the optimal policy has been one popular method for solving partially observable reinforcement learning problems. Typically, with each change of the target policy, its value is estimated from the…

Artificial Intelligence · Computer Science 2007-05-23 Leonid Peshkin , Christian R. Shelton

Motion planning algorithms often leverage topological information about the environment to improve planner performance. However, these methods often focus only on the environment's connectivity while ignoring other properties such as…

Robotics · Computer Science 2020-03-05 Diane Uwacu , Regina Rex , Bonnie Wang , Shawna Thomas , Nancy M. Amato