English
Related papers

Related papers: Kinodynamic Task and Motion Planning using VLM-gui…

200 papers

To achieve optimal robot behavior in dynamic scenarios we need to consider complex dynamics in a predictive manner. In the vehicle dynamics community, it is well know that to achieve time-optimal driving on low surface, the vehicle should…

Robotics · Computer Science 2023-03-28 Zlatan Ajanović , Enrico Regolin , Barys Shyrokau , Hana Ćatić , Martin Horn , Antonella Ferrara

We introduce a new method that extracts knowledge from a large language model (LLM) to produce object-level plans, which describe high-level changes to object state, and uses them to bootstrap task and motion planning (TAMP). Existing work…

Robotics · Computer Science 2025-03-24 David Paulius , Alejandro Agostini , Benedict Quartey , George Konidaris

We present new models of optimization-based task and motion planning (TAMP) for robotic pick-and-place (P&P), which plan action sequences and motion trajectory with low computational costs. We improved an existing state-of-the-art TAMP…

Robotics · Computer Science 2022-01-24 Takuma Kogo , Kei Takaya , Hiroyuki Oyama

Physics-based motion planning is a challenging task, since it requires the computation of the robot motions while allowing possible interactions with (some of) the obstacles in the environment. Kinodynamic motion planners equipped with a…

Robotics · Computer Science 2017-10-03 Muhayyuddin , Aliakbar Akbari , Jan Rosell

We consider manipulation problems in constrained and cluttered settings, which require several regrasps at unknown locations. We propose to inform an optimization-based task and motion planning (TAMP) solver with possible regrasp areas and…

Robotics · Computer Science 2025-07-17 Svetlana Levit , Marc Toussaint

This study examines the problem of hopping robot navigation planning to achieve simultaneous goal-directed and environment exploration tasks. We consider a scenario in which the robot has mandatory goal-directed tasks defined using Linear…

Robotics · Computer Science 2024-07-10 Jesse Jiang , Samuel Coogan , Ye Zhao

Task and Motion Planning combines high-level task sequencing (what to do) with low-level motion planning (how to do it) to generate feasible, collision-free execution plans. However, in many real-world domains, such as automated warehouses,…

Robotics · Computer Science 2026-03-20 Elisa Tosello , Arthur Bit-Monnot , Davide Lusuardi , Alessandro Valentini , Andrea Micheli

Solving multi-robot motion planning (MRMP) requires generating collision-free kinodynamically feasible trajectories for multiple interacting robots. We introduce Kinodynamic Translation-Invariant Edge Bundles or KiTE-Extend, a…

Robotic manipulation relies on analytical or learned models to simulate the system dynamics. These models are often inaccurate and based on offline information, so that the robot planner is unable to cope with mismatches between the…

Robotics · Computer Science 2024-03-13 Marco Faroni , Dmitry Berenson

We present a framework for learning to guide geometric task and motion planning (GTAMP). GTAMP is a subclass of task and motion planning in which the goal is to move multiple objects to target regions among movable obstacles. A standard…

Robotics · Computer Science 2022-03-10 Beomjoon Kim , Luke Shimanuki , Leslie Pack Kaelbling , Tomás Lozano-Pérez

Trajectory optimization is a widely used technique in robot motion planning for letting the dynamics and constraints on the system shape and synthesize complex behaviors. Several previous works have shown its benefits in high-dimensional…

Robotics · Computer Science 2024-03-19 Ramkumar Natarajan , Shohin Mukherjee , Howie Choset , Maxim Likhachev

Vision-Language Models (VLMs) exhibit remarkable common-sense and semantic reasoning capabilities. However, they lack a grounded understanding of physical dynamics. This limitation arises from training VLMs on static internet-scale…

Robotics · Computer Science 2026-04-01 Haowen Liu , Shaoxiong Yao , Haonan Chen , Jiawei Gao , Jiayuan Mao , Jia-Bin Huang , Yilun Du

Despite recent progress improving the efficiency and quality of motion planning, planning collision-free and dynamically-feasible trajectories in partially-mapped environments remains challenging, since constantly replanning as unseen…

Robotics · Computer Science 2023-06-16 Abhish Khanal , Hoang-Dung Bui , Gregory J. Stein , Erion Plaku

While Large Language Models (LLMs) can solve many NLP tasks in zero-shot settings, applications involving embodied agents remain problematic. In particular, complex plans that require multi-step reasoning become difficult and too costly as…

Computation and Language · Computer Science 2023-08-15 Gautier Dagan , Frank Keller , Alex Lascarides

In this paper, we tackle the problem of human-robot coordination in sequences of manipulation tasks. Our approach integrates hierarchical human motion prediction with Task and Motion Planning (TAMP). We first devise a hierarchical motion…

Robotics · Computer Science 2021-07-06 An T. Le , Philipp Kratzer , Simon Hagenmayer , Marc Toussaint , Jim Mainprice

This paper aims to improve the path quality and computational efficiency of kinodynamic planners used for vehicular systems. It proposes a learning framework for identifying promising controls during the expansion process of sampling-based…

Robotics · Computer Science 2022-01-10 Seth Karten , Aravind Sivaramakrishnan , Edgar Granados , Troy McMahon , Kostas E. Bekris

Visual robot navigation within large-scale, semi-structured environments deals with various challenges such as computation intensive path planning algorithms or insufficient knowledge about traversable spaces. Moreover, many…

Robotics · Computer Science 2018-03-12 Fabian Blöchliger , Marius Fehr , Marcin Dymczyk , Thomas Schneider , Roland Siegwart

Sampling-based kinodynamic planners, such as Rapidly-exploring Random Trees (RRTs), pose two fundamental challenges: computing a reliable (pseudo-)metric for the distance between two randomly sampled nodes, and computing a steering input to…

Robotics · Computer Science 2017-10-30 Wouter Wolfslag , Mukunda Bharatheesha , Thomas Moerland , Martijn Wisse

In this work we consider the multi-agent motion planning (MAMP) problem with the constraint that agents arrive at their respective goals at the same time. For the special case where all agents are initially at rest we propose a two-step…

Optimization and Control · Mathematics 2026-05-05 Anja Hellander , Daniel Axehill

With the rapid advancement of artificial intelligence, there is an increasing demand for intelligent robots capable of assisting humans in daily tasks and performing complex operations. Such robots not only require task planning…

Robotics · Computer Science 2025-05-01 Huihui Guo , Huilong Pi , Yunchuan Qin , Zhuo Tang , Kenli Li