English
Related papers

Related papers: Differentiable Spatial Planning using Transformers

200 papers

Motion planning is integral to robotics applications such as autonomous driving, surgical robots, and industrial manipulators. Existing planning methods lack scalability to higher-dimensional spaces, while recent learning based planners…

Robotics · Computer Science 2023-09-28 Jacob J Johnson , Ahmed H Qureshi , Michael Yip

In this work, a set of motion primitives is defined for use in an energy-aware motion planning problem. The motion primitives are defined as sequences of control inputs to a simplified four-DOF dynamics model and are used to replace the…

Robotics · Computer Science 2023-11-21 Seung-Keol Ryu , Michael Moncton , Han-Lim Choi , Eric Frew

Evolutionary algorithms are wildly used in unmanned aerial vehicle path planning for their flexibility and effectiveness. Nevertheless, they are so sensitive to the change of environment that can't adapt to all scenarios. Due to this…

Neural and Evolutionary Computing · Computer Science 2022-04-08 Jiabin Lou , Rong Ding , Wenjun Wu

Predicting pedestrian motion trajectories is crucial for path planning and motion control of autonomous vehicles. Accurately forecasting crowd trajectories is challenging due to the uncertain nature of human motions in different…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Yu Liu , Yuexin Zhang , Kunming Li , Yongliang Qiao , Stewart Worrall , You-Fu Li , He Kong

Vision Transformers (ViTs) have demonstrated exceptional performance in various vision tasks. However, they tend to underperform on smaller datasets due to their inherent lack of inductive biases. Current approaches address this limitation…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Alan Luo , Kaiwen Yuan

Industrial robots are widely used in various manufacturing environments due to their efficiency in doing repetitive tasks such as assembly or welding. A common problem for these applications is to reach a destination without colliding with…

Robotics · Computer Science 2023-01-18 Teham Bhuiyan , Linh Kästner , Yifan Hu , Benno Kutschank , Jens Lambrecht

The ability to adapt to changes in environmental contingencies is an important challenge in reinforcement learning. Indeed, transferring previously acquired knowledge to environments with unseen structural properties can greatly enhance the…

Machine Learning · Computer Science 2021-10-28 Ayman Boustati , Hana Chockler , Daniel C. McNamee

In this work, we study the problem of how to leverage instructional videos to facilitate the understanding of human decision-making processes, focusing on training a model with the ability to plan a goal-directed procedure from real-world…

Robotics · Computer Science 2022-03-11 Jiankai Sun , De-An Huang , Bo Lu , Yun-Hui Liu , Bolei Zhou , Animesh Garg

Multi-Agent Path Finding (MAPF) poses a significant and challenging problem critical for applications in robotics and logistics, particularly due to its combinatorial complexity and the partial observability inherent in realistic…

Multiagent Systems · Computer Science 2025-09-29 Merve Atasever , Matthew Hong , Mihir Nitin Kulkarni , Qingpei Li , Jyotirmoy V. Deshmukh

Path planning in dynamic environments is a fundamental challenge in intelligent transportation and robotics, where obstacles and conditions change over time, introducing uncertainty and requiring continuous adaptation. While existing…

Robotics · Computer Science 2025-11-20 Jonas De Maeyer , Hossein Yarahmadi , Moharram Challenger

Large transformer models trained on diverse datasets have shown a remarkable ability to learn in-context, achieving high few-shot performance on tasks they were not explicitly trained to solve. In this paper, we study the in-context…

Machine Learning · Computer Science 2023-06-27 Jonathan N. Lee , Annie Xie , Aldo Pacchiano , Yash Chandak , Chelsea Finn , Ofir Nachum , Emma Brunskill

The hierarchy of global and local planners is one of the most commonly utilized system designs in autonomous robot navigation. While the global planner generates a reference path from the current to goal locations based on the pre-built…

Robotics · Computer Science 2024-02-28 Kohei Honda , Ryo Yonetani , Mai Nishimura , Tadashi Kozuno

Constrained robot motion planning is a ubiquitous need for robots interacting with everyday environments, but it is a notoriously difficult problem to solve. Many sampled points in a sample-based planner need to be rejected as they fall…

Robotics · Computer Science 2023-09-28 Jacob J. Johnson , Ahmed H. Qureshi , Michael C. Yip

In this paper a deep reinforcement based multi-agent path planning approach is introduced. The experiments are realized in a simulation environment and in this environment different multi-agent path planning problems are produced. The…

Machine Learning · Computer Science 2021-10-05 Mert Çetinkaya

Transformers can generate predictions in two approaches: 1. auto-regressively by conditioning each sequence element on the previous ones, or 2. directly produce an output sequences in parallel. While research has mostly explored upon this…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Andrea Alfieri , Yancong Lin , Jan C. van Gemert

Spatial transformer networks (STNs) were designed to enable CNNs to learn invariance to image transformations. STNs were originally proposed to transform CNN feature maps as well as input images. This enables the use of more complex…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Lukas Finnveden , Ylva Jansson , Tony Lindeberg

Estimating path loss for a transmitter-receiver location is key to many use-cases including network planning and handover. Machine learning has become a popular tool to predict wireless channel properties based on map data. In this work, we…

Last-mile delivery systems commonly propose the use of autonomous robotic vehicles to increase scalability and efficiency. The economic inefficiency of collecting accurate prior maps for navigation motivates the use of planning algorithms…

Robotics · Computer Science 2020-06-03 Michael Everett , Justin Miller , Jonathan P. How

Vision Transformers (ViTs) have achieved comparable or superior performance than Convolutional Neural Networks (CNNs) in computer vision. This empirical breakthrough is even more remarkable since, in contrast to CNNs, ViTs do not embed any…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Samy Jelassi , Michael E. Sander , Yuanzhi Li

Sampling-based motion planning is the predominant paradigm in many real-world robotic applications, but its performance is immensely dependent on the quality of the samples. The majority of traditional planners are inefficient as they use…

Robotics · Computer Science 2020-10-23 Tin Lai , Fabio Ramos