English
Related papers

Related papers: Joint Localization and Planning using Diffusion

200 papers

Task planning for embodied AI has been one of the most challenging problems where the community does not meet a consensus in terms of formulation. In this paper, we aim to tackle this problem with a unified framework consisting of an…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Cheng-Fu Yang , Haoyang Xu , Te-Lin Wu , Xiaofeng Gao , Kai-Wei Chang , Feng Gao

Autonomous exploration in structured and complex indoor environments remains a challenging task, as existing methods often struggle to appropriately model unobserved space and plan globally efficient paths. To address these limitations, we…

Robotics · Computer Science 2026-03-06 Zijun Che , Yinghong Zhang , Shengyi Liang , Boyu Zhou , Jun Ma , Jinni Zhou

Mobile robot navigation in dynamic environments with pedestrian traffic is a key challenge in the development of autonomous mobile service robots. Recently, deep reinforcement learning-based methods have been actively studied and have…

Robotics · Computer Science 2026-05-19 Kohei Matsumoto , Yuki Tomita , Yuki Hyodo , Ryo Kurazume

Diffusion generative models have demonstrated remarkable success in visual domains such as image and video generation. They have also recently emerged as a promising approach in robotics, especially in robot manipulations. Diffusion models…

Robotics · Computer Science 2025-07-15 Rosa Wolf , Yitian Shi , Sheng Liu , Rania Rayyes

Localization is a key challenge in many robotics applications. In this work we explore LIDAR-based global localization in both urban and natural environments and develop a method suitable for online application. Our approach leverages…

Robotics · Computer Science 2023-02-01 Georgi Tinchev , Adrian Penate-Sanchez , Maurice Fallon

Compositional diffusion models offer a promising route to long-horizon planning by denoising multiple overlapping sub-trajectories while ensuring that together they constitute a global solution. However, enforcing local behavior over long…

Robotics · Computer Science 2026-05-19 Yaniv Hassidof , Adir Morgan , Yilun Du , Kiril Solovey

The Object Navigation (ObjectNav) task aims to guide an agent to locate target objects in unseen environments using partial observations. Prior approaches have employed location prediction paradigms to achieve long-term goal reasoning, yet…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Yiming Ji , Kaijie Yun , Yang Liu , Zhengpu Wang , Boyu Ma , Zongwu Xie , Hong Liu

Mobile robots on construction sites require accurate pose estimation to perform autonomous surveying and inspection missions. Localization in construction sites is a particularly challenging problem due to the presence of repetitive…

Robotics · Computer Science 2025-04-18 Benjamin Krummenacher , Jonas Frey , Turcan Tuna , Olga Vysotska , Marco Hutter

Global localization is an important and widely studied problem for many robotic applications. Place recognition approaches can be exploited to solve this task, e.g., in the autonomous driving field. While most vision-based approaches match…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 Daniele Cattaneo , Matteo Vaghi , Simone Fontana , Augusto Luis Ballardini , Domenico Giorgio Sorrenti

The exploration of high-speed movement by robots or road traffic agents is crucial for autonomous driving and navigation. Trajectory prediction at high speeds requires considering historical features and interactions with surrounding…

Robotics · Computer Science 2024-05-14 Yao Liu , Ruoyu Wang , Yuanjiang Cao , Quan Z. Sheng , Lina Yao

Building generalized models that can solve many computer vision tasks simultaneously is an intriguing direction. Recent works have shown image itself can be used as a natural interface for general-purpose visual perception and demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Yue Fan , Yongqin Xian , Xiaohua Zhai , Alexander Kolesnikov , Muhammad Ferjad Naeem , Bernt Schiele , Federico Tombari

We introduce a learning-guided motion planning framework that generates seed trajectories using a diffusion model for trajectory optimization. Given a workspace, our method approximates the configuration space (C-space) obstacles through an…

Robotics · Computer Science 2025-03-20 Mingyo Seo , Yoonyoung Cho , Yoonchang Sung , Peter Stone , Yuke Zhu , Beomjoon Kim

Diffusion model-based approaches have shown promise in data-driven planning, but there are no safety guarantees, thus making it hard to be applied for safety-critical applications. To address these challenges, we propose a new method,…

Machine Learning · Computer Science 2023-06-02 Wei Xiao , Tsun-Hsuan Wang , Chuang Gan , Daniela Rus

Diffusion models have risen as a powerful tool in robotics due to their flexibility and multi-modality. While some of these methods effectively address complex problems, they often depend heavily on inference-time obstacle detection and…

Visual traversability estimation is critical for autonomous navigation, but existing VLM-based methods rely on hand-crafted prompts, generalize poorly across embodiments, and output only traversability maps, leaving trajectory generation to…

Diffusion models excel at modeling complex and multimodal trajectory distributions for decision-making and control. Reward-gradient guided denoising has been recently proposed to generate trajectories that maximize both a differentiable…

Machine Learning · Computer Science 2024-07-18 Brian Yang , Huangyuan Su , Nikolaos Gkanatsios , Tsung-Wei Ke , Ayush Jain , Jeff Schneider , Katerina Fragkiadaki

Route planning for navigation under partial observability plays a crucial role in modern robotics and autonomous driving. Existing route planning approaches can be categorized into two main classes: traditional autoregressive and…

Robotics · Computer Science 2024-04-04 Gengyu Zhang , Hao Tang , Yan Yan

Discriminative classifiers have become a foundational tool in deep learning for medical imaging, excelling at learning separable features of complex data distributions. However, these models often need careful design, augmentation, and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Gian Mario Favero , Parham Saremi , Emily Kaczmarek , Brennan Nichyporuk , Tal Arbel

Multi-arm motion planning is fundamental for enabling arms to complete complex long-horizon tasks in shared spaces efficiently but current methods struggle with scalability due to exponential state-space growth and reliance on large…

Robotics · Computer Science 2025-09-11 Viraj Parimi , Brian C. Williams

This paper presents an end-to-end neural architecture based on Diffusion Models for spatial puzzle solving, particularly jigsaw puzzle and room arrangement tasks. In the latter task, for instance, the proposed system "PuzzleFusion" takes a…

Artificial Intelligence · Computer Science 2023-10-05 Sepidehsadat Hosseini , Mohammad Amin Shabani , Saghar Irandoust , Yasutaka Furukawa