English
Related papers

Related papers: A Knowledge-Driven Diffusion Policy for End-to-End…

200 papers

Diffusion-based trajectory planners have demonstrated strong capability for modeling the multimodal nature of human driving behavior, but their reliance on iterative stochastic sampling poses critical challenges for real-time,…

Artificial Intelligence · Computer Science 2026-02-10 Ruturaj Reddy , Hrishav Bakul Barua , Junn Yong Loo , Thanh Thi Nguyen , Ganesh Krishnasamy

As the prediction horizon increases, predicting the future evolution of traffic scenes becomes increasingly difficult due to the multi-modal nature of agent motion. Most state-of-the-art (SotA) prediction models primarily focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Yue Yao , Mohamed-Khalil Bouzidi , Daniel Goehring , Joerg Reichardt

Real-world driving involves intricate interactions among vehicles navigating through dense traffic scenarios. Recent research focuses on enhancing the interaction awareness of autonomous vehicles to leverage these interactions in…

Robotics · Computer Science 2024-04-03 Piyush Gupta , David Isele , Sangjae Bae

Diffusion models have demonstrated strong potential for robotic trajectory planning. However, generating coherent trajectories from high-level instructions remains challenging, especially for long-range composition tasks requiring multiple…

Robotics · Computer Science 2024-03-29 Zhixuan Liang , Yao Mu , Hengbo Ma , Masayoshi Tomizuka , Mingyu Ding , Ping Luo

Contact-rich manipulation is central to many everyday human activities, requiring continuous adaptation to contact uncertainty and external disturbances through multi-modal perception, particularly vision and tactile feedback. While…

Robotics · Computer Science 2026-04-28 Teng Xue , Alberto Rigo , Bingjian Huang , Jiayi Shen , Zhengtong Xu , Nick Colonnese , Amirhossein H. Memar

Recent progress in imitation learning has been enabled by policy architectures that scale to complex visuomotor tasks, multimodal distributions, and large datasets. However, these methods often rely on learning from large amount of expert…

Robotics · Computer Science 2025-04-24 Amber Xie , Oleh Rybkin , Dorsa Sadigh , Chelsea Finn

Recent advances in motion planning for autonomous driving have led to models capable of generating high-quality trajectories. However, most existing planners tend to fix their policy after supervised training, leading to consistent but…

Robotics · Computer Science 2025-08-26 Fan Ding , Xuewen Luo , Hwa Hui Tew , Ruturaj Reddy , Xikun Wang , Junn Yong Loo

Generative diffusion models for end-to-end autonomous driving often suffer from mode collapse, tending to generate conservative and homogeneous behaviors. While DiffusionDrive employs predefined anchors representing different driving…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Jialv Zou , Shaoyu Chen , Bencheng Liao , Zhiyu Zheng , Yuehao Song , Lefei Zhang , Qian Zhang , Wenyu Liu , Xinggang Wang

Accurate trajectory prediction and motion planning are crucial for autonomous driving systems to navigate safely in complex, interactive environments characterized by multimodal uncertainties. However, current generation-then-evaluation…

Robotics · Computer Science 2025-09-23 Ruiguo Zhong , Ruoyu Yao , Pei Liu , Xiaolong Chen , Rui Yang , Jun Ma

The objective of this paper is to develop a sample efficient end-to-end deep learning method for self-driving cars, where we attempt to increase the value of the information extracted from samples, through careful analysis obtained from…

Robotics · Computer Science 2020-07-30 Yunus Bicer , Ali Alizadeh , Nazim Kemal Ure , Ahmetcan Erdogan , Orkun Kizilirmak

Model-based reinforcement learning methods often use learning only for the purpose of estimating an approximate dynamics model, offloading the rest of the decision-making work to classical trajectory optimizers. While conceptually simple,…

Machine Learning · Computer Science 2022-12-22 Michael Janner , Yilun Du , Joshua B. Tenenbaum , Sergey Levine

Achieving safe and stylized trajectory planning in complex real-world scenarios remains a critical challenge for autonomous driving systems. This paper proposes the SDD Planner, a diffusion-based framework designed to effectively reconcile…

Robotics · Computer Science 2026-03-13 Shuo Pei , Yong Wang , Yuanchen Zhu , Chen Sun , Qin Li , Yanan Zhao , Huachun Tan

The robotic assembly task poses a key challenge in building generalist robots due to the intrinsic complexity of part interactions and the sensitivity to noise perturbations in contact-rich settings. The assembly agent is typically designed…

Robotics · Computer Science 2025-09-24 Ziyi Xu , Haohong Lin , Shiqi Liu , Ding Zhao

Recent studies have explored leveraging the world knowledge and cognitive capabilities of Vision-Language Models (VLMs) to address the long-tail problem in end-to-end autonomous driving. However, existing methods typically formulate…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yongkang Li , Kaixin Xiong , Xiangyu Guo , Fang Li , Sixu Yan , Gangwei Xu , Lijun Zhou , Long Chen , Haiyang Sun , Bing Wang , Kun Ma , Guang Chen , Hangjun Ye , Wenyu Liu , Xinggang Wang

Diffusion Policies (DPs) have attracted attention for their ability to achieve significant accuracy improvements in various imitation learning tasks. However, DPs depend on Diffusion Models, which require multiple noise removal steps to…

Machine Learning · Computer Science 2025-07-30 Sodtavilan Odonchimed , Tatsuya Matsushima , Simon Holk , Yusuke Iwasawa , Yutaka Matsuo

Intelligent surgical robots have the potential to revolutionize clinical practice by enabling more precise and automated surgical procedures. However, the automation of such robot for surgical tasks remains under-explored compared to recent…

Robotics · Computer Science 2026-03-10 Chonlam Ho , Jianshu Hu , Lei Song , Hesheng Wang , Qi Dou , Yutong Ban

Automated creation of synthetic traffic scenarios is a key part of validating the safety of autonomous vehicles (AVs). In this paper, we propose Scenario Diffusion, a novel diffusion-based architecture for generating traffic scenarios that…

Machine Learning · Computer Science 2023-11-20 Ethan Pronovost , Meghana Reddy Ganesina , Noureldin Hendy , Zeyu Wang , Andres Morales , Kai Wang , Nicholas Roy

Recent neural methods for vehicle routing problems always train and test the deep models on the same instance distribution (i.e., uniform). To tackle the consequent cross-distribution generalization concerns, we bring the knowledge…

Machine Learning · Computer Science 2023-01-20 Jieyi Bi , Yining Ma , Jiahai Wang , Zhiguang Cao , Jinbiao Chen , Yuan Sun , Yeow Meng Chee

End-to-End driving is a promising paradigm as it circumvents the drawbacks associated with modular systems, such as their overwhelming complexity and propensity for error propagation. Autonomous driving transcends conventional traffic…

Robotics · Computer Science 2023-09-20 Pranav Singh Chib , Pravendra Singh

Safety-critical traffic scenarios are integral to the development and validation of autonomous driving systems. These scenarios provide crucial insights into vehicle responses under high-risk conditions rarely encountered in real-world…

Robotics · Computer Science 2024-10-08 Jinxiong Lu , Shoaib Azam , Gokhan Alcan , Ville Kyrki