English
Related papers

Related papers: TopoDiffuser: A Diffusion-Based Multimodal Traject…

200 papers

Maritime vessel maneuvers, characterized by their inherent complexity and indeterminacy, requires vessel trajectory prediction system capable of modeling the multi-modality nature of future motion states. Conventional stochastic trajectory…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Changlin Li , Yanglei Gan , Tian Lan , Yuxiang Cai , Xueyi Liu , Run Lin , Qiao Liu

This paper proposes a unified diffusion framework (dubbed UniDiffuser) to fit all distributions relevant to a set of multi-modal data in one model. Our key insight is -- learning diffusion models for marginal, conditional, and joint…

Machine Learning · Computer Science 2023-05-31 Fan Bao , Shen Nie , Kaiwen Xue , Chongxuan Li , Shi Pu , Yaole Wang , Gang Yue , Yue Cao , Hang Su , Jun Zhu

This paper introduces a Multi-modal Diffusion model for Motion Prediction (MDMP) that integrates and synchronizes skeletal data and textual descriptions of actions to generate refined long-term motion predictions with quantifiable…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Leo Bringer , Joey Wilson , Kira Barton , Maani Ghaffari

As multimodal data proliferates across diverse real-world applications, leveraging heterogeneous information such as texts and timestamps for accurate time series forecasting (TSF) has become a critical challenge. While diffusion models…

Machine Learning · Computer Science 2025-12-09 Da Zhang , Bingyu Li , Zhuyuan Zhao , Junyu Gao , Feiping Nie , Xuelong Li

Accurate estimation of motion information is crucial in diverse computational imaging and computer vision applications. Researchers have investigated various methods to extract motion information from a single blurred image, including blur…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Wontae Choi , Jaelin Lee , Hyung Sup Yun , Byeungwoo Jeon , Il Yong Chun

Joint pedestrian trajectory prediction has long grappled with the inherent unpredictability of human behaviors. Recent investigations employing variants of conditional diffusion models in trajectory prediction have exhibited notable…

Robotics · Computer Science 2024-09-05 Haotian Lin , Yixiao Wang , Mingxiao Huo , Chensheng Peng , Zhiyuan Liu , Masayoshi Tomizuka

Diffusion models have emerged as powerful generative frameworks by progressively adding noise to data through a forward process and then reversing this process to generate realistic samples. While these models have achieved strong…

Machine Learning · Computer Science 2025-03-04 Xingzhuo Guo , Yu Zhang , Baixu Chen , Haoran Xu , Jianmin Wang , Mingsheng Long

Recent advances in diffusion models have opened new avenues for research into embodied AI agents and robotics. Despite significant achievements in complex robotic locomotion and skills, mobile manipulation-a capability that requires the…

Robotics · Computer Science 2025-04-03 Sixu Yan , Zeyu Zhang , Muzhi Han , Zaijin Wang , Qi Xie , Zhitian Li , Zhehan Li , Hangxin Liu , Xinggang Wang , Song-Chun Zhu

Accurate prediction of pedestrian trajectories is crucial for improving the safety of autonomous driving. However, this task is generally nontrivial due to the inherent stochasticity of human motion, which naturally requires the predictor…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Ge Sun , Sheng Wang , Lei Zhu , Ming Liu , Jun Ma

While diffusion models can successfully generate data and make predictions, they are predominantly designed for static images. We propose an approach for efficiently training diffusion models for probabilistic spatiotemporal forecasting,…

Machine Learning · Computer Science 2023-10-12 Salva Rühling Cachay , Bo Zhao , Hailey Joren , Rose Yu

Drivable Free-space prediction is a fundamental and crucial problem in autonomous driving. Recent works have addressed the problem by representing the entire non-obstacle road regions as the free-space. In contrast our aim is to estimate…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Keshav Gupta , Tejas S. Stanley , Pranjal Paul , Arun K. Singh , K. Madhava Krishna

The widespread use of GPS devices has driven advances in spatiotemporal data mining, enabling machine learning models to simulate human decision making and generate realistic trajectories, addressing both data collection costs and privacy…

Machine Learning · Computer Science 2025-10-09 Zhiyang Zhang , Ningcong Chen , Xin Zhang , Yanhua Li , Shen Su , Hui Lu , Jun Luo

Automated parking is a critical feature of Advanced Driver Assistance Systems (ADAS), where accurate trajectory prediction is essential to bridge perception and planning modules. Despite its significance, research in this domain remains…

Robotics · Computer Science 2025-08-14 Jiarong Wei , Niclas Vödisch , Anna Rehr , Christian Feist , Abhinav Valada

In this paper, we present a novel trajectory prediction model for autonomous driving, combining a Characterized Diffusion Module and a Spatial-Temporal Interaction Network to address the challenges posed by dynamic and heterogeneous traffic…

Robotics · Computer Science 2024-11-26 Haoming Li

Accurate and uncertainty-aware trajectory prediction remains a core challenge for autonomous driving, driven by complex multi-agent interactions, diverse scene contexts and the inherently stochastic nature of future motion. Diffusion-based…

Machine Learning · Computer Science 2026-02-26 Marion Neumeier , Niklas Roßberg , Michael Botsch , Wolfgang Utschick

Accurate environmental representations are essential for autonomous driving, providing the foundation for safe and efficient navigation. Traditionally, high-definition (HD) maps are providing this representation of the static road…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Thomas Monninger , Zihan Zhang , Steffen Staab , Sihao Ding

The exploration of high-speed movement by robots or road traffic agents is crucial for autonomous driving and navigation. Trajectory prediction at high speeds requires considering historical features and interactions with surrounding…

Robotics · Computer Science 2024-05-14 Yao Liu , Ruoyu Wang , Yuanjiang Cao , Quan Z. Sheng , Lina Yao

Video prediction is a useful function for autonomous driving, enabling intelligent vehicles to reliably anticipate how driving scenes will evolve and thereby supporting reasoning and safer planning. However, existing models are constrained…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Ke Li , Tianjia Yang , Kaidi Liang , Xianbiao Hu , Ruwen Qin

This paper addresses the problem of generating dynamically admissible trajectories for control tasks using diffusion models, particularly in scenarios where the environment is complex and system dynamics are crucial for practical…

Robotics · Computer Science 2025-10-15 Darshan Gadginmath , Fabio Pasqualetti

Diffusion models have attracted significant attention due to the remarkable ability to create content and generate data for tasks like image classification. However, the usage of diffusion models to generate the high-quality object…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Kai Chen , Enze Xie , Zhe Chen , Yibo Wang , Lanqing Hong , Zhenguo Li , Dit-Yan Yeung