English
Related papers

Related papers: DONUT: A Decoder-Only Model for Trajectory Predict…

200 papers

Motion prediction is a challenging problem in autonomous driving as it demands the system to comprehend stochastic dynamics and the multi-modal nature of real-world agent interactions. Diffusion models have recently risen to prominence, and…

Robotics · Computer Science 2024-05-03 Jiahui Li , Tianle Shen , Zekai Gu , Jiawei Sun , Chengran Yuan , Yuhang Han , Shuo Sun , Marcelo H. Ang

The development of language models have moved from encoder-decoder to decoder-only designs. In addition, we observe that the two most popular multimodal tasks, the generative and contrastive tasks, are nontrivial to accommodate in one…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Weicheng Kuo , AJ Piergiovanni , Dahun Kim , Xiyang Luo , Ben Caine , Wei Li , Abhijit Ogale , Luowei Zhou , Andrew Dai , Zhifeng Chen , Claire Cui , Anelia Angelova

Trajectory prediction in urban mixed-traffic zones (a.k.a. shared spaces) is critical for many intelligent transportation systems, such as intent detection for autonomous driving. However, there are many challenges to predict the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Hao Cheng , Wentong Liao , Michael Ying Yang , Monika Sester , Bodo Rosenhahn

Accurate motion prediction of pedestrians, cyclists, and other surrounding vehicles (all called agents) is very important for autonomous driving. Most existing works capture map information through an one-stage interaction with map by…

Machine Learning · Computer Science 2024-03-26 Yinke Dong , Haifeng Yuan , Hongkun Liu , Wei Jing , Fangzhen Li , Hongmin Liu , Bin Fan

Understanding the behavior of road users is of vital importance for the development of trajectory prediction systems. In this context, the latest advances have focused on recurrent structures, establishing the social interaction between the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 A. Quintanar , D. Fernández-Llorca , I. Parra , R. Izquierdo , M. A. Sotelo

Due to the complex and changing interactions in dynamic scenarios, motion forecasting is a challenging problem in autonomous driving. Most existing works exploit static road graphs to characterize scenarios and are limited in modeling…

Artificial Intelligence · Computer Science 2023-03-09 Xing Gao , Xiaogang Jia , Yikang Li , Hongkai Xiong

Most prior motion prediction endeavors in autonomous driving have inadequately encoded future scenarios, leading to predictions that may fail to accurately capture the diverse movements of agents (e.g., vehicles or pedestrians). To address…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Mingkun Wang , Xiaoguang Ren , Ruochun Jin , Minglong Li , Xiaochuan Zhang , Changqian Yu , Mingxu Wang , Wenjing Yang

It is desirable to predict the behavior of traffic participants conditioned on different planned trajectories of the autonomous vehicle. This allows the downstream planner to estimate the impact of its decisions. Recent approaches for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Julian Schmidt , Pascal Huissel , Julian Wiederer , Julian Jordan , Vasileios Belagiannis , Klaus Dietmayer

Predicting future behavior of the surrounding vehicles is crucial for self-driving platforms to safely navigate through other traffic. This is critical when making decisions like crossing an unsignalized intersection. We address the problem…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Mohamed Hasan , Evangelos Paschalidis , Albert Solernou , He Wang , Gustav Markkula , Richard Romano

Next-token prediction is conventionally done using decoder-only Transformers with causal attention, as this approach allows for efficient reuse of keys and values. What if we were not compute-limited, should we still use decoder-only…

Machine Learning · Computer Science 2025-02-05 Ethan Ewer , Daewon Chae , Thomas Zeng , Jinkyu Kim , Kangwook Lee

Accurate motion forecasting for traffic agents is crucial for ensuring the safety and efficiency of autonomous driving systems in dynamically changing environments. Mainstream methods adopt a one-query-one-trajectory paradigm, where each…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Bozhou Zhang , Nan Song , Li Zhang

Predicting future trajectories of surrounding obstacles is a crucial task for autonomous driving cars to achieve a high degree of road safety. There are several challenges in trajectory prediction in real-world traffic scenarios, including…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Bo Dong , Hao Liu , Yu Bai , Jinbiao Lin , Zhuoran Xu , Xinyu Xu , Qi Kong

Autonomous driving systems require a comprehensive understanding of the environment, achieved by extracting visual features essential for perception, planning, and control. However, models trained solely on single-task objectives or generic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Huy-Dung Nguyen , Anass Bairouk , Mirjana Maras , Wei Xiao , Tsun-Hsuan Wang , Patrick Chareyre , Ramin Hasani , Marc Blanchon , Daniela Rus

Predicting the future motion of traffic agents is crucial for safe and efficient autonomous driving. To this end, we present PredictionNet, a deep neural network (DNN) that predicts the motion of all surrounding traffic agents together with…

Simulating realistic behaviors of traffic agents is pivotal for efficiently validating the safety of autonomous driving systems. Existing data-driven simulators primarily use an encoder-decoder architecture to encode the historical…

Artificial Intelligence · Computer Science 2024-11-12 Zikang Zhou , Haibo Hu , Xinhong Chen , Jianping Wang , Nan Guan , Kui Wu , Yung-Hui Li , Yu-Kai Huang , Chun Jason Xue

Realizing delay-capacity in intermittently connected mobile networks remains a largely open question, with state-of-the-art routing schemes typically focusing either on delay or on capacity. We show the feasibility of routing with both high…

Networking and Internet Architecture · Computer Science 2014-01-24 Dhrubojyoti Roy , Mukundan Sridharan , Satyajeet Deshpande , Anish Arora

This paper proposes a novel deep learning framework for multi-modal motion prediction. The framework consists of three parts: recurrent neural networks to process the target agent's motion process, convolutional neural networks to process…

Robotics · Computer Science 2022-07-05 Zhiyu Huang , Xiaoyu Mo , Chen Lv

Predicting future trajectories is critical in autonomous navigation, especially in preventing accidents involving humans, where a predictive agent's ability to anticipate in advance is of utmost importance. Trajectory forecasting models,…

Robotics · Computer Science 2023-11-07 Saeed Saadatnejad , Yang Gao , Hamid Rezatofighi , Alexandre Alahi

Existing top-performance autonomous driving systems typically rely on the multi-modal fusion strategy for reliable scene understanding. This design is however fundamentally restricted due to overlooking the modality-specific strengths and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Zeyu Yang , Nan Song , Wei Li , Xiatian Zhu , Li Zhang , Philip H. S. Torr

Trajectory prediction of agents is crucial for the safety of autonomous vehicles, whereas previous approaches usually rely on sufficiently long-observed trajectory to predict the future trajectory of the agents. However, in real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Rongqing Li , Changsheng Li , Yuhang Li , Hanjie Li , Yi Chen , Dongchun Ren , Ye Yuan , Guoren Wang