English
Related papers

Related papers: ModeSeq: Taming Sparse Multimodal Motion Predictio…

200 papers

Predicting the future behavior of road users is one of the most challenging and important problems in autonomous driving. Applying deep learning to this problem requires fusing heterogeneous world state in the form of rich perception…

This paper proposes a novel approach to motion planning and decision-making for automated vehicles, using a multi-modal Model Predictive Path Integral control algorithm. The method samples with Sobol sequences around the prior input and…

Robotics · Computer Science 2025-09-01 Alberto Bertipaglia , Dariu M. Gavrila , Barys Shyrokau

Autonomous Vehicle decisions rely on multimodal prediction models that account for multiple route options and the inherent uncertainty in human behavior. However, models can suffer from mode collapse, where only the most likely mode is…

Robotics · Computer Science 2025-07-01 Maarten Hugenholtz , Anna Meszaros , Jens Kober , Zlatan Ajanovic

Trajectory prediction is essential for the safety and efficiency of planning in autonomous vehicles. However, current models often fail to fully capture complex traffic rules and the complete range of potential vehicle movements. Addressing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Ahmad Rahimi , Alexandre Alahi

Motion planning at urban intersections that accounts for the situation context, handles occlusions, and deals with measurement and prediction uncertainty is a major challenge on the way to urban automated driving. In this work, we address…

Robotics · Computer Science 2021-10-22 Johannes Müller , Jan Strohbeck , Martin Herrmann , Michael Buchholz

Trajectory forecasting has become a popular deep learning task due to its relevance for scenario simulation for autonomous driving. Specifically, trajectory forecasting predicts the trajectory of a short-horizon future for specific human…

Robotics · Computer Science 2025-03-10 Laura Zheng , Hamidreza Yaghoubi Araghi , Tony Wu , Sandeep Thalapanane , Tianyi Zhou , Ming C. Lin

In video prediction tasks, one major challenge is to capture the multi-modal nature of future contents and dynamics. In this work, we propose a simple yet effective framework that can efficiently predict plausible future states. The key…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Jingwei Xu , Huazhe Xu , Bingbing Ni , Xiaokang Yang , Trevor Darrell

The ability to predict the future movements of other vehicles is a subconscious and effortless skill for humans and key to safe autonomous driving. Therefore, trajectory prediction for autonomous cars has gained a lot of attention in recent…

Robotics · Computer Science 2021-09-16 Benedikt Mersch , Thomas Höllen , Kun Zhao , Cyrill Stachniss , Ribana Roscher

Motion prediction plays an important role in autonomous driving. This study presents LMFormer, a lane-aware transformer network for trajectory prediction tasks. In contrast to previous studies, our work provides a simple mechanism to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Harsh Yadav , Maximilian Schaefer , Kun Zhao , Tobias Meisen

Trajectory prediction is a critical part of many AI applications, for example, the safe operation of autonomous vehicles. However, current methods are prone to making inconsistent and physically unrealistic predictions. We leverage insights…

Machine Learning · Computer Science 2021-03-19 Robin Walters , Jinxi Li , Rose Yu

End-to-end autonomous driving increasingly leverages self-supervised video pretraining to learn transferable planning representations. However, pretraining video world models for scene understanding has so far brought only limited…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Linhan Wang , Zichong Yang , Chen Bai , Guoxiang Zhang , Xiaotong Liu , Xiaoyin Zheng , Xiao-Xiao Long , Chang-Tien Lu , Cheng Lu

Anticipating human actions is an important task that needs to be addressed for the development of reliable intelligent agents, such as self-driving cars or robot assistants. While the ability to make future predictions with high accuracy is…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Olga Zatsarynna , Yazan Abu Farha , Juergen Gall

Accurate travel time estimation (TTE) plays a crucial role in intelligent transportation systems. However, it remains challenging due to heterogeneous data sources and complex traffic dynamics. Moreover, traditional approaches typically…

Machine Learning · Computer Science 2026-01-27 Zhi Liu , Xuyuan Hu , Xiao Han , Zhehao Dai , Zhaolin Deng , Guojiang Shen , Xiangjie Kong

To plan a safe and efficient route, an autonomous vehicle should anticipate future trajectories of other agents around it. Trajectory prediction is an extremely challenging task which recently gained a lot of attention in the autonomous…

Robotics · Computer Science 2023-03-24 Apoorv Singh

To plan a safe and efficient route, an autonomous vehicle should anticipate future motions of other agents around it. Motion prediction is an extremely challenging task that recently gained significant attention within the research…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Stepan Konev , Kirill Brodt , Artsiom Sanakoyeu

We introduce temporal multimodal multivariate learning, a new family of decision making models that can indirectly learn and transfer online information from simultaneous observations of a probability distribution with more than one peak or…

We study the problem of fitting a model to a dynamical environment when new modes of behavior emerge sequentially. The learning model is aware when a new mode appears, but it cannot access the true modes of individual training sequences.…

Machine Learning · Computer Science 2024-05-10 Abdullah Akgül , Gozde Unal , Melih Kandemir

Current autonomous driving systems often favor end-to-end frameworks, which take sensor inputs like images and learn to map them into trajectory space via neural networks. Previous work has demonstrated that models can achieve better…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Zebin Xing , Pengxuan Yang , Linbo Wang , Yichen Zhang , Yiming Hu , Yupeng Zheng , Junli Wang , Yinfeng Gao , Guang Li , Kun Ma , Long Chen , Zhongpu Xia , Qichao Zhang , Hangjun Ye , Dongbin Zhao

Trajectory prediction is an essential step in the pipeline of an autonomous vehicle. Inaccurate or inconsistent predictions regarding the movement of agents in its surroundings lead to poorly planned maneuvers and potentially dangerous…

Machine Learning · Computer Science 2025-07-04 Caio Azevedo , Lina Achaji , Stefano Sabatini , Nicola Poerio , Grzegorz Bartyzel , Sascha Hornauer , Fabien Moutarde

Predicting the motion of a driver's vehicle is crucial for advanced driving systems, enabling detection of potential risks towards shared control between the driver and automation systems. In this paper, we propose a variational neural…

Robotics · Computer Science 2019-03-07 Xin Huang , Stephen McGill , Brian C. Williams , Luke Fletcher , Guy Rosman