English
Related papers

Related papers: Multi-modal Motion Prediction with Transformer-bas…

200 papers

Autonomous transportation systems such as road vehicles or vessels require the consideration of the static and dynamic environment to dislocate without collision. Anticipating the behavior of an agent in a given situation is required to…

Machine Learning · Computer Science 2024-06-06 Kathrin Donandt , Dirk Söffker

In most classical Autonomous Vehicle (AV) stacks, the prediction and planning layers are separated, limiting the planner to react to predictions that are not informed by the planned trajectory of the AV. This work presents a module that…

Robotics · Computer Science 2022-04-06 Jose L. Vazquez , Alexander Liniger , Wilko Schwarting , Daniela Rus , Luc Van Gool

Transformer has significantly propelled the development of artificial intelligence, and certainly the development of agents as well. We categorize attention structures of Transformer into two types based on the source of the input…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yongjin Cui , Xiaohui Fan , Huajun Chen

Autonomous parking plays a vital role in intelligent vehicle systems, particularly in constrained urban environments where high-precision control is required. While traditional rule-based parking systems struggle with environmental…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Jun Fu , Bin Tian , Haonan Chen , Shi Meng , Tingting Yao

Route planning for a fleet of vehicles is an important task in applications such as package delivery, surveillance, or transportation, often integrated within larger Intelligent Transportation Systems (ITS). This problem is commonly…

Artificial Intelligence · Computer Science 2025-05-21 Daniel Fuertes , Carlos R. del-Blanco , Fernando Jaureguizar , Narciso García

While attention has been empirically shown to improve model performance, it lacks a rigorous mathematical justification. This short paper establishes a novel connection between attention mechanisms and multinomial regression. Specifically,…

Machine Learning · Computer Science 2025-10-28 Jonas A. Actor , Anthony Gruber , Eric C. Cyr

Trajectory prediction in autonomous driving relies on accurate representation of all relevant contexts of the driving scene, including traffic participants, road topology, traffic signs, as well as their semantic relations to each other.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Zhigang Sun , Zixu Wang , Lavdim Halilaj , Juergen Luettin

For autonomous vehicles (AVs) to behave appropriately on roads populated by human-driven vehicles, they must be able to reason about the uncertain intentions and decisions of other drivers from rich perceptual information. Towards these…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Nicholas Rhinehart , Rowan McAllister , Kris Kitani , Sergey Levine

The design of a safe and reliable Autonomous Driving stack (ADS) is one of the most challenging tasks of our era. These ADS are expected to be driven in highly dynamic environments with full autonomy, and a reliability greater than human…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Carlos Gómez-Huélamo , Marcos V. Conde , Miguel Ortiz , Santiago Montiel , Rafael Barea , Luis M. Bergasa

Anticipating human actions is an important task that needs to be addressed for the development of reliable intelligent agents, such as self-driving cars or robot assistants. While the ability to make future predictions with high accuracy is…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Olga Zatsarynna , Yazan Abu Farha , Juergen Gall

Car-following refers to a control process in which the following vehicle (FV) tries to keep a safe distance between itself and the lead vehicle (LV) by adjusting its acceleration in response to the actions of the vehicle ahead. The…

Artificial Intelligence · Computer Science 2022-02-08 Meixin Zhu , Simon S. Du , Xuesong Wang , Hao , Yang , Ziyuan Pu , Yinhai Wang

Dynamic graph learning plays a pivotal role in modeling evolving relationships over time, especially for temporal link prediction tasks in domains such as traffic systems, social networks, and recommendation platforms. While…

Machine Learning · Computer Science 2025-11-18 Tao Zou , Chengfeng Wu , Tianxi Liao , Junchen Ye , Bowen Du

We address multi-modal trajectory forecasting of agents in unknown scenes by formulating it as a planning problem. We present an approach consisting of three models; a goal prediction model to identify potential goals of the agent, an…

Robotics · Computer Science 2019-05-30 Nachiket Deo , Mohan M. Trivedi

Trajectory prediction is a critical component of autonomous driving, essential for ensuring both safety and efficiency on the road. However, traditional approaches often struggle with the scarcity of labeled data and exhibit suboptimal…

Robotics · Computer Science 2025-09-18 Jianxin Shi , Zengqi Peng , Xiaolong Chen , Tianyu Wo , Jun Ma

Predicting future sensory states is crucial for learning agents such as robots, drones, and autonomous vehicles. In this paper, we couple multiple sensory modalities with exploratory actions and propose a predictive neural network…

Robotics · Computer Science 2021-09-17 Xiaohui Chen , Ramtin Hosseini , Karen Panetta , Jivko Sinapov

We propose a novel solution for predicting future trajectories of pedestrians. Our method uses a multimodal encoder-decoder transformer architecture, which takes as input both pedestrian locations and ego-vehicle speeds. Notably, our…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Haleh Damirchi , Michael Greenspan , Ali Etemad

Motion prediction has been an essential component of autonomous driving systems since it handles highly uncertain and complex scenarios involving moving agents of different types. In this paper, we propose a Multi-Granular TRansformer…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Yiqian Gan , Hao Xiao , Yizhe Zhao , Ethan Zhang , Zhe Huang , Xin Ye , Lingting Ge

The ability of intelligent systems to predict human behaviors is crucial, particularly in fields such as autonomous vehicle navigation and social robotics. However, the complexity of human motion have prevented the development of a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Yang Gao , Po-Chien Luan , Alexandre Alahi

Trajectory prediction has been a long-standing problem in intelligent systems like autonomous driving and robot navigation. Models trained on large-scale benchmarks have made significant progress in improving prediction accuracy. However,…

Robotics · Computer Science 2023-06-21 Hao Cheng , Mengmeng Liu , Lin Chen , Hellward Broszio , Monika Sester , Michael Ying Yang

Traffic prediction is a challenging spatio-temporal forecasting problem that involves highly complex spatio-temporal correlations. This paper proposes a Multi-level Multi-view Augmented Spatio-temporal Transformer (LVSTformer) for traffic…

Machine Learning · Computer Science 2024-06-19 Jiaqi Lin , Qianqian Ren