English
Related papers

Related papers: Latent Variable Sequential Set Transformers For Jo…

200 papers

Simulating realistic behaviors of traffic agents is pivotal for efficiently validating the safety of autonomous driving systems. Existing data-driven simulators primarily use an encoder-decoder architecture to encode the historical…

Artificial Intelligence · Computer Science 2024-11-12 Zikang Zhou , Haibo Hu , Xinhong Chen , Jianping Wang , Nan Guan , Kui Wu , Yung-Hui Li , Yu-Kai Huang , Chun Jason Xue

Trajectory prediction in autonomous driving relies on accurate representation of all relevant contexts of the driving scene, including traffic participants, road topology, traffic signs, as well as their semantic relations to each other.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Zhigang Sun , Zixu Wang , Lavdim Halilaj , Juergen Luettin

Multi-modal data-sets are ubiquitous in modern applications, and multi-modal Variational Autoencoders are a popular family of models that aim to learn a joint representation of the different modalities. However, existing approaches suffer…

Machine Learning · Computer Science 2023-12-19 Mustapha Bounoua , Giulio Franzese , Pietro Michiardi

Accurate and robust trajectory prediction of neighboring agents is critical for autonomous vehicles traversing in complex scenes. Most methods proposed in recent years are deep learning-based due to their strength in encoding complex…

Robotics · Computer Science 2023-03-27 Yujun Jiao , Mingze Miao , Zhishuai Yin , Chunyuan Lei , Xu Zhu , Linzhen Nie , Bo Tao

Self-driving vehicles rely on multimodal motion forecasts to effectively interact with their environment and plan safe maneuvers. We introduce SceneMotion, an attention-based model for forecasting scene-wide motion modes of multiple traffic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Royden Wagner , Ömer Sahin Tas , Marlon Steiner , Fabian Konstantinidis , Hendrik Königshof , Marvin Klemp , Carlos Fernandez , Christoph Stiller

Predicting the motion of other agents in a scene is highly relevant for autonomous driving, as it allows a self-driving car to anticipate. Inspired by the success of decoder-only models for language modeling, we propose DONUT, a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Markus Knoche , Daan de Geus , Bastian Leibe

In this work, we propose a learning based neural model that provides both the longitudinal and lateral control commands to simultaneously navigate multiple vehicles. The goal is to ensure that each vehicle reaches a desired target state…

Robotics · Computer Science 2024-03-22 Yining Ma , Qadeer Khan , Daniel Cremers

Motion forecasting for agents in autonomous driving is highly challenging due to the numerous possibilities for each agent's next action and their complex interactions in space and time. In real applications, motion forecasting takes place…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Nan Song , Bozhou Zhang , Xiatian Zhu , Li Zhang

While multi-agent interactions can be naturally modeled as a graph, the environment has traditionally been considered as a black box. We propose to create a shared agent-entity graph, where agents and environmental entities form vertices,…

Machine Learning · Computer Science 2019-06-05 Akshat Agarwal , Sumit Kumar , Katia Sycara

Forecasting the future behavior of all traffic agents in the vicinity is a key task to achieve safe and reliable autonomous driving systems. It is a challenging problem as agents adjust their behavior depending on their intentions, the…

Robotics · Computer Science 2021-12-30 Edoardo Mello Rella , Jan-Nico Zaech , Alexander Liniger , Luc Van Gool

Detectors with high coverage have direct and far-reaching benefits for road users in route planning and avoiding traffic congestion, but utilizing these data presents unique challenges including: the dynamic temporal correlation, and the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 He Li , Shiyu Zhang , Xuejiao Li , Liangcai Su , Hongjie Huang , Duo Jin , Linghao Chen , Jianbing Huang , Jaesoo Yoo

Multi-agent trajectory prediction in autonomous driving requires a comprehensive understanding of complex social dynamics. Existing methods, however, often struggle to capture the full richness of these dynamics, particularly the…

Artificial Intelligence · Computer Science 2025-12-11 Bingqing Wei , Lianmin Chen , Zhongyu Xia , Yongtao Wang

Forecasting the future states of surrounding traffic participants is a crucial capability for autonomous vehicles. The recently proposed occupancy flow field prediction introduces a scalable and effective representation to jointly predict…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Haochen Liu , Zhiyu Huang , Chen Lv

Reasoning about human motion is an important prerequisite to safe and socially-aware robotic navigation. As a result, multi-agent behavior prediction has become a core component of modern human-robot interactive systems, such as…

Robotics · Computer Science 2021-01-14 Tim Salzmann , Boris Ivanovic , Punarjay Chakravarty , Marco Pavone

Predicting the motion of multiple traffic participants has always been one of the most challenging tasks in autonomous driving. The recently proposed occupancy flow field prediction method has shown to be a more effective and scalable…

Systems and Control · Electrical Eng. & Systems 2024-07-02 Zhan Chen , Chen Tang , Lu Xiong

Data-driven simulation has become a favorable way to train and test autonomous driving algorithms. The idea of replacing the actual environment with a learned simulator has also been explored in model-based reinforcement learning in the…

Robotics · Computer Science 2023-09-29 Zhejun Zhang , Alexander Liniger , Dengxin Dai , Fisher Yu , Luc Van Gool

Forecasting vehicular motions in autonomous driving requires a deep understanding of agent interactions and the preservation of motion equivariance under Euclidean geometric transformations. Traditional models often lack the sophistication…

Robotics · Computer Science 2025-08-05 Yuping Wang , Jier Chen

In autonomous driving, accurately interpreting the movements of other road users and leveraging this knowledge to forecast future trajectories is crucial. This is typically achieved through the integration of map data and tracked…

Robotics · Computer Science 2024-05-17 Tobias Demmler , Andreas Tamke , Thao Dang , Karsten Haug , Lars Mikelsons

Learning an agent model that behaves like humans-capable of jointly perceiving the environment, predicting the future, and taking actions from a first-person perspective-is a fundamental challenge in computer vision. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Lu Chen , Yizhou Wang , Shixiang Tang , Qianhong Ma , Tong He , Wanli Ouyang , Xiaowei Zhou , Hujun Bao , Sida Peng

Motion prediction is crucial for autonomous driving systems to understand complex driving scenarios and make informed decisions. However, this task is challenging due to the diverse behaviors of traffic participants and complex…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Shaoshuai Shi , Li Jiang , Dengxin Dai , Bernt Schiele