English
Related papers

Related papers: Shared Cross-Modal Trajectory Prediction for Auton…

200 papers

Context plays a significant role in the generation of motion for dynamic agents in interactive environments. This work proposes a modular method that utilises a learned model of the environment for motion prediction. This modularity…

Machine Learning · Computer Science 2021-01-05 Todor Davchev , Michael Burke , Subramanian Ramamoorthy

Accurately tracking and predicting behaviors of surrounding objects are key prerequisites for intelligent systems such as autonomous vehicles to achieve safe and high-quality decision making and motion planning. However, there still remain…

Robotics · Computer Science 2020-03-31 Jiachen Li , Wei Zhan , Yeping Hu , Masayoshi Tomizuka

In a given scenario, simultaneously and accurately predicting every possible interaction of traffic participants is an important capability for autonomous vehicles. The majority of current researches focused on the prediction of an single…

Machine Learning · Computer Science 2018-10-31 Yeping Hu , Wei Zhan , Masayoshi Tomizuka

Efficient data utilization is crucial for advancing 3D scene understanding in autonomous driving, where reliance on heavily human-annotated LiDAR point clouds challenges fully supervised methods. Addressing this, our study extends into…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Lingdong Kong , Xiang Xu , Jiawei Ren , Wenwei Zhang , Liang Pan , Kai Chen , Wei Tsang Ooi , Ziwei Liu

Multi-modal fusion is a fundamental task for the perception of an autonomous driving system, which has recently intrigued many researchers. However, achieving a rather good performance is not an easy task due to the noisy raw data,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Keli Huang , Botian Shi , Xiang Li , Xin Li , Siyuan Huang , Yikang Li

In this paper, a multi-modal 360$^{\circ}$ framework for 3D object detection and tracking for autonomous vehicles is presented. The process is divided into four main stages. First, images are fed into a CNN network to obtain instance…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jorge Beltrán , Carlos Guindel , Irene Cortés , Alejandro Barrera , Armando Astudillo , Jesús Urdiales , Mario Álvarez , Farid Bekka , Vicente Milanés , Fernando García

Predicting vehicle trajectories plays an important role in autonomous driving and ITS applications. Although multiple deep learning algorithms are devised to predict vehicle trajectories, their reliant on specific graph structure (e.g.,…

Robotics · Computer Science 2026-04-09 Diyi Liu , Zihan Niu , Tu Xu , Lishan Sun

Autonomous vehicles are expected to drive in complex scenarios with several independent non cooperating agents. Path planning for safely navigating in such environments can not just rely on perceiving present location and motion of other…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Francesco Marchetti , Federico Becattini , Lorenzo Seidenari , Alberto Del Bimbo

Autonomous driving systems require a comprehensive understanding of the environment, achieved by extracting visual features essential for perception, planning, and control. However, models trained solely on single-task objectives or generic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Huy-Dung Nguyen , Anass Bairouk , Mirjana Maras , Wei Xiao , Tsun-Hsuan Wang , Patrick Chareyre , Ramin Hasani , Marc Blanchon , Daniela Rus

How should representations from complementary sensors be integrated for autonomous driving? Geometry-based sensor fusion has shown great promise for perception tasks such as object detection and motion forecasting. However, for the actual…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Aditya Prakash , Kashyap Chitta , Andreas Geiger

Trajectory prediction is crucial for autonomous vehicles. The planning system not only needs to know the current state of the surrounding objects but also their possible states in the future. As for vehicles, their trajectories are…

Robotics · Computer Science 2020-07-07 Chenxu Luo , Lin Sun , Dariush Dabiri , Alan Yuille

A crucial component of an autonomous vehicle (AV) is the artificial intelligence (AI) is able to drive towards a desired destination. Today, there are different paradigms addressing the development of AI drivers. On the one hand, we find…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Yi Xiao , Felipe Codevilla , Akhil Gurram , Onay Urfalioglu , Antonio M. López

Transformer-based architectures have shown remarkable performance in vision and language tasks but pose unique challenges for safety-critical applications. This paper presents a conceptual framework for integrating Transformers into…

Software Engineering · Computer Science 2026-01-28 Sven Kirchner , Nils Purschke , Chengdong Wu , Alois Knoll

Autonomous driving presents one of the largest problems that the robotics and artificial intelligence communities are facing at the moment, both in terms of difficulty and potential societal impact. Self-driving vehicles (SDVs) are expected…

Most state-of-the-art works in trajectory forecasting for automotive target predicting the pose and orientation of the agents in the scene. This represents a particularly useful problem, for instance in autonomous driving, but it does not…

Robotics · Computer Science 2024-10-28 Luca Paparusso , Stefano Melzi , Francesco Braghin

Existing top-performance autonomous driving systems typically rely on the multi-modal fusion strategy for reliable scene understanding. This design is however fundamentally restricted due to overlooking the modality-specific strengths and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Zeyu Yang , Nan Song , Wei Li , Xiatian Zhu , Li Zhang , Philip H. S. Torr

Traversability estimation is critical for enabling robots to navigate across diverse terrains and environments. While recent self-supervised learning methods achieve promising results, they often fail to capture the characteristics of…

Robotics · Computer Science 2025-08-26 Zipeng Fang , Yanbo Wang , Lei Zhao , Weidong Chen

Pedestrian behavior prediction is one of the major challenges for intelligent driving systems in urban environments. Pedestrians often exhibit a wide range of behaviors and adequate interpretations of those depend on various sources of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Amir Rasouli , Tiffany Yau , Mohsen Rohani , Jun Luo

Autonomous vehicles hold great promise in improving the future of transportation. The driving models used in these vehicles are based on neural networks, which can be difficult to validate. However, ensuring the safety of these models is…

Robotics · Computer Science 2023-09-14 Maximilian Zipfl , Sven Spickermann , J. Marius Zöllner

Trajectory planning in autonomous driving is highly dependent on predicting the emergent behavior of other road users. Learning-based methods are currently showing impressive results in simulation-based challenges, with transformer-based…

Machine Learning · Computer Science 2024-08-08 Lars Ullrich , Alex McMaster , Knut Graichen