English
Related papers

Related papers: ReasonNet: End-to-End Driving with Temporal and Gl…

200 papers

Pedestrian detection is a critical task in autonomous driving, aimed at enhancing safety and reducing risks on the road. Over recent years, significant advancements have been made in improving detection performance. However, these…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Melo Castillo Angie Nataly , Martin Serrano Sergio , Salinas Carlota , Sotelo Miguel Angel

This research work seeks to explore and identify strategies that can determine road topology information in 2D and 3D under highly dynamic urban driving scenarios. To facilitate this exploration, we introduce a substantial dataset…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 David Paz , Narayanan E. Ranganatha , Srinidhi K. Srinivas , Yunchao Yao , Henrik I. Christensen

Autonomous navigation in crowded spaces poses a challenge for mobile robots due to the highly dynamic, partially observable environment. Occlusions are highly prevalent in such settings due to a limited sensor field of view and obstructing…

Robotics · Computer Science 2023-05-02 Ye-Ji Mun , Masha Itkina , Shuijing Liu , Katherine Driggs-Campbell

We consider the problem of intelligently navigating through complex traffic. Urban situations are defined by the underlying map structure and special regulatory objects of e.g. a stop line or crosswalk. Thereon dynamic vehicles (cars,…

Robotics · Computer Science 2023-03-15 Tim Puphal , Benedict Flade , Daan de Geus , Julian Eggert

Autonomous vehicles rely extensively on perception systems to navigate and interpret their surroundings. Despite significant advancements in these systems recently, challenges persist under conditions like occlusion, extreme lighting, or in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Tianyuan Yuan , Yucheng Mao , Jiawei Yang , Yicheng Liu , Yue Wang , Hang Zhao

End-to-end autonomous driving has achieved remarkable progress by integrating perception, prediction, and planning into a fully differentiable framework. Yet, to fully realize its potential, an effective online trajectory evaluation is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Yingyan Li , Yuqi Wang , Yang Liu , Jiawei He , Lue Fan , Zhaoxiang Zhang

Efficient and accurate incident prediction in spatio-temporal systems is critical to minimize service downtime and optimize performance. This work aims to utilize historic data to predict and diagnose incidents using spatio-temporal…

Machine Learning · Computer Science 2022-06-14 Shreshth Tuli , Matthew R. Wilkinson , Chris Kettell

Prognostication of vehicle trajectories in unknown environments is intrinsically a challenging and difficult problem to solve. The behavior of such vehicles is highly influenced by surrounding traffic, road conditions, and rogue…

Robotics · Computer Science 2022-02-01 Nishanth Rao , Suresh Sundaram

This study addresses the critical need for enhanced situational awareness in autonomous driving (AD) by leveraging the contextual reasoning capabilities of large language models (LLMs). Unlike traditional perception systems that rely on…

Artificial Intelligence · Computer Science 2025-01-09 Xuewen Luo , Fan Ding , Fengze Yang , Yang Zhou , Junnyong Loo , Hwa Hui Tew , Chenxi Liu

Understanding event and event-centered commonsense reasoning are crucial for natural language processing (NLP). Given an observed event, it is trivial for human to infer its intents and effects, while this type of If-Then reasoning still…

Computation and Language · Computer Science 2019-12-03 Li Du , Xiao Ding , Ting Liu , Zhongyang Li

The task of motion prediction is pivotal for autonomous driving systems, providing crucial data to choose a vehicle behavior strategy within its surroundings. Existing motion prediction techniques primarily focus on predicting the future…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Youshaa Murhij , Dmitry Yudin

Planning and prediction are two important modules of autonomous driving and have experienced tremendous advancement recently. Nevertheless, most existing methods regard planning and prediction as independent and ignore the correlation…

Robotics · Computer Science 2023-09-08 Jiawei Fu , Yanqing Shen , Zhiqiang Jian , Shitao Chen , Jingmin Xin , Nanning Zheng

While large multimodal models (LMMs) have demonstrated strong performance across various Visual Question Answering (VQA) tasks, certain challenges require complex multi-step reasoning to reach accurate answers. One particularly challenging…

This work addresses the task of risk evaluation in traffic scenarios with limited observability due to restricted sensorial coverage. Here, we concentrate on intersection scenarios that are difficult to access visually. To identify the area…

Robotics · Computer Science 2023-03-14 Florian Damerow , Yuda Li , Tim Puphal , Benedict Flade , Julian Eggert

Robust perception in automated driving requires reliable performance under adverse conditions, where sensors may be affected by partial failures or environmental occlusions. Although existing autonomous driving datasets inherently contain…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Sanjay Kumar , Tim Brophy , Reenu Mohandas , Eoin Martino Grua , Ganesh Sistu , Valentina Donzella , Ciaran Eising

Road traffic accidents remain a significant global concern, with human error, particularly distracted and impaired driving, among the leading causes. This study introduces a novel driver behaviour classification system that uses external…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Ian Nell , Shane Gilroy

Current deep learning based autonomous driving approaches yield impressive results also leading to in-production deployment in certain controlled scenarios. One of the most popular and fascinating approaches relies on learning vehicle…

Computer Vision and Pattern Recognition · Computer Science 2020-06-08 Luca Cultrera , Lorenzo Seidenari , Federico Becattini , Pietro Pala , Alberto Del Bimbo

The autonomous driving industry is increasingly adopting end-to-end learning from sensory inputs to minimize human biases in system design. Traditional end-to-end driving models, however, suffer from long-tail events due to rare or unseen…

Artificial Intelligence · Computer Science 2024-07-02 Ran Tian , Boyi Li , Xinshuo Weng , Yuxiao Chen , Edward Schmerling , Yue Wang , Boris Ivanovic , Marco Pavone

Predicting the future motion of surrounding road users is a crucial and challenging task for autonomous driving (AD) and various advanced driver-assistance systems (ADAS). Planning a safe future trajectory heavily depends on understanding…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Maximilian Schäfer , Kun Zhao , Markus Bühren , Anton Kummert

In autonomous driving, end-to-end planners learn scene representations from raw sensor data and utilize them to generate a motion plan or control actions. However, exclusive reliance on the current scene for motion planning may result in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Hongbin Lin , Yiming Yang , Yifan Zhang , Chaoda Zheng , Jie Feng , Sheng Wang , Zhennan Wang , Shijia Chen , Boyang Wang , Yu Zhang , Xianming Liu , Shuguang Cui , Zhen Li