English
Related papers

Related papers: Enhancing End-to-End Autonomous Driving with Laten…

200 papers

End-to-end autonomous driving offers a streamlined alternative to the traditional modular pipeline, integrating perception, prediction, and planning within a single framework. While Deep Reinforcement Learning (DRL) has recently gained…

Artificial Intelligence · Computer Science 2024-09-27 Siyi Lu , Lei He , Shengbo Eben Li , Yugong Luo , Jianqiang Wang , Keqiang Li

Driving in the dynamic, multi-agent, and complex urban environment is a difficult task requiring a complex decision policy. The learning of such a policy requires a state representation that can encode the entire environment. Mid-level…

Robotics · Computer Science 2020-03-03 Eshagh Kargar , Ville Kyrki

Despite the significant advances in Deep Reinforcement Learning (RL) observed in the last decade, the amount of training experience necessary to learn effective policies remains one of the primary concerns in both simulated and real…

Robotics · Computer Science 2026-04-02 Manuel Serra Nunes , Atabak Dehban , Yiannis Demiris , José Santos-Victor

This paper investigates how end-to-end driving models can be improved to drive more accurately and human-like. To tackle the first issue we exploit semantic and visual maps from HERE Technologies and augment the existing Drive360 dataset…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Simon Hecker , Dengxin Dai , Alexander Liniger , Luc Van Gool

Autonomous driving has a natural bi-level structure. The goal of the upper behavioural layer is to provide appropriate lane change, speeding up, and braking decisions to optimize a given driving task. However, this layer can only indirectly…

Robotics · Computer Science 2022-12-06 Arun Kumar Singh , Jatan Shrestha , Nicola Albarella

Autonomous vehicles demand high accuracy and robustness of perception algorithms. To develop efficient and scalable perception algorithms, the maximum information should be extracted from the available sensor data. In this work, we present…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Sebastian Huch , Florian Sauerbeck , Johannes Betz

Advanced sensors are a key to enable self-driving cars technology. Laser scanner sensors (LiDAR, Light Detection And Ranging) became a fundamental choice due to its long-range and robustness to low light driving conditions. The problem of…

Image and Video Processing · Electrical Eng. & Systems 2019-07-19 Khaled Elmadawi , Moemen Abdelrazek , Mohamed Elsobky , Hesham M. Eraqi , Mohamed Zahran

Autonomous driving in urban crowds at unregulated intersections is challenging, where dynamic occlusions and uncertain behaviors of other vehicles should be carefully considered. Traditional methods are heuristic and based on…

Robotics · Computer Science 2021-09-20 Peide Cai , Sukai Wang , Hengli Wang , Ming Liu

Sampling-based motion planning is a well-established approach in autonomous driving, valued for its modularity and analytical tractability. In complex urban scenarios, however, uniform or heuristic sampling often produces many infeasible or…

Robotics · Computer Science 2026-03-24 Korbinian Moller , Roland Stroop , Mattia Piccinini , Alexander Langmann , Johannes Betz

World models predict future transitions from observations and actions. Existing works predominantly focus on image generation only. Visual feature-based world models, on the other hand, predict future visual features instead of raw video…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Xinyu Zhang , Zhengtong Xu , Yutian Tao , Yeping Wang , Yu She , Abdeslam Boularias

An efficient path planner for autonomous car-like vehicles should handle the strong kinematic constraints, particularly in confined spaces commonly encountered while maneuvering in city traffic, and should enable rapid planning, as the city…

Robotics · Computer Science 2020-03-03 Piotr Kicki , Tomasz Gawron , Piotr Skrzypczyński

Efficient reasoning about the semantic, spatial, and temporal structure of a scene is a crucial prerequisite for autonomous driving. We present NEural ATtention fields (NEAT), a novel representation that enables such reasoning for…

Computer Vision and Pattern Recognition · Computer Science 2021-09-10 Kashyap Chitta , Aditya Prakash , Andreas Geiger

When interacting with highly dynamic environments, scene flow allows autonomous systems to reason about the non-rigid motion of multiple independent objects. This is of particular interest in the field of autonomous driving, in which many…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Himangi Mittal , Brian Okorn , David Held

In recent years, vision-based end-to-end autonomous driving has emerged as a new paradigm. However, popular end-to-end approaches typically rely on visual feature extraction networks trained under label supervision. This limited supervision…

Robotics · Computer Science 2025-11-04 Ling Niu , Xiaoji Zheng , Han Wang , Chen Zheng , Ziyuan Yang , Bokui Chen , Jiangtao Gong

Despite impressive advancements in Autonomous Driving Systems (ADS), navigation in complex road conditions remains a challenging problem. There is considerable evidence that evaluating the subjective risk level of various decisions can…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Shih-Yuan Yu , Arnav V. Malawade , Deepan Muthirayan , Pramod P. Khargonekar , Mohammad A. Al Faruque

World models enable robots to conduct counterfactual reasoning in physical environments by predicting future world states. While conventional approaches often prioritize pixel-level reconstruction of future scenes, such detailed rendering…

Robotics · Computer Science 2025-12-22 Zhiwei Zhang , Hui Zhang , Kaihong Huang , Chenghao Shi , Huimin Lu

In recent years, autonomous driving algorithms using low-cost vehicle-mounted cameras have attracted increasing endeavors from both academia and industry. There are multiple fronts to these endeavors, including object detection on roads,…

Computer Vision and Pattern Recognition · Computer Science 2017-08-15 Lu Chi , Yadong Mu

Self driving cars has been the biggest innovation in the automotive industry, but to achieve human level accuracy or near human level accuracy is the biggest challenge that research scientists are facing today. Unlike humans autonomous…

Robotics · Computer Science 2025-05-06 Aashish Kumar Misraa , Naman Jain , Saurav Singh Dhakad

Autonomous driving demands safe motion planning, especially in critical "long-tail" scenarios. Recent end-to-end autonomous driving systems leverage large language models (LLMs) as planners to improve generalizability to rare events.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Deepti Hegde , Rajeev Yasarla , Hong Cai , Shizhong Han , Apratim Bhattacharyya , Shweta Mahajan , Litian Liu , Risheek Garrepalli , Vishal M. Patel , Fatih Porikli

A map, as crucial information for downstream applications of an autonomous driving system, is usually represented in lanelines or centerlines. However, existing literature on map learning primarily focuses on either detecting geometry-based…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Tianyu Li , Peijin Jia , Bangjun Wang , Li Chen , Kun Jiang , Junchi Yan , Hongyang Li