English
Related papers

Related papers: SparseDrive: End-to-End Autonomous Driving via Spa…

200 papers

Sparse Perception Models (SPMs) adopt a query-driven paradigm that forgoes explicit dense BEV or volumetric construction, enabling highly efficient computation and accelerated inference. In this paper, we introduce SQS, a novel query-based…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Haiming Zhang , Yiyao Zhu , Wending Zhou , Xu Yan , Yingjie Cai , Bingbing Liu , Shuguang Cui , Zhen Li

End-to-end autonomous driving models generate future trajectories from multi-view inputs, improving system integration but introducing opaque decisions and hard-to-localize risks. Existing methods either rely on auxiliary monitoring models…

Machine Learning · Computer Science 2026-05-08 Le Yang , Ruoyu Chen , Haijun Liu , Jiawei Liang , ShangQuan Sun , Xiaochun Cao

Diffusion models have become a popular choice for decision-making tasks in robotics, and more recently, are also being considered for solving autonomous driving tasks. However, their applications and evaluations in autonomous driving remain…

Outside of urban hubs, autonomous cars and trucks have to master driving on intercity highways. Safe, long-distance highway travel at speeds exceeding 100 km/h demands perception distances of at least 250 m, which is about five times the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Edoardo Palladin , Samuel Brucker , Filippo Ghilotti , Praveen Narayanan , Mario Bijelic , Felix Heide

In recent years, autonomous driving algorithms using low-cost vehicle-mounted cameras have attracted increasing endeavors from both academia and industry. There are multiple fronts to these endeavors, including object detection on roads,…

Computer Vision and Pattern Recognition · Computer Science 2017-08-15 Lu Chi , Yadong Mu

Modeling interactive driving behaviors in complex scenarios remains a fundamental challenge for autonomous driving planning. Learning-based approaches attempt to address this challenge with advanced generative models, removing the…

End-to-end autonomous driving aims to build a fully differentiable system that takes raw sensor data as inputs and directly outputs the planned trajectory or control signals of the ego vehicle. State-of-the-art methods usually follow the…

Robotics · Computer Science 2023-08-29 Xiaosong Jia , Yulu Gao , Li Chen , Junchi Yan , Patrick Langechuan Liu , Hongyang Li

We introduce ForeSight, a novel joint detection and forecasting framework for vision-based 3D perception in autonomous vehicles. Traditional approaches treat detection and forecasting as separate sequential tasks, limiting their ability to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Sandro Papais , Letian Wang , Brian Cheong , Steven L. Waslander

We present Flex, an efficient and effective scene encoder that addresses the computational bottleneck of processing high-volume multi-camera data in end-to-end autonomous driving. Flex employs a small set of learnable scene tokens to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Jiawei Yang , Ziyu Chen , Yurong You , Yan Wang , Yiming Li , Yuxiao Chen , Boyi Li , Boris Ivanovic , Marco Pavone , Yue Wang

World models have become central to autonomous driving, where accurate scene understanding and future prediction are crucial for safe control. Recent work has explored using vision-language models (VLMs) for planning, yet existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhexiao Xiong , Xin Ye , Burhan Yaman , Sheng Cheng , Yiren Lu , Jingru Luo , Nathan Jacobs , Liu Ren

Recent works in end-to-end control for autonomous driving have investigated the use of vision-based exteroceptive perception. Inspired by such results, we propose a new end-to-end memory-based neural architecture for robot steering and…

Robotics · Computer Science 2022-05-25 Sergio Paniego Blanco , Sakshay Mahna , Utkarsh A. Mishra , JoseMaria Canas

Autonomous driving systems require a comprehensive understanding of the environment, achieved by extracting visual features essential for perception, planning, and control. However, models trained solely on single-task objectives or generic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Huy-Dung Nguyen , Anass Bairouk , Mirjana Maras , Wei Xiao , Tsun-Hsuan Wang , Patrick Chareyre , Ramin Hasani , Marc Blanchon , Daniela Rus

Balancing safety, efficiency, and interaction is fundamental to designing autonomous driving agents and to understanding autonomous vehicle (AV) behavior in real-world operation. This study introduces an empirical learning framework that…

Robotics · Computer Science 2026-01-28 Mohammad Elayan , Wissam Kontar

Learning a human-like driving policy from large-scale driving demonstrations is promising, but the uncertainty and non-deterministic nature of planning make it challenging. Existing learning-based planning methods follow a deterministic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Bo Jiang , Shaoyu Chen , Hao Gao , Bencheng Liao , Qian Zhang , Wenyu Liu , Xinggang Wang

This paper introduces a novel architecture for trajectory-conditioned forecasting of future 3D scene occupancy. In contrast to methods that rely on variational autoencoders (VAEs) to generate discrete occupancy tokens, which inherently…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Jiayuan Du , Yiming Zhao , Zhenglong Guo , Yong Pan , Wenbo Hou , Zhihui Hao , Kun Zhan , Qijun Chen

Prototyping and validating hardware-software components, sub-systems and systems within the intelligent transportation system-of-systems framework requires a modular yet flexible and open-access ecosystem. This work presents our attempt…

Robotics · Computer Science 2023-05-30 Tanmay Vilas Samak , Chinmay Vilas Samak , Sivanathan Kandhasamy , Venkat Krovi , Ming Xie

In this work, we introduce DeepIPC, a novel end-to-end model tailored for autonomous driving, which seamlessly integrates perception and control tasks. Unlike traditional models that handle these tasks separately, DeepIPC innovatively…

Robotics · Computer Science 2024-04-05 Oskar Natan , Jun Miura

The reliability of current autonomous driving systems is often jeopardized in situations when the vehicle's field-of-view is limited by nearby occluding objects. To mitigate this problem, vehicle-to-vehicle communication to share sensor…

Robotics · Computer Science 2023-05-30 Hsu-kuang Chiu , Stephen F. Smith

This paper introduces the SEAD framework that simplifies the process of designing and describing autonomous vehicle platooning manoeuvres. Although a large body of research has been formulating platooning manoeuvres, it is still challenging…

Multiagent Systems · Computer Science 2021-04-13 Corvin Deboeser , Jordan Ivanchev , Thomas Braud , Alois Knoll , David Eckhoff , Alberto Sangiovanni-Vincentelli

Human drivers adeptly navigate complex scenarios by utilizing rich attentional semantics, but the current autonomous systems struggle to replicate this ability, as they often lose critical semantic information when converting 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Pei Liu , Haipeng Liu , Haichao Liu , Xin Liu , Jinxin Ni , Jun Ma