English
Related papers

Related papers: Are We Ready for Vision-Centric Driving Streaming …

200 papers

We propose a novel and pragmatic framework for traffic scene perception with roadside cameras. The proposed framework covers a full-stack of roadside perception pipeline for infrastructure-assisted autonomous driving, including object…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Zhengxia Zou , Rusheng Zhang , Shengyin Shen , Gaurav Pandey , Punarjay Chakravarty , Armin Parchami , Henry X. Liu

Outside of urban hubs, autonomous cars and trucks have to master driving on intercity highways. Safe, long-distance highway travel at speeds exceeding 100 km/h demands perception distances of at least 250 m, which is about five times the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Edoardo Palladin , Samuel Brucker , Filippo Ghilotti , Praveen Narayanan , Mario Bijelic , Felix Heide

Obstacle detection is crucial to the operation of autonomous driving systems, which rely on multiple sensors, such as cameras and LiDARs, combined with code logic and deep learning models to detect obstacles for time-sensitive decisions.…

Software Engineering · Computer Science 2025-10-16 Tri Minh-Triet Pham , Diego Elias Costa , Weiyi Shang , Jinqiu Yang

In recent years, autonomous driving has garnered escalating attention for its potential to relieve drivers' burdens and improve driving safety. Vision-based 3D occupancy prediction, which predicts the spatial occupancy status and semantics…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Yanan Zhang , Jinqing Zhang , Zengran Wang , Junhao Xu , Di Huang

Detecting a diverse range of objects under various driving scenarios is essential for the effectiveness of autonomous driving systems. However, the real-world data collected often lacks the necessary diversity presenting a long-tail…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Aqeel Anwar , Tae Eun Choe , Zian Wang , Sanja Fidler , Minwoo Park

High-Definition (HD) maps are essential for the safety of autonomous driving systems. While existing techniques employ camera images and onboard sensors to generate vectorized high-precision maps, they are constrained by their reliance on…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Tianyuan Yuan , Yicheng Liu , Yue Wang , Yilun Wang , Hang Zhao

Incorporating the audio stream enables Video Saliency Prediction (VSP) to imitate the selective attention mechanism of human brain. By focusing on the benefits of joint auditory and visual information, most VSP methods are capable of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Junwen Xiong , Ganglai Wang , Peng Zhang , Wei Huang , Yufei Zha , Guangtao Zhai

3D occupancy perception technology aims to observe and understand dense 3D environments for autonomous vehicles. Owing to its comprehensive perception capability, this technology is emerging as a trend in autonomous driving perception…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Huaiyuan Xu , Junliang Chen , Shiyu Meng , Yi Wang , Lap-Pui Chau

Inefficient driving behaviors, such as overly conservative yielding, remain a key obstacle to deployment of autonomous vehicles (AVs). Instantaneous driving efficiency metrics are crucial for self-driving decision-making because they affect…

Robotics · Computer Science 2026-04-28 Xiaohua Zhao , Zhaowei Huang , Chen Chen , Haiyi Yang

We introduce ForeSight, a novel joint detection and forecasting framework for vision-based 3D perception in autonomous vehicles. Traditional approaches treat detection and forecasting as separate sequential tasks, limiting their ability to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Sandro Papais , Letian Wang , Brian Cheong , Steven L. Waslander

Perception systems, especially cameras, are the eyes of automated driving systems. Ensuring that they function reliably and robustly is therefore an important building block in the automation of vehicles. There are various approaches to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Philipp Rigoll , Laurenz Adolph , Lennart Ries , Eric Sax

Autonomous driving perceives surroundings with line-of-sight sensors that are compromised under environmental uncertainties. To achieve real time global information in high definition map, we investigate to share perception information…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-12 Qiang Liu , Tao Han , Jiang , Xie , BaekGyu Kim

As the development of autonomous driving (AD) and advanced driver assistance systems (ADAS) progresses, the relevance of the comfort of users is gaining increasing interest. It becomes significant to test and validate perceived comfort…

Human-Computer Interaction · Computer Science 2022-08-24 Felix Bognar , Markus Oster , Herman Van der Auweraer , Tong Duy Son

Scene understanding is essential for enhancing driver safety, generating human-centric explanations for Automated Vehicle (AV) decisions, and leveraging Artificial Intelligence (AI) for retrospective driving video analysis. This study…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Mohammed Elhenawy , Huthaifa I. Ashqar , Andry Rakotonirainy , Taqwa I. Alhadidi , Ahmed Jaber , Mohammad Abu Tami

By sharing information across multiple agents, collaborative perception helps autonomous vehicles mitigate occlusions and improve overall perception accuracy. While most previous work focus on vehicle-to-vehicle and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Yunhao Hou , Bochao Zou , Min Zhang , Ran Chen , Shangdong Yang , Yanmei Zhang , Junbao Zhuo , Siheng Chen , Jiansheng Chen , Huimin Ma

Perception is crucial for autonomous driving, but single-agent perception is often constrained by sensors' physical limitations, leading to degraded performance under severe occlusion, adverse weather conditions, and when detecting distant…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Xiangbo Gao , Runsheng Xu , Jiachen Li , Ziran Wang , Zhiwen Fan , Zhengzhong Tu

Perception systems of autonomous vehicles are susceptible to occlusion, especially when examined from a vehicle-centric perspective. Such occlusion can lead to overlooked object detections, e.g., larger vehicles such as trucks or buses may…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Xiaofei Zhang , Yining Li , Jinping Wang , Xiangyi Qin , Ying Shen , Zhengping Fan , Xiaojun Tan

This paper investigates runtime monitoring of perception systems. Perception is a critical component of high-integrity applications of robotics and autonomous systems, such as self-driving cars. In these applications, failure of perception…

Robotics · Computer Science 2022-05-24 Pasquale Antonante , Heath Nilsen , Luca Carlone

Collaborative perception enhances sensing in multirobot and vehicular networks by fusing information from multiple agents, improving perception accuracy and sensing range. However, mobility and non-rigid sensor mounts introduce extrinsic…

Networking and Internet Architecture · Computer Science 2025-05-01 Zhengru Fang , Jingjing Wang , Yanan Ma , Yihang Tao , Yiqin Deng , Xianhao Chen , Yuguang Fang

The research community has increasing interest in autonomous driving research, despite the resource intensity of obtaining representative real world data. Existing self-driving datasets are limited in the scale and variation of the…