English
Related papers

Related papers: Panoptic Perception for Autonomous Driving: A Surv…

200 papers

Autonomously driving vehicles require a complete and robust perception of the local environment. A main challenge is to perceive any other road users, where multi-object tracking or occupancy grid maps are commonly used. The presented…

Robotics · Computer Science 2020-03-26 Fabian Gies , Andreas Danzer , Klaus Dietmayer

End-to-end autonomous driving has achieved remarkable advancements in recent years. Existing methods primarily follow a perception-planning paradigm, where perception and planning are executed sequentially within a fully differentiable…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Bozhou Zhang , Jingyu Li , Nan Song , Li Zhang

Navigational perception for visually impaired people has been substantially promoted by both classic and deep learning based segmentation methods. In classic visual recognition methods, the segmentation models are mostly object-dependent,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Wei Mao , Jiaming Zhang , Kailun Yang , Rainer Stiefelhagen

Vehicle control is one of the most critical challenges in autonomous vehicles (AVs) and connected and automated vehicles (CAVs), and it is paramount in vehicle safety, passenger comfort, transportation efficiency, and energy saving. This…

Today, there are two major paradigms for vision-based autonomous driving systems: mediated perception approaches that parse an entire scene to make a driving decision, and behavior reflex approaches that directly map an input image to a…

Computer Vision and Pattern Recognition · Computer Science 2015-09-29 Chenyi Chen , Ari Seff , Alain Kornhauser , Jianxiong Xiao

Autonomous systems possess the features of inferring their own state, understanding their surroundings, and performing autonomous navigation. With the applications of learning systems, like deep learning and reinforcement learning, the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Yang Tang , Chaoqiang Zhao , Jianrui Wang , Chongzhen Zhang , Qiyu Sun , Weixing Zheng , Wenli Du , Feng Qian , Juergen Kurths

This paper proposes a specialized autonomous driving system that takes into account the unique constraints and characteristics of automotive systems, aiming for innovative advancements in autonomous driving technology. The proposed system…

Robotics · Computer Science 2023-12-18 Eunbin Seo , Gwanjun Shin , Eunho Lee

Besides performance, efficiency is a key design driver of technologies supporting vehicular perception. Indeed, a well-balanced trade-off between performance and energy consumption is crucial for the sustainability of autonomous vehicles.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Aitor Martinez Seras , Javier Del Ser , Pablo Garcia-Bringas

In this paper, we develop rotation-equivariant neural networks for 4D panoptic segmentation. 4D panoptic segmentation is a benchmark task for autonomous driving that requires recognizing semantic classes and object instances on the road…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Minghan Zhu , Shizhong Han , Hong Cai , Shubhankar Borse , Maani Ghaffari , Fatih Porikli

Autonomous robot systems have attracted increasing research attention in recent years, where environment understanding is a crucial step for robot navigation, human-robot interaction, and decision. Real-world robot systems usually collect…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Duy-Tho Le , Chenhui Gou , Stavya Datta , Hengcan Shi , Ian Reid , Jianfei Cai , Hamid Rezatofighi

Learning-based perception and prediction modules in modern autonomous driving systems typically rely on expensive human annotation and are designed to perceive only a handful of predefined object categories. This closed-set paradigm is…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Mahyar Najibi , Jingwei Ji , Yin Zhou , Charles R. Qi , Xinchen Yan , Scott Ettinger , Dragomir Anguelov

Autonomous vehicle navigation is a key challenge in artificial intelligence, requiring robust and accurate decision-making processes. This research introduces a new end-to-end method that exploits multimodal information from a single…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Fouad Makiyeh , Mark Bastourous , Anass Bairouk , Wei Xiao , Mirjana Maras , Tsun-Hsuan Wangb , Marc Blanchon , Ramin Hasani , Patrick Chareyre , Daniela Rus

Concurrent perception datasets for autonomous driving are mainly limited to frontal view with sensors mounted on the vehicle. None of them is designed for the overlooked roadside perception tasks. On the other hand, the data captured from…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Xiaoqing Ye , Mao Shu , Hanyu Li , Yifeng Shi , Yingying Li , Guangjie Wang , Xiao Tan , Errui Ding

Autonomous driving systems have made significant advances in Q&A, perception, prediction, and planning based on local visual information, yet they struggle to incorporate broader navigational context that human drivers routinely utilize. We…

Robotics · Computer Science 2025-11-04 Qucheng Peng , Chen Bai , Guoxiang Zhang , Bo Xu , Xiaotong Liu , Xiaoyin Zheng , Chen Chen , Cheng Lu

Motivated by vision-based control of autonomous vehicles, we consider the problem of controlling a known linear dynamical system for which partial state information, such as vehicle position, is extracted from complex and nonlinear data,…

Optimization and Control · Mathematics 2019-12-24 Sarah Dean , Nikolai Matni , Benjamin Recht , Vickie Ye

The thesis presents contributions made to the evaluation and design of a haptic guidance system on improving driving performance in cases of normal and degraded visual information, which are based on behavior experiments, modeling and…

Robotics · Computer Science 2021-04-26 Zheng Wang

The autonomous car technology promises to replace human drivers with safer driving systems. But although autonomous cars can become safer than human drivers this is a long process that is going to be refined over time. Before these vehicles…

Artificial Intelligence · Computer Science 2018-05-09 Thomio Watanabe , Denis Wolf

We present a novel method for testing the safety of self-driving vehicles in simulation. We propose an alternative to sensor simulation, as sensor simulation is expensive and has large domain gaps. Instead, we directly simulate the outputs…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Kelvin Wong , Qiang Zhang , Ming Liang , Bin Yang , Renjie Liao , Abbas Sadat , Raquel Urtasun

End-to-end autonomous driving methods aim to directly map raw sensor inputs to future driving actions such as planned trajectories, bypassing traditional modular pipelines. While these approaches have shown promise, they often operate under…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Bozhou Zhang , Nan Song , Jingyu Li , Xiatian Zhu , Jiankang Deng , Li Zhang

Sensor configuration, including the sensor selections and their installation locations, serves a crucial role in autonomous driving. A well-designed sensor configuration significantly improves the performance upper bound of the perception…

Robotics · Computer Science 2021-04-15 Tao Ma , Zhizheng Liu , Yikang Li