English
Related papers

Related papers: S2R-Bench: A Sim-to-Real Evaluation Benchmark for …

200 papers

Autonomous systems operating in unknown environments often rely heavily on visual sensor data, yet making safe and informed control decisions based on these measurements remains a significant challenge. To facilitate the integration of…

Systems and Control · Electrical Eng. & Systems 2025-08-05 Jelena Trisovic , Andrea Carron , Melanie N. Zeilinger

Autonomous driving decision-making is one of the critical modules towards intelligent transportation systems, and how to evaluate the driving performance comprehensively and precisely is a crucial challenge. A biased evaluation misleads and…

Robotics · Computer Science 2024-09-24 Yuning Wang , Zehong Ke , Yanbo Jiang , Jinhao Li , Shaobing Xu , John M. Dolan , Jianqiang Wang

With the rapid advancement of autonomous driving technology, vehicle-to-everything (V2X) communication has emerged as a key enabler for extending perception range and enhancing driving safety by providing visibility beyond the line of…

This paper investigates runtime monitoring of perception systems. Perception is a critical component of high-integrity applications of robotics and autonomous systems, such as self-driving cars. In these applications, failure of perception…

Robotics · Computer Science 2022-05-24 Pasquale Antonante , Heath Nilsen , Luca Carlone

Collaborative perception has attracted growing interest from academia and industry due to its potential to enhance perception accuracy, safety, and robustness in autonomous driving through multi-agent information fusion. With the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Naibang Wang , Deyong Shang , Yan Gong , Xiaoxi Hu , Ziying Song , Lei Yang , Yuhan Huang , Xiaoyu Wang , Jianli Lu

Safety assurance of automated driving systems must consider uncertain environment perception. This paper reviews literature addressing how perception testing is realized as part of safety assurance. We focus on testing for verification and…

Robotics · Computer Science 2022-02-28 Michael Hoss , Maike Scholtes , Lutz Eckstein

Modern perception systems of autonomous vehicles are known to be sensitive to occlusions and lack the capability of long perceiving range. It has been one of the key bottlenecks that prevents Level 5 autonomy. Recent research has…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Runsheng Xu , Xin Xia , Jinlong Li , Hanzhao Li , Shuo Zhang , Zhengzhong Tu , Zonglin Meng , Hao Xiang , Xiaoyu Dong , Rui Song , Hongkai Yu , Bolei Zhou , Jiaqi Ma

We present a new approach to automated scenario-based testing of the safety of autonomous vehicles, especially those using advanced artificial intelligence-based components, spanning both simulation-based evaluation as well as testing in…

Systems and Control · Electrical Eng. & Systems 2020-07-14 Daniel J. Fremont , Edward Kim , Yash Vardhan Pant , Sanjit A. Seshia , Atul Acharya , Xantha Bruso , Paul Wells , Steve Lemke , Qiang Lu , Shalin Mehta

Existing evaluation paradigms for Autonomous Vehicles (AVs) face critical limitations. Real-world evaluation is often challenging due to safety concerns and a lack of reproducibility, whereas closed-loop simulation can face insufficient…

In the realm of autonomous driving, robust perception under out-of-distribution conditions is paramount for the safe deployment of vehicles. Challenges such as adverse weather, sensor malfunctions, and environmental unpredictability can…

Current autonomous driving systems are composed of a perception system and a decision system. Both of them are divided into multiple subsystems built up with lots of human heuristics. An end-to-end approach might clean up the system and…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Jianyu Chen , Zhuo Xu , Masayoshi Tomizuka

Simulation-based testing of automated driving systems (ADS) is the industry standard, being a controlled, safe, and cost-effective alternative to real-world testing. Despite these advantages, virtual simulations often fail to accurately…

Software Engineering · Computer Science 2024-04-30 Stefano Carlo Lambertenghi , Andrea Stocco

Vehicle-to-everything (V2X) autonomous driving opens up a promising direction for developing a new generation of intelligent transportation systems. Collaborative perception (CP) as an essential component to achieve V2X can overcome the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Si Liu , Chen Gao , Yuan Chen , Xingyu Peng , Xianghao Kong , Kun Wang , Runsheng Xu , Wentao Jiang , Hao Xiang , Jiaqi Ma , Miao Wang

Autonomous driving technologies have achieved significant advances in recent years, yet their real-world deployment remains constrained by data scarcity, safety requirements, and the need for generalization across diverse environments. In…

Artificial Intelligence · Computer Science 2026-04-06 A. Humnabadkar , A. Sikdar , B. Cave , H. Zhang , N. Bessis , A. Behera

The outstanding performance of Large Multimodal Models (LMMs) has made them widely applied in vision-related tasks. However, various corruptions in the real world mean that images will not be as ideal as in simulations, presenting…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Chunyi Li , Jianbo Zhang , Zicheng Zhang , Haoning Wu , Yuan Tian , Wei Sun , Guo Lu , Xiaohong Liu , Xiongkuo Min , Weisi Lin , Guangtao Zhai

This paper addresses the problem of data-driven modeling and verification of perception-based autonomous systems. We assume the perception model can be decomposed into a canonical model (obtained from first principles or a simulator) and a…

Systems and Control · Electrical Eng. & Systems 2023-12-13 Thomas Waite , Alexander Robey , Hassani Hamed , George J. Pappas , Radoslav Ivanov

As a research community, we are still lacking a systematic understanding of the progress on adversarial robustness which often makes it hard to identify the most promising ideas in training robust models. A key challenge in benchmarking…

Autonomous Systems (AS) are increasingly proposed, or used, in Safety Critical (SC) applications. Many such systems make use of sophisticated sensor suites and processing to provide scene understanding which informs the AS' decision-making.…

Systems and Control · Electrical Eng. & Systems 2022-08-19 John Molloy , John McDermid

Software metrics such as coverage and mutation scores have been extensively explored for the automated quality assessment of test suites. While traditional tools rely on such quantifiable software metrics, the field of self-driving cars…

Software Engineering · Computer Science 2024-01-29 Christian Birchler , Tanzil Kombarabettu Mohammed , Pooja Rani , Teodora Nechita , Timo Kehrer , Sebastiano Panichella

To ensure safe operation of autonomous vehicles in complex urban environments, complete perception of the environment is necessary. However, due to environmental conditions, sensor limitations, and occlusions, this is not always possible…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Sven Teufel , Jörg Gamerdinger , Jan-Patrick Kirchner , Georg Volk , Oliver Bringmann