English
Related papers

Related papers: SAVME: Efficient Safety Validation for Autonomous …

200 papers

Autonomous vehicles rely on machine learning to solve challenging tasks in perception and motion planning. However, automotive software safety standards have not fully evolved to address the challenges of machine learning safety such as…

Machine Learning · Computer Science 2019-12-23 Sina Mohseni , Mandar Pitale , Vasu Singh , Zhangyang Wang

While recent developments in autonomous vehicle (AV) technology highlight substantial progress, we lack tools for rigorous and scalable testing. Real-world testing, the $\textit{de facto}$ evaluation environment, places the public in…

Machine Learning · Computer Science 2019-01-15 Matthew O'Kelly , Aman Sinha , Hongseok Namkoong , John Duchi , Russ Tedrake

Automated Driving Systems (ADSs) have seen rapid progress in recent years. To ensure the safety and reliability of these systems, extensive testings are being conducted before their future mass deployment. Testing the system on the road is…

Software Engineering · Computer Science 2021-12-03 Ziyuan Zhong , Yun Tang , Yuan Zhou , Vania de Oliveira Neves , Yang Liu , Baishakhi Ray

Testing controllers in safety-critical systems is vital for ensuring their safety and preventing failures. In this paper, we address the falsification problem within learning-based closed-loop control systems through simulation. This…

Systems and Control · Electrical Eng. & Systems 2024-09-13 Zahra Shahrooei , Mykel J. Kochenderfer , Ali Baheri

While machine learning systems show high success rate in many complex tasks, research shows they can also fail in very unexpected situations. Rise of machine learning products in safety-critical industries cause an increase in attention in…

Machine Learning · Computer Science 2019-05-21 Sina Mohseni , Akshay Jagadeesh , Zhangyang Wang

The planning problem constitutes a fundamental aspect of the autonomous driving framework. Recent strides in representation learning have empowered vehicles to comprehend their surrounding environments, thereby facilitating the integration…

Estimating the distribution over failures is a key step in validating autonomous systems. Existing approaches focus on finding failures for a small range of initial conditions or make restrictive assumptions about the properties of the…

Robotics · Computer Science 2023-05-18 Harrison Delecki , Anthony Corso , Mykel J. Kochenderfer

The widescale deployment of Autonomous Vehicles (AV) seems to be imminent despite many safety challenges that are yet to be resolved. It is well known that there are no universally agreed Verification and Validation (VV) methodologies to…

Robotics · Computer Science 2020-03-05 Dhanoop Karunakaran , Stewart Worrall , Eduardo Nebot

The automated real-time recognition of unexpected situations plays a crucial role in the safety of autonomous vehicles, especially in unsupported and unpredictable scenarios. This paper evaluates different Bayesian uncertainty…

Machine Learning · Computer Science 2025-02-14 Ruben Grewal , Paolo Tonella , Andrea Stocco

An open problem for autonomous driving is how to validate the safety of an autonomous vehicle in simulation. Automated testing procedures can find failures of an autonomous system but these failures may be difficult to interpret due to…

Robotics · Computer Science 2020-06-29 Anthony Corso , Mykel J. Kochenderfer

To improve the security and robustness of autonomous driving models, this paper presents SMET, a scenariobased metamorphic testing tool for autonomous driving models. The metamorphic relationship is divided into three dimensions (time,…

Robotics · Computer Science 2021-04-09 Haiyang Ao , Ya Pan

Machine Learning (ML) models are increasingly integrated into safety-critical systems, such as autonomous vehicle platooning, to enable real-time decision-making. However, their inherent imperfection introduces a new class of failure:…

Artificial Intelligence · Computer Science 2025-06-10 Razieh Arshadizadeh , Mahmoud Asgari , Zeinab Khosravi , Yiannis Papadopoulos , Koorosh Aslansefat

As autonomous driving technology matures, safety and robustness of its key components, including trajectory prediction, is vital. Though real-world datasets, such as Waymo Open Motion, provide realistic recorded scenarios for model…

Robotics · Computer Science 2024-02-06 Benjamin Stoler , Ingrid Navarro , Meghdeep Jana , Soonmin Hwang , Jonathan Francis , Jean Oh

Autonomous vehicles must be comprehensively evaluated before deployed in cities and highways. However, most existing evaluation approaches for autonomous vehicles are static and lack adaptability, so they are usually inefficient in…

Robotics · Computer Science 2020-11-25 Baiming Chen , Xiang Chen , Wu Qiong , Liang Li

Scenario-based testing with driving simulators is extensively used to identify failing conditions of automated driving assistance systems (ADAS). However, existing studies have shown that repeated test execution in the same as well as in…

Software Engineering · Computer Science 2025-11-11 Lev Sorokin , Matteo Biagiola , Andrea Stocco

We present a new approach to automated scenario-based testing of the safety of autonomous vehicles, especially those using advanced artificial intelligence-based components, spanning both simulation-based evaluation as well as testing in…

Systems and Control · Electrical Eng. & Systems 2020-07-14 Daniel J. Fremont , Edward Kim , Yash Vardhan Pant , Sanjit A. Seshia , Atul Acharya , Xantha Bruso , Paul Wells , Steve Lemke , Qiang Lu , Shalin Mehta

Autonomous driving promises to transform road transport. Multi-vehicle and multi-lane scenarios, however, present unique challenges due to constrained navigation and unpredictable vehicle interactions. Learning-based methods---such as deep…

Robotics · Computer Science 2020-02-12 Rupert Mitchell , Jenny Fletcher , Jacopo Panerati , Amanda Prorok

The success of automated driving deployment is highly depending on the ability to develop an efficient and safe driving policy. The problem is well formulated under the framework of optimal control as a cost optimization problem. Model…

Artificial Intelligence · Computer Science 2017-06-14 Ahmad El Sallab , Mahmoud Saeed , Omar Abdel Tawab , Mohammed Abdou

We study a novel problem that tackles learning based sensor scanning in 3D and uncertain environments with heterogeneous multi-robot systems. Our motivation is two-fold: first, 3D environments are complex, the use of heterogeneous…

Robotics · Computer Science 2021-09-29 Junfeng Chen , Yuan Gao , Junjie Hu , Fuqin Deng , Tin Lun Lam

In the context of Industry 4.0, effective monitoring of multiple targets and states during assembly processes is crucial, particularly when constrained to using only visual sensors. Traditional methods often rely on either multiple sensor…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Xingjian Zhang , Yutong Duan , Zaishu Chen