English
Related papers

Related papers: Evaluating the Impact of Flaky Simulators on Testi…

200 papers

Advanced Driver Assistance Systems (ADAS) and Automated Driving Systems (ADS) are expected to improve comfort, productivity and, most importantly, safety for all road users. To ensure that the systems are safe, rules and regulations…

Systems and Control · Electrical Eng. & Systems 2025-02-18 Pierluigi Olleja , Gustav Markkula , Jonas Bärgman

High-level Autonomous Driving Systems (ADSs), such as Google Waymo and Baidu Apollo, typically rely on multi-sensor fusion (MSF) based approaches to perceive their surroundings. This strategy increases perception robustness by combining the…

The kind of closed-loop verification likely to be required for autonomous vehicle (AV) safety testing is beyond the reach of traditional test methodologies and discrete verification. Validation puts the autonomous vehicle system to the test…

Machine Learning · Computer Science 2020-05-29 Hyun Jae Cho , Madhur Behl

Simulation platforms facilitate the development of emerging Cyber-Physical Systems (CPS) like self-driving cars (SDC) because they are more efficient and less dangerous than field operational test cases. Despite this, thoroughly testing…

Software Engineering · Computer Science 2022-12-12 Christian Birchler , Sajad Khatiri , Bill Bosshard , Alessio Gambi , Sebastiano Panichella

Advanced Driver-Assistance Systems (ADAS) have been thriving and widely deployed in recent years. In general, these systems receive sensor data, compute driving decisions, and output control signals to the vehicles. To smooth out the…

Robotics · Computer Science 2022-05-26 Ziyuan Zhong , Zhisheng Hu , Shengjian Guo , Xinyang Zhang , Zhenyu Zhong , Baishakhi Ray

As a variety of automated collision prevention systems gain presence within personal vehicles, rating and differentiating the automated safety performance of car models has become increasingly important for consumers, manufacturers, and…

Robotics · Computer Science 2024-11-28 Luigi Di Lillo , Andrea Triscari , Xilin Zhou , Robert Dyro , Ruolin Li , Marco Pavone

Autonomous driving systems (ADSs) rely on real-time sensor data, such as cameras and LiDARs, for time-critical decisions using deep neural networks. The accuracy of these decisions is crucial for the widespread adoption of ADSs, as errors…

Software Engineering · Computer Science 2025-10-15 Tri Minh Triet Pham , Bo Yang , Jinqiu Yang

Test flakiness is a common problem in industry, which hinders the reliability of automated build and testing workflows. Most existing research on test flakiness has primarily focused on unit and small-scale integration tests. In contrast,…

Software Engineering · Computer Science 2026-03-31 Man Zhang , Chongyang Shen , Andrea Arcuri , Tao Yue

Advanced Driver Assistance Systems (ADAS) based on deep neural networks (DNNs) are widely used in autonomous vehicles for critical perception tasks such as object detection, semantic segmentation, and lane recognition. However, these…

Software Engineering · Computer Science 2025-01-22 Stefano Carlo Lambertenghi , Hannes Leonhard , Andrea Stocco

Automated Driving Systems (ADSs) are being manufactured at an accelerated rate, leading to improvements in traffic safety, reduced energy consumption, pollution, and congestion. ADS relies on various data streams from onboard sensors,…

Networking and Internet Architecture · Computer Science 2023-11-27 André Budel , Reem Alhabib , Mark Nicholson , Poonam Yadav

Self-driving cars require extensive testing, which can be costly in terms of time. To optimize this process, simple and straightforward tests should be excluded, focusing on challenging tests instead. This study addresses the test selection…

Robotics · Computer Science 2025-01-08 Ali Güllü , Faiz Ali Shah , Dietmar Pfahl

Software metrics such as coverage and mutation scores have been extensively explored for the automated quality assessment of test suites. While traditional tools rely on such quantifiable software metrics, the field of self-driving cars…

Software Engineering · Computer Science 2024-01-29 Christian Birchler , Tanzil Kombarabettu Mohammed , Pooja Rani , Teodora Nechita , Timo Kehrer , Sebastiano Panichella

Closed-loop simulation environments play a crucial role in the validation and enhancement of autonomous driving systems (ADS). However, certain challenges warrant significant attention, including balancing simulation accuracy with duration,…

Robotics · Computer Science 2025-02-14 Daocheng Fu , Naiting Zhong , Xu Han , Pinlong Cai , Licheng Wen , Song Mao , Botian Shi , Yu Qiao

We report our experience of using failure symptoms, such as error messages or stack traces, to identify flaky test failures in a Continuous Integration (CI) pipeline for a large industrial software system, SAP HANA. Although failure…

Software Engineering · Computer Science 2023-11-07 Gabin An , Juyeon Yoon , Thomas Bach , Jingun Hong , Shin Yoo

Software testing ensures that a system functions correctly, meets specified requirements, and maintains high quality. As artificial intelligence and machine learning (ML) technologies become integral to software systems, testing has evolved…

Software Engineering · Computer Science 2025-07-29 Ronnie de Souza Santos , Matheus de Morais Leca , Reydne Santos , Cleyton Magalhaes

Autonomous systems are becoming increasingly prevalent in new vehicles. Due to their environmental friendliness and their remarkable capability to significantly enhance road safety, these vehicles have gained widespread recognition and…

Robotics · Computer Science 2025-07-04 Reem Alhabib , Poonam Yadav

Success in racing requires a unique combination of vehicle setup, understanding of the racetrack, and human expertise. Since building and testing many different vehicle configurations in the real world is prohibitively expensive,…

Robotics · Computer Science 2024-12-06 John Subosits , Jenna Lee , Shawn Manuel , Paul Tylkin , Avinash Balachandran

One of the major impediments in deployment of Autonomous Driving Systems (ADS) is their safety and reliability. The primary reason for the complexity of testing ADS is that it operates in an open world characterized by its…

With fully automated driving systems (ADS; SAE level 4) ride-hailing services expanding in the US, we are now approaching an inflection point, where the process of retrospectively evaluating ADS safety impact can start to yield…

The public, regulators, and domain experts alike seek to understand the effect of deployed SAE level 4 automated driving system (ADS) technologies on safety. The recent expansion of ADS technology deployments is paving the way for early…