中文
相关论文

相关论文: Evaluating the Impact of Flaky Simulators on Testi…

200 篇论文

Ensuring the safety of Autonomous Driving Systems (ADS) requires realistic and reproducible test scenarios, yet extracting such scenarios from multimodal crash reports remains a major challenge. Large Language Models (LLMs) often…

软件工程 · 计算机科学 2025-11-26 Siwei Luo , Yang Zhang , Yao Deng , Linfeng Liang , Xi Zheng

Continuous engineering of autonomous driving functions commonly requires deploying vehicles in road testing to obtain inputs that cause problematic decisions. Although the discovery leads to producing an improved system, it also challenges…

人工智能 · 计算机科学 2021-09-28 Chih-Hong Cheng , Rongjie Yan

The role of regression testing in software testing is crucial as it ensures that any new modifications do not disrupt the existing functionality and behaviour of the software system. The desired outcome is for regression tests to yield…

软件工程 · 计算机科学 2025-06-09 Xin Sun , Daniel Ståhl , Kristian Sandahl

Testing Automated Driving Systems (ADS) in simulation with realistic driving scenarios is important for verifying their performance. However, converting real-world driving videos into simulation scenarios is a significant challenge due to…

计算机视觉与模式识别 · 计算机科学 2025-01-28 Yan Miao , Georgios Fainekos , Bardh Hoxha , Hideki Okamoto , Danil Prokhorov , Sayan Mitra

Vehicle API testing verifies whether the interactions between a vehicle's internal systems and external applications meet expectations, ensuring that users can access and control various vehicle functions and data. However, this task is…

软件工程 · 计算机科学 2025-02-07 Shuai Wang , Yinan Yu , Robert Feldt , Dhasarathy Parthasarathy

The development of Automated Driving Systems (ADS) has the potential to revolutionise the transportation industry, but it also presents significant safety challenges. One of the key challenges is ensuring that the ADS is safe in the event…

软件工程 · 计算机科学 2025-03-26 Milin Patel , Rolf Jung

Autonomous Driving Systems (ADS) use complex decision-making (DM) models with multimodal sensory inputs, making rigorous validation and verification (V&V) essential for safety and reliability. These models pose challenges in diagnosing…

软件工程 · 计算机科学 2025-10-07 Halit Eris , Stefan Wagner

Teaching software testing presents difficulties due to its abstract and conceptual nature. The lack of tangible outcomes and limited emphasis on hands-on experience further compound the challenge, often leading to difficulties in…

软件工程 · 计算机科学 2023-10-11 Chakkrit Tantithamthavorn , Norman Chen

Vehicles equipped with automated driving capabilities have shown potential to improve safety and operations. Advanced driver assistance systems (ADAS) and automated driving systems (ADS) have been widely developed to support vehicular…

应用统计 · 统计学 2024-10-15 Shengxuan Ding , Mohamed Abdel-Aty , Natalia Barbour , Dongdong Wang , Zijin Wang , Ou Zheng

Flaky tests are problematic because they non-deterministically pass or fail for the same software version under test, causing confusion and wasting development effort. While machine learning models have been used to predict flakiness and…

软件工程 · 计算机科学 2024-10-08 Sakina Fatima , Hadi Hemmati , Lionel Briand

In a recent study, Reinforcement Learning (RL) used in combination with many-objective search, has been shown to outperform alternative techniques (random search and many-objective search) for online testing of Deep Neural Network-enabled…

软件工程 · 计算机科学 2024-03-21 Luca Giamattei , Matteo Biagiola , Roberto Pietrantuono , Stefano Russo , Paolo Tonella

Machine Learning applications are acknowledged at the foundation of autonomous driving, because they are the enabling technology for most driving tasks. However, the inclusion of trained agents in automotive systems exposes the vehicle to…

人工智能 · 计算机科学 2022-03-01 Niccolò Piazzesi , Massimo Hong , Andrea Ceccarelli

Simulators play a crucial role in autonomous driving, offering significant time, cost, and labor savings. Over the past few years, the number of simulators for autonomous driving has grown substantially. However, there is a growing concern…

机器人学 · 计算机科学 2024-03-26 Yueyuan Li , Wei Yuan , Songan Zhang , Weihao Yan , Qiyuan Shen , Chunxiang Wang , Ming Yang

Fuzz testing to find semantic control vulnerabilities is an essential activity to evaluate the robustness of autonomous driving (AD) software. Whilst there is a preponderance of disparate fuzzing tools that target different parts of the…

密码学与安全 · 计算机科学 2025-04-16 Andrew Roberts , Lorenz Teply , Mert D. Pese , Olaf Maennel , Mohammad Hamad , Sebastian Steinhorst

While recent developments in autonomous vehicle (AV) technology highlight substantial progress, we lack tools for rigorous and scalable testing. Real-world testing, the $\textit{de facto}$ evaluation environment, places the public in…

机器学习 · 计算机科学 2019-01-15 Matthew O'Kelly , Aman Sinha , Hongseok Namkoong , John Duchi , Russ Tedrake

Tests that cause spurious failures without any code changes, i.e., flaky tests, hamper regression testing, increase maintenance costs, may shadow real bugs, and decrease trust in tests. While the prevalence and importance of flakiness is…

软件工程 · 计算机科学 2022-02-15 Martin Gruber , Stephan Lukasczyk , Florian Kroiß , Gordon Fraser

Search-based software testing (SBT) is an effective and efficient approach for testing automated driving systems (ADS). However, testing pipelines for ADS testing are particularly challenging as they involve integrating complex driving…

软件工程 · 计算机科学 2023-11-03 Lev Sorokin , Tiziano Munaro , Damir Safin , Brian Hsuan-Cheng Liao , Adam Molin

As automation in the field of automated driving (AD) progresses, ensuring the safety and functionality of AD functions (ADFs) becomes crucial. Virtual scenario-based testing has emerged as a prevalent method for evaluating these systems,…

机器人学 · 计算机科学 2024-06-25 Daniel Becker , Sanath Konthala , Lutz Eckstein

Robotics simulation plays an important role in the design, development, and verification and validation of robotic systems. Recent studies have shown that simulation may be used as a cheaper, safer, and more reliable alternative to manual,…

机器人学 · 计算机科学 2020-04-17 Afsoon Afzal , Deborah S. Katz , Claire Le Goues , Christopher S. Timperley

Abstract Simulation platforms facilitate the development of emerging cyber-physical systems (CPS) like self-driving cars (SDC) because they are more efficient and less dangerous than field operational tests. Despite this, thoroughly testing…

软件工程 · 计算机科学 2021-11-09 Sajad Khatiri , Christian Birchler , Bill Bosshard , Alessio Gambi , Sebastiano Panichella