English
Related papers

Related papers: Evaluation as Evolution: Transforming Adversarial …

200 papers

Establishing trustworthy safety assurance for autonomous driving systems (ADSs) requires evidence that failures arise from avoidable system deficiencies rather than unavoidable traffic conflicts. Current adversarial simulation methods can…

Robotics · Computer Science 2026-05-14 Yizhuo Xiao , Haotian Yan , Ying Wang , Zhongpan Zhu , Yuxin Zhang , Xintao Yan , Mustafa Suphi Erden , Cheng Wang

With the wide application of deep neural network models in various computer vision tasks, there has been a proliferation of adversarial example generation strategies aimed at deeply exploring model security. However, existing adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Wenxuan Wang , Chenglei Wang , Huihui Qi , Menghao Ye , Xuelin Qian , Peng Wang , Yanning Zhang

Scientific testing techniques are essential for ensuring the safe operation of autonomous vehicles (AVs), with high-risk, highly interactive scenarios being a primary focus. To address the limitations of existing testing methods, such as…

Robotics · Computer Science 2025-07-30 Yicheng Guo , Chengkai Xu , Jiaqi Liu , Hao Zhang , Peng Hang , Jian Sun

Verification and validation of autonomous driving (AD) systems and components is of increasing importance, as such technology increases in real-world prevalence. Safety-critical scenario generation is a key approach to robustify AD policies…

Robotics · Computer Science 2025-07-15 Benjamin Stoler , Ingrid Navarro , Jonathan Francis , Jean Oh

While recent autonomous agents demonstrate impressive capabilities, they predominantly rely on manually scripted workflows and handcrafted heuristics, inherently limiting their potential for open-ended improvement. To address this, we…

Artificial Intelligence · Computer Science 2026-05-28 Ziyang Liu , Xinyan Guo , Xuchen Wei , Han Hao , Liu Yang

Offline reinforcement learning enables sample-efficient policy acquisition without risky online interaction, yet policies trained on static datasets remain brittle under action-space perturbations such as actuator faults. This study…

Robotics · Computer Science 2026-03-02 Shingo Ayabe , Hiroshi Kera , Kazuhiko Kawamoto

High-level autonomous driving requires motion planners capable of modeling multimodal future uncertainties while remaining robust in closed-loop interactions. Although diffusion-based planners are effective at modeling complex trajectory…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Hao Gao , Shaoyu Chen , Yifan Zhu , Yuehao Song , Wenyu Liu , Qian Zhang , Xinggang Wang

Large language models (LLMs) have shown remarkable performance on various tasks, but existing evaluation benchmarks are often static and insufficient to fully assess their robustness and generalization in realistic scenarios. Prior work…

Computation and Language · Computer Science 2025-07-01 JiaRu Wu , Mingwei Liu

This work introduces a framework to diagnose the strengths and shortcomings of Autonomous Vehicle (AV) collision avoidance technology with synthetic yet realistic potential collision scenarios adapted from real-world, collision-free data.…

Optimization and Control · Mathematics 2024-09-18 Robert Dyro , Matthew Foutter , Ruolin Li , Luigi Di Lillo , Edward Schmerling , Xilin Zhou , Marco Pavone

Modern transportation systems face significant challenges in ensuring road safety, given serious injuries caused by road accidents. The rapid growth of autonomous vehicles (AVs) has prompted new traffic designs that aim to optimize…

Multiagent Systems · Computer Science 2026-02-25 Yijun Lu , Zhen Tian , Zhihao Lin

Autonomous vehicles with a self-evolving ability are expected to cope with unknown scenarios in the real-world environment. Take advantage of trial and error mechanism, reinforcement learning is able to self evolve by learning the optimal…

Robotics · Computer Science 2024-08-23 Shuo Yang , Liwen Wang , Yanjun Huang , Hong Chen

To improve efficiency and reduce failures in autonomous vehicles, research has focused on developing robust and safe learning methods that take into account disturbances in the environment. Existing literature in robust reinforcement…

Machine Learning · Computer Science 2019-03-12 Xiaobai Ma , Katherine Driggs-Campbell , Mykel J. Kochenderfer

Autonomous driving policies are typically trained via open-loop behavior cloning of human demonstrations. However, such policies suffer from covariate shift when deployed in closed loop, leading to compounding errors. We introduce Rollouts…

Existing evaluation paradigms for Autonomous Vehicles (AVs) face critical limitations. Real-world evaluation is often challenging due to safety concerns and a lack of reproducibility, whereas closed-loop simulation can face insufficient…

In an era marked by the rapid scaling of foundation models, autonomous driving technologies are approaching a transformative threshold where end-to-end autonomous driving (E2E-AD) emerges due to its potential of scaling up in the…

Robotics · Computer Science 2024-11-28 Xiaosong Jia , Zhenjie Yang , Qifeng Li , Zhiyuan Zhang , Junchi Yan

Adversarial examples are perturbed inputs designed to fool machine learning models. Adversarial training injects such examples into training data to increase robustness. To scale this technique to large datasets, perturbations are crafted…

Machine Learning · Statistics 2020-04-28 Florian Tramèr , Alexey Kurakin , Nicolas Papernot , Ian Goodfellow , Dan Boneh , Patrick McDaniel

In autonomous driving, behavior prediction is fundamental for safe motion planning, hence the security and robustness of prediction models against adversarial attacks are of paramount importance. We propose a novel adversarial backdoor…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Mozhgan Pourkeshavarz , Mohammad Sabokrou , Amir Rasouli

Vision-Language Models (VLMs) have recently emerged as a promising paradigm in autonomous driving (AD). However, current performance evaluation protocols for VLM-based AD systems (ADVLMs) are predominantly confined to open-loop settings…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Tianyuan Zhang , Ting Jin , Lu Wang , Jiangfan Liu , Siyuan Liang , Mingchuan Zhang , Aishan Liu , Xianglong Liu

As a new programming paradigm, deep learning has expanded its application to many real-world problems. At the same time, deep learning based software are found to be vulnerable to adversarial attacks. Though various defense mechanisms have…

Cryptography and Security · Computer Science 2021-03-16 Zhe Zhao , Guangke Chen , Jingyi Wang , Yiwei Yang , Fu Song , Jun Sun

As autonomous vehicles edge closer to widespread adoption, enhancing road safety through collision avoidance and minimization of collateral damage becomes imperative. Vehicle-to-everything (V2X) technologies, which include…