English
Related papers

Related papers: Does Physical Adversarial Example Really Matter to…

200 papers

Self-driving vehicles (SDVs) must be rigorously tested on a wide range of scenarios to ensure safe deployment. The industry typically relies on closed-loop simulation to evaluate how the SDV interacts on a corpus of synthetic and real…

Robotics · Computer Science 2023-11-03 Jay Sarva , Jingkang Wang , James Tu , Yuwen Xiong , Sivabalan Manivasagam , Raquel Urtasun

Nowadays, intrusion detection systems based on deep learning deliver state-of-the-art performance. However, recent research has shown that specially crafted perturbations, called adversarial examples, are capable of significantly reducing…

Cryptography and Security · Computer Science 2022-10-31 Islam Debicha , Richard Bauwens , Thibault Debatty , Jean-Michel Dricot , Tayeb Kenaza , Wim Mees

There is an increasing interest in analyzing the behavior of machine learning systems against adversarial attacks. However, most of the research in adversarial machine learning has focused on studying weaknesses against evasion or poisoning…

Machine Learning · Statistics 2025-06-12 Pablo G. Arce , Roi Naveiro , David Ríos Insua

The safety of autonomous driving systems (ADS) depends on accurate perception across distance and driving conditions. The outputs of AI perception algorithms are stochastic, which have a major impact on decision making and safety outcomes,…

Robotics · Computer Science 2026-02-24 Boyu Jiang , Liang Shi , Zhengzhi Lin , Lanxin Xiang , Loren Stowe , Feng Guo

Vision-Language Models (VLMs), with their strong reasoning and planning capabilities, are widely used in embodied decision-making (EDM) tasks in embodied agents, such as autonomous driving and robotic manipulation. Recent research has…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Yichen Wang , Hangtao Zhang , Hewen Pan , Ziqi Zhou , Xianlong Wang , Peijin Guo , Lulu Xue , Shengshan Hu , Minghui Li , Leo Yu Zhang

Generating adversarial safety-critical scenarios is a pivotal method for testing autonomous driving systems, as it identifies potential weaknesses and enhances system robustness and reliability. However, existing approaches predominantly…

Robotics · Computer Science 2025-03-03 Yukuan Yang , Xucheng Lu , Zhili Zhang , Zepeng Wu , Guoqi Li , Lingzhong Meng , Yunzhi Xue

Many research papers have recently focused on behavioral-based driver authentication systems in vehicles. Pushed by Artificial Intelligence (AI) advancements, these works propose powerful models to identify drivers through their unique…

Cryptography and Security · Computer Science 2024-06-11 Emad Efatinasab , Francesco Marchiori , Denis Donadel , Alessandro Brighente , Mauro Conti

Recent studies have shown that state-of-the-art deep learning models are vulnerable to the inputs with small perturbations (adversarial examples). We observe two critical obstacles in adversarial examples: (i) Strong adversarial attacks…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Xiaoyong Yuan , Pan He , Xiaolin Andy Li , Dapeng Oliver Wu

Autonomous systems such as self-driving cars and general-purpose robots are safety-critical systems that operate in highly uncertain and dynamic environments. We propose an interactive multi-agent framework where the system-under-design is…

Machine Learning · Computer Science 2021-07-07 Xin Qin , Nikos Aréchiga , Andrew Best , Jyotirmoy Deshmukh

Modern self-driving perception systems have been shown to improve upon processing complementary inputs such as LiDAR with images. In isolation, 2D images have been found to be extremely vulnerable to adversarial attacks. Yet, there have…

Computer Vision and Pattern Recognition · Computer Science 2022-01-10 James Tu , Huichen Li , Xinchen Yan , Mengye Ren , Yun Chen , Ming Liang , Eilyan Bitar , Ersin Yumer , Raquel Urtasun

Deep neural networks (DNNs) have been proven extremely susceptible to adversarial examples, which raises special safety-critical concerns for DNN-based autonomous driving stacks (i.e., 3D object detection). Although there are extensive…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Leheng Li , Qing Lian , Ying-Cong Chen

Bird's-Eye-View (BEV) perception has become a foundational paradigm in autonomous driving, enabling unified spatial representations that support robust multi-sensor fusion and multi-agent collaboration. As autonomous vehicles transition…

To autonomously control vehicles, driving agents use outputs from a combination of machine-learning (ML) models, controller logic, and custom modules. Although numerous prior works have shown that adversarial examples can mislead ML models…

Cryptography and Security · Computer Science 2025-11-20 Henry Wong , Clement Fung , Weiran Lin , Karen Li , Stanley Chen , Lujo Bauer

Current evaluation methods for autonomous driving prediction models rely heavily on simplistic metrics such as Average Displacement Error (ADE) and Final Displacement Error (FDE). While these metrics offer basic performance assessments,…

Robotics · Computer Science 2025-10-14 Feifei Liu , Haozhe Wang , Zejun Wei , Qirong Lu , Yiyang Wen , Xiaoyu Tang , Jingyan Jiang , Zhijian He

We develop a novel framework to assess the risk of misperception in a traffic sign classification task in the presence of exogenous noise. We consider the problem in an autonomous driving setting, where visual input quality gradually…

Robotics · Computer Science 2023-03-17 Guangyi Liu , Disha Kamale , Cristian-Ioan Vasile , Nader Motee

Recent work in adversarial machine learning started to focus on the visual perception in autonomous driving and studied Adversarial Examples (AEs) for object detection models. However, in such visual perception pipeline the detected objects…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Yunhan Jia , Yantao Lu , Junjie Shen , Qi Alfred Chen , Zhenyu Zhong , Tao Wei

Autonomous vehicle (AV) technology is rapidly becoming a reality on U.S. roads, offering the promise of improvements in traffic management, safety, and the comfort and efficiency of vehicular travel. With this increasing popularity and…

Signal Processing · Electrical Eng. & Systems 2019-08-15 Saurabh Jha , Subho S. Banerjee , James Cyriac , Zbigniew T. Kalbarczyk , Ravishankar K. Iyer

Autonomous Driving Systems (ADS) have made huge progress and started on-road testing or even commercializing trials. ADS are complex and difficult to test: they receive input data from multiple sensors and make decisions using a combination…

Software Engineering · Computer Science 2024-08-27 Tri Minh Triet Pham , Bo Yang , Jinqiu Yang

Trajectory prediction using deep neural networks (DNNs) is an essential component of autonomous driving (AD) systems. However, these methods are vulnerable to adversarial attacks, leading to serious consequences such as collisions. In this…

Machine Learning · Computer Science 2022-08-02 Yulong Cao , Danfei Xu , Xinshuo Weng , Zhuoqing Mao , Anima Anandkumar , Chaowei Xiao , Marco Pavone

In recent years, 3D object perception has become a crucial component in the development of autonomous driving systems, providing essential environmental awareness. However, as perception tasks in autonomous driving evolve, their variants…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Yu Wang , Shaohua Wang , Yicheng Li , Mingchun Liu