English
Related papers

Related papers: Developing a Taxonomy of Elements Adversarial to A…

200 papers

Real-world autonomous driving, particularly in urban environments with numerous corner cases, requires rigorous testing to ensure product safety and robustness. However, few studies have explored integrating adversarial scenario generation…

Robotics · Computer Science 2026-05-18 Chuancheng Zhang , Zhenhao Wang , Kaizheng Li , Yaran Lin , Qiang Guo , Bin Jiang

Deep learning models are known to solve classification and regression problems by employing a number of epoch and training samples on a large dataset with optimal accuracy. However, that doesn't mean they are attack-proof or unexposed to…

Cryptography and Security · Computer Science 2019-05-10 Chris Einar San Agustin

In multiple domains such as malware detection, automated driving systems, or fraud detection, classification algorithms are susceptible to being attacked by malicious agents willing to perturb the value of instance covariates to pursue…

Machine Learning · Statistics 2025-07-10 Victor Gallego , Roi Naveiro , Alberto Redondo , David Rios Insua , Fabrizio Ruggeri

Fueled by massive amounts of data, models produced by machine-learning (ML) algorithms, especially deep neural networks, are being used in diverse domains where trustworthiness is a concern, including automotive systems, finance, health…

Machine Learning · Computer Science 2018-05-22 Tommaso Dreossi , Somesh Jha , Sanjit A. Seshia

It has been shown that most machine learning algorithms are susceptible to adversarial perturbations. Slightly perturbing an image in a carefully chosen direction in the image space may cause a trained neural network model to misclassify…

Computer Vision and Pattern Recognition · Computer Science 2017-07-13 Jiajun Lu , Hussein Sibai , Evan Fabry , David Forsyth

Existing approaches in reinforcement learning train an agent to learn desired optimal behavior in an environment with rule based surrounding agents. In safety critical applications such as autonomous driving it is crucial that the rule…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Arjun Srinivasan , Anubhav Paras , Aniket Bera

This work introduces a framework to diagnose the strengths and shortcomings of Autonomous Vehicle (AV) collision avoidance technology with synthetic yet realistic potential collision scenarios adapted from real-world, collision-free data.…

Optimization and Control · Mathematics 2024-09-18 Robert Dyro , Matthew Foutter , Ruolin Li , Luigi Di Lillo , Edward Schmerling , Xilin Zhou , Marco Pavone

Convolutional Neural Networks (CNNs) are vulnerable to misclassifying images when small perturbations are present. With the increasing prevalence of CNNs in self-driving cars, it is vital to ensure these algorithms are robust to prevent…

Computer Vision and Pattern Recognition · Computer Science 2022-02-17 Aakash Kumar

Adversarial input image perturbation attacks have emerged as a significant threat to machine learning algorithms, particularly in image classification setting. These attacks involve subtle perturbations to input images that cause neural…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Anthony Etim , Jakub Szefer

Autonomous racing represents a uniquely challenging control environment where agents must act while on the limits of a vehicle's capability in order to set competitive lap times. This places the agent on a knife's edge, with a very small…

Systems and Control · Electrical Eng. & Systems 2022-10-25 Matthew Howe , James Bockman , Adrian Orenstein , Stefan Podgorski , Sam Bahrami , Ian Reid

The open-world deployment of Machine Learning (ML) algorithms in safety-critical applications such as autonomous vehicles needs to address a variety of ML vulnerabilities such as interpretability, verifiability, and performance limitations.…

Machine Learning · Computer Science 2022-03-09 Sina Mohseni , Haotao Wang , Zhiding Yu , Chaowei Xiao , Zhangyang Wang , Jay Yadawa

Adversarial attacks are a type of attack on machine learning models where an attacker deliberately modifies the inputs to cause the model to make incorrect predictions. Adversarial attacks can have serious consequences, particularly in…

Machine Learning · Computer Science 2025-09-15 Prathyusha Devabhakthini , Sasmita Parida , Raj Mani Shukla , Suvendu Chandan Nayak , Tapadhir Das

Generating adversarial scenarios, which have the potential to fail autonomous driving systems, provides an effective way to improve robustness. Extending purely data-driven generative models, recent specialized models satisfy additional…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Wenhao Ding , Haohong Lin , Bo Li , Ding Zhao

Modern autonomous vehicles adopt state-of-the-art DNN models to interpret the sensor data and perceive the environment. However, DNN models are vulnerable to different types of adversarial attacks, which pose significant risks to the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Xingshuo Han , Guowen Xu , Yuan Zhou , Xuehuan Yang , Jiwei Li , Tianwei Zhang

Autonomous driving vehicles provide a vast potential for realizing use cases in the on-road and off-road domains. Consequently, remarkable solutions exist to autonomous systems' environmental perception and control. Nevertheless, proof of…

Robotics · Computer Science 2024-03-29 Patrick Wolf

Machine learning algorithms are vulnerable to poisoning attacks: An adversary can inject malicious points in the training dataset to influence the learning process and degrade the algorithm's performance. Optimal poisoning attacks have…

Machine Learning · Computer Science 2019-09-26 Luis Muñoz-González , Bjarne Pfitzner , Matteo Russo , Javier Carnerero-Cano , Emil C. Lupu

This paper focuses on safety performance testing and characterization of black-box highly automated vehicles (HAV). Existing testing approaches typically obtain the testing outcomes by deploying the HAV into a specific testing environment.…

Robotics · Computer Science 2024-02-05 Minghao Zhu , Anmol Sidhu , Keith A. Redmill

Machine learning algorithms, however effective, are known to be vulnerable in adversarial scenarios where a malicious user may inject manipulated instances. In this work we focus on evasion attacks, where a model is trained in a safe…

Machine Learning · Computer Science 2020-04-08 Stefano Calzavara , Claudio Lucchese , Federico Marcuzzi , Salvatore Orlando

Deep learning has become an increasingly common technique for various control problems, such as robotic arm manipulation, robot navigation, and autonomous vehicles. However, the downside of using deep neural networks to learn control…

Machine Learning · Computer Science 2020-02-28 Sampo Kuutti , Saber Fallah , Richard Bowden

Advanced driver assistance systems are advancing at a rapid pace and all major companies started investing in developing the autonomous vehicles. But the security and reliability is still uncertain and debatable. Imagine that a vehicle is…

Human-Computer Interaction · Computer Science 2018-10-10 Amara Dinesh Kumar , Koti Naga Renu Chebrolu , Vinayakumar R , Soman KP