English
Related papers

Related papers: Selecting Models based on the Risk of Damage Cause…

200 papers

With an ever-increasing reliance on machine learning (ML) models in the real world, adversarial examples threaten the safety of AI-based systems such as autonomous vehicles. In the image domain, they represent maliciously perturbed data…

Artificial Intelligence · Computer Science 2024-04-22 Dren Fazlija , Arkadij Orlov , Johanna Schrader , Monty-Maximilian Zühlke , Michael Rohs , Daniel Kudenko

Despite tremendous advancements of machine learning models and algorithms in various application domains, they are known to be vulnerable to subtle, natural or intentionally crafted perturbations in future input data, known as adversarial…

Machine Learning · Statistics 2025-06-03 Jingfu Peng , Yuhong Yang

Adversarial attacking aims to fool deep neural networks with adversarial examples. In the field of natural language processing, various textual adversarial attack models have been proposed, varying in the accessibility to the victim model.…

Computation and Language · Computer Science 2020-09-22 Yuan Zang , Bairu Hou , Fanchao Qi , Zhiyuan Liu , Xiaojun Meng , Maosong Sun

The landscape of adversarial attacks against text classifiers continues to grow, with new attacks developed every year and many of them available in standard toolkits, such as TextAttack and OpenAttack. In response, there is a growing body…

Computation and Language · Computer Science 2022-01-24 Zhouhang Xie , Jonathan Brophy , Adam Noack , Wencong You , Kalyani Asthana , Carter Perkins , Sabrina Reis , Sameer Singh , Daniel Lowd

The existence of adversarial attacks (or adversarial examples) brings huge concern about the machine learning (ML) model's safety issues. For many safety-critical ML tasks, such as financial forecasting, fraudulent detection, and anomaly…

Machine Learning · Computer Science 2022-10-19 Han Xu , Menghai Pan , Zhimeng Jiang , Huiyuan Chen , Xiaoting Li , Mahashweta Das , Hao Yang

State-of-the-art deep neural networks are known to be vulnerable to adversarial examples, formed by applying small but malicious perturbations to the original inputs. Moreover, the perturbations can \textit{transfer across models}:…

Machine Learning · Statistics 2018-02-28 Lei Wu , Zhanxing Zhu , Cheng Tai , Weinan E

Evaluating the robustness of automated driving planners is a critical and challenging task. Although methodologies to evaluate vehicles are well established, they do not yet account for a reality in which vehicles with autonomous components…

Cryptography and Security · Computer Science 2022-05-31 Andres Molina-Markham , Silvia G. Ionescu , Erin Lanus , Derek Ng , Sam Sommerer , Joseph J. Rushanan

Adversarial examples, which are slightly perturbed inputs generated with the aim of fooling a neural network, are known to transfer between models; adversaries which are effective on one model will often fool another. This concept of…

Machine Learning · Computer Science 2020-05-13 George Adam , Romain Speciel

Deep neural networks have demonstrated remarkable effectiveness across a wide range of tasks such as semantic segmentation. Nevertheless, these networks are vulnerable to adversarial attacks that add imperceptible perturbations to the input…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Kira Maag , Roman Resner , Asja Fischer

Motivated by safety-critical classification problems, we investigate adversarial attacks against cost-sensitive classifiers. We use current state-of-the-art adversarially-resistant neural network classifiers [1] as the underlying models.…

Machine Learning · Statistics 2019-10-08 Gavin S. Hartnett , Andrew J. Lohn , Alexander P. Sedlack

Adversarial examples are input examples that are specifically crafted to deceive machine learning classifiers. State-of-the-art adversarial example detection methods characterize an input example as adversarial either by quantifying the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Yuhang Wu , Sunpreet S. Arora , Yanhong Wu , Hao Yang

Over the last decade, adversarial attack algorithms have revealed instabilities in deep learning tools. These algorithms raise issues regarding safety, reliability and interpretability in artificial intelligence; especially in high risk…

Numerical Analysis · Mathematics 2023-08-30 Desmond J. Higham

Advances in machine learning have led to broad deployment of systems with impressive performance on important problems. Nonetheless, these systems can be induced to make errors on data that are surprisingly similar to examples the learned…

Machine Learning · Computer Science 2018-07-23 Justin Gilmer , Ryan P. Adams , Ian Goodfellow , David Andersen , George E. Dahl

We investigate conditions under which test statistics exist that can reliably detect examples, which have been adversarially manipulated in a white-box attack. These statistics can be easily computed and calibrated by randomly corrupting…

Machine Learning · Computer Science 2019-05-10 Kevin Roth , Yannic Kilcher , Thomas Hofmann

In this paper we propose a framework for assessing the risk associated with deploying a machine learning model in a specified environment. For that we carry over the risk definition from decision theory to machine learning. We develop and…

Recommender systems play an important role in modern information and e-commerce applications. While increasing research is dedicated to improving the relevance and diversity of the recommendations, the potential risks of state-of-the-art…

Machine Learning · Computer Science 2020-08-31 Jiaxi Tang , Hongyi Wen , Ke Wang

Many machine learning algorithms are vulnerable to almost imperceptible perturbations of their inputs. So far it was unclear how much risk adversarial perturbations carry for the safety of real-world machine learning applications because…

Machine Learning · Statistics 2018-02-19 Wieland Brendel , Jonas Rauber , Matthias Bethge

Benefiting from the rapid development of deep learning, 2D and 3D computer vision applications are deployed in many safe-critical systems, such as autopilot and identity authentication. However, deep learning models are not trustworthy…

Machine Learning · Computer Science 2023-10-03 Yanjie Li , Bin Xie , Songtao Guo , Yuanyuan Yang , Bin Xiao

Adversarial examples are inputs to a machine learning system that result in an incorrect output from that system. Attacks launched through this type of input can cause severe consequences: for example, in the field of image recognition, a…

Machine Learning · Computer Science 2021-11-24 Stefano Cresci , Marinella Petrocchi , Angelo Spognardi , Stefano Tognazzi

Our decision-making processes are becoming more data driven, based on data from multiple sources, of different types, processed by a variety of technologies. As technology becomes more relevant for decision processes, the more likely they…

Computers and Society · Computer Science 2018-01-01 Tomasz Ostwald