English
Related papers

Related papers: Explaining Vulnerabilities to Adversarial Machine …

200 papers

Machine learning algorithms are used to construct a mathematical model for a system based on training data. Such a model is capable of making highly accurate predictions without being explicitly programmed to do so. These techniques have a…

Cryptography and Security · Computer Science 2022-02-22 Cato Pauling , Michael Gimson , Muhammed Qaid , Ahmad Kida , Basel Halak

Adversarial attacks are considered a potentially serious security threat for machine learning systems. Medical image analysis (MedIA) systems have recently been argued to be vulnerable to adversarial attacks due to strong financial…

Adversarial machine learning is a fast growing research area, which considers the scenarios when machine learning systems may face potential adversarial attackers, who intentionally synthesize input data to make a well-trained model to make…

Machine Learning · Computer Science 2018-10-24 Guofu Li , Pengjia Zhu , Jin Li , Zhemin Yang , Ning Cao , Zhiyi Chen

Deep computer vision systems being vulnerable to imperceptible and carefully crafted noise have raised questions regarding the robustness of their decisions. We take a step back and approach this problem from an orthogonal direction. We…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Sadaf Gulshad , Jan Hendrik Metzen , Arnold Smeulders , Zeynep Akata

Machine learning is a powerful tool enabling full automation of a huge number of tasks without explicit programming. Despite recent progress of machine learning in different domains, these models have shown vulnerabilities when they are…

Machine Learning · Computer Science 2026-03-27 Mohammad Meymani , Roozbeh Razavi-Far

Adversarial samples are perturbed inputs crafted to mislead the machine learning systems. A training mechanism, called adversarial training, which presents adversarial samples along with clean samples has been introduced to learn robust…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Vivek B. S. , Konda Reddy Mopuri , R. Venkatesh Babu

Malware still constitutes a major threat in the cybersecurity landscape, also due to the widespread use of infection vectors such as documents. These infection vectors hide embedded malicious code to the victim users, facilitating the use…

Cryptography and Security · Computer Science 2020-04-15 Davide Maiorca , Battista Biggio , Giorgio Giacinto

Learning from demonstrations is a popular approach to train AI models; however, their vulnerability to adversarial attacks remains underexplored. We present the first systematic study of adversarial attacks, across a range of both classic…

Machine Learning · Computer Science 2026-04-27 Akansha Kalra , Basavasagar Patil , Guanhong Tao , Daniel S. Brown

Machine learning is being integrated into a growing number of critical systems with far-reaching impacts on society. Unexpected behaviour and unfair decision processes are coming under increasing scrutiny due to this widespread use and its…

Machine Learning · Computer Science 2020-09-02 Pieter Delobelle , Paul Temple , Gilles Perrouin , Benoît Frénay , Patrick Heymans , Bettina Berendt

Despite their impressive performance, deep visual models are susceptible to transferable black-box adversarial attacks. Principally, these attacks craft perturbations in a target model-agnostic manner. However, surprisingly, we find that…

Machine Learning · Computer Science 2025-04-15 Mohammad A. A. K. Jalwana , Naveed Akhtar , Ajmal Mian , Nazanin Rahnavard , Mubarak Shah

Adversarial attacks for machine learning models have become a highly studied topic both in academia and industry. These attacks, along with traditional security threats, can compromise confidentiality, integrity, and availability of…

Cryptography and Security · Computer Science 2020-12-10 Jakub Breier , Adrian Baldwin , Helen Balinsky , Yang Liu

Deep Learning models are vulnerable to adversarial examples, i.e.\ images obtained via deliberate imperceptible perturbations, such that the model misclassifies them with high confidence. However, class confidence by itself is an incomplete…

Machine Learning · Statistics 2017-11-23 Ambrish Rawat , Martin Wistuba , Maria-Irina Nicolae

Embodied AI systems, including robots and autonomous vehicles, are increasingly integrated into real-world applications, where they encounter a range of vulnerabilities stemming from both environmental and system-level factors. These…

Cryptography and Security · Computer Science 2025-02-26 Wenpeng Xing , Minghao Li , Mohan Li , Meng Han

In recent years, the topic of explainable machine learning (ML) has been extensively researched. Up until now, this research focused on regular ML users use-cases such as debugging a ML model. This paper takes a different posture and show…

Cryptography and Security · Computer Science 2022-06-02 Ishai Rosenberg , Shai Meir , Jonathan Berrebi , Ilay Gordon , Guillaume Sicard , Eli David

Deep learning on graph structures has shown exciting results in various applications. However, few attentions have been paid to the robustness of such models, in contrast to numerous research work for image or text adversarial attack and…

Machine Learning · Computer Science 2018-06-08 Hanjun Dai , Hui Li , Tian Tian , Xin Huang , Lin Wang , Jun Zhu , Le Song

Despite the impressive performances reported by deep neural networks in different application domains, they remain largely vulnerable to adversarial examples, i.e., input samples that are carefully perturbed to cause misclassification at…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Angelo Sotgiu , Ambra Demontis , Marco Melis , Battista Biggio , Giorgio Fumera , Xiaoyi Feng , Fabio Roli

It is imperative to safeguard computer applications and information systems against the growing number of cyber-attacks. Automated software testing tools can be developed to quickly analyze many lines of code and detect vulnerabilities by…

Software Engineering · Computer Science 2025-05-20 João Vitorino , Tiago Dias , Tiago Fonseca , Eva Maia , Isabel Praça

Explainable AI (XAI) methods aim to describe the decision process of deep neural networks. Early XAI methods produced visual explanations, whereas more recent techniques generate multimodal explanations that include textual information and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Alina Elena Baia , Valentina Poggioni , Andrea Cavallaro

This paper investigates recently proposed approaches for defending against adversarial examples and evaluating adversarial robustness. We motivate 'adversarial risk' as an objective for achieving models robust to worst-case inputs. We then…

Machine Learning · Computer Science 2018-06-13 Jonathan Uesato , Brendan O'Donoghue , Aaron van den Oord , Pushmeet Kohli

The use of machine learning (ML) has become increasingly prevalent in various domains, highlighting the importance of understanding and ensuring its safety. One pressing concern is the vulnerability of ML applications to model stealing…

Machine Learning · Computer Science 2026-04-07 Ganghua Wang , Yuhong Yang , Jie Ding