English
Related papers

Related papers: A Comprehensive Review of Adversarial Attacks on M…

200 papers

Adversarial attacks are a major concern in security-centered applications, where malicious actors continuously try to mislead Machine Learning (ML) models into wrongly classifying fraudulent activity as legitimate, whereas system…

Machine learning models are vulnerable to both security attacks (e.g., adversarial examples) and privacy attacks (e.g., private attribute inference). We take the first step to mitigate both the security and privacy attacks, and maintain…

Machine Learning · Computer Science 2024-12-17 Binghui Zhang , Sayedeh Leila Noorbakhsh , Yun Dong , Yuan Hong , Binghui Wang

In this work we present a formal theoretical framework for assessing and analyzing two classes of malevolent action towards generic Artificial Intelligence (AI) systems. Our results apply to general multi-class classifiers that map from an…

Machine Learning · Computer Science 2021-01-01 Ivan Y. Tyukin , Desmond J. Higham , Alexander N. Gorban

Adversarial training (AT) is among the most effective techniques to improve model robustness by augmenting training data with adversarial examples. However, most existing AT methods adopt a specific attack to craft adversarial examples,…

Machine Learning · Computer Science 2020-11-20 Yinpeng Dong , Zhijie Deng , Tianyu Pang , Hang Su , Jun Zhu

As generative AI, particularly large language models (LLMs), become increasingly integrated into production applications, new attack surfaces and vulnerabilities emerge and put a focus on adversarial threats in natural language and…

Adversarial training is an effective method to boost model robustness to malicious, adversarial attacks. However, such improvement in model robustness often leads to a significant sacrifice of standard performance on clean images. In many…

Machine Learning · Computer Science 2022-04-29 Pengyue Hou , Ming Zhou , Jie Han , Petr Musilek , Xingyu Li

Machine learning models are increasingly being adopted across various fields, such as medicine, business, autonomous vehicles, and cybersecurity, to analyze vast amounts of data, detect patterns, and make predictions or recommendations. In…

Cryptography and Security · Computer Science 2024-04-16 Dipkamal Bhusal , Nidhi Rastogi

Machine learning models are currently being deployed in a variety of real-world applications where model predictions are used to make decisions about healthcare, bank loans, and numerous other critical tasks. As the deployment of artificial…

Human-Computer Interaction · Computer Science 2019-10-07 Yuxin Ma , Tiankai Xie , Jundong Li , Ross Maciejewski

Adversarial attacks are major threats to the deployment of machine learning (ML) models in many applications. Testing ML models against such attacks is becoming an essential step for evaluating and improving ML models. In this paper, we…

Cryptography and Security · Computer Science 2024-10-10 Yuanzhe Jin , Min Chen

This paper presents an approach to developing assurance cases for adversarial robustness and regulatory compliance in large language models (LLMs). Focusing on both natural and code language tasks, we explore the vulnerabilities these…

Cryptography and Security · Computer Science 2024-10-10 Tomas Bueno Momcilovic , Dian Balta , Beat Buesser , Giulio Zizzo , Mark Purcell

Adversarial machine learning is an emerging field that focuses on studying vulnerabilities of machine learning approaches in adversarial settings and developing techniques accordingly to make learning robust to adversarial manipulations. It…

Quantum Physics · Physics 2020-08-11 Sirui Lu , Lu-Ming Duan , Dong-Ling Deng

The growing use of social media has led to the development of several Machine Learning (ML) and Natural Language Processing(NLP) tools to process the unprecedented amount of social media content to make actionable decisions. However, these…

Computation and Language · Computer Science 2021-10-28 Izzat Alsmadi , Kashif Ahmad , Mahmoud Nazzal , Firoj Alam , Ala Al-Fuqaha , Abdallah Khreishah , Abdulelah Algosaibi

Deep learning (DL) has significantly transformed cybersecurity, enabling advancements in malware detection, botnet identification, intrusion detection, user authentication, and encrypted traffic analysis. However, the rise of adversarial…

Cryptography and Security · Computer Science 2024-12-18 Li Li

Adversarial training has become one of the most effective methods for improving robustness of neural networks. However, it often suffers from poor generalization on both clean and perturbed data. In this paper, we propose a new algorithm,…

Machine Learning · Computer Science 2020-02-19 Minhao Cheng , Qi Lei , Pin-Yu Chen , Inderjit Dhillon , Cho-Jui Hsieh

Nowadays, autonomous driving has attracted much attention from both industry and academia. Convolutional neural network (CNN) is a key component in autonomous driving, which is also increasingly adopted in pervasive computing such as…

Signal Processing · Electrical Eng. & Systems 2020-02-07 Yao Deng , Xi Zheng , Tianyi Zhang , Chen Chen , Guannan Lou , Miryung Kim

Machine learning and deep learning in particular has been recently used to successfully address many tasks in the domain of code such as finding and fixing bugs, code completion, decompilation, type inference and many others. However, the…

Machine Learning · Computer Science 2020-08-18 Pavol Bielik , Martin Vechev

Machine Learning (ML) and Deep Learning (DL) models have achieved state-of-the-art performance on multiple learning tasks, from vision to natural language modelling. With the growing adoption of ML and DL to many areas of computer science,…

Machine Learning · Computer Science 2019-06-11 Anshuman Chhabra , Abhishek Roy , Prasant Mohapatra

Vulnerability of various machine learning methods to adversarial examples has been recently explored in the literature. Power systems which use these vulnerable methods face a huge threat against adversarial examples. To this end, we first…

Cryptography and Security · Computer Science 2022-02-16 Jiwei Tian , Buhong Wang , Jing Li , Zhen Wang , Mete Ozay

Large language models (LLMs) can often be made to behave in undesirable ways that they are explicitly fine-tuned not to. For example, the LLM red-teaming literature has produced a wide variety of 'jailbreaking' techniques to elicit harmful…

We have seen a surge in research aims toward adversarial attacks and defenses in AI/ML systems. While it is crucial to formulate new attack methods and devise novel defense strategies for robustness, it is also imperative to recognize who…

Cryptography and Security · Computer Science 2021-06-29 Kishor Datta Gupta , Dipankar Dasgupta