English
Related papers

Related papers: Harnessing the Vulnerability of Latent Layers in A…

200 papers

Despite extensive diagnostics and debugging by developers, AI systems sometimes exhibit harmful unintended behaviors. Finding and fixing these is challenging because the attack surface is so large -- it is not tractable to exhaustively…

Cryptography and Security · Computer Science 2025-07-30 Stephen Casper , Lennart Schulze , Oam Patel , Dylan Hadfield-Menell

Deep Neural Networks (DNNs) have recently achieved great success in many tasks, which encourages DNNs to be widely used as a machine learning service in model sharing scenarios. However, attackers can easily generate adversarial examples…

Machine Learning · Computer Science 2019-07-17 Xiaowei Zhou , Ivor W. Tsang , Jie Yin

Large language models (LLMs) can often be made to behave in undesirable ways that they are explicitly fine-tuned not to. For example, the LLM red-teaming literature has produced a wide variety of 'jailbreaking' techniques to elicit harmful…

Recent work has shown that language models' refusal behavior is primarily encoded in a single direction in their latent space, making it vulnerable to targeted attacks. Although Latent Adversarial Training (LAT) attempts to improve…

Computation and Language · Computer Science 2025-04-29 Alexandra Abbas , Nora Petrova , Helios Ael Lyons , Natalia Perez-Campanero

It is well known that adversarial attacks can fool deep neural networks with imperceptible perturbations. Although adversarial training significantly improves model robustness, failure cases of defense still broadly exist. In this work, we…

Machine Learning · Computer Science 2021-06-10 Boxi Wu , Heng Pan , Li Shen , Jindong Gu , Shuai Zhao , Zhifeng Li , Deng Cai , Xiaofei He , Wei Liu

Adversarial training (AT) is always formulated as a minimax problem, of which the performance depends on the inner optimization that involves the generation of adversarial examples (AEs). Most previous methods adopt Projected Gradient…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Xiaojun Jia , Yong Zhang , Baoyuan Wu , Ke Ma , Jue Wang , Xiaochun Cao

The new wave of adversarial attacks that utilize gradient-related vulnerabilities in neural network-based classifiers makes Network Intrusion Detection Systems more open to such threats. Although state-of-the-art adversarial training…

Cryptography and Security · Computer Science 2026-05-12 Hira Nasir , Eiman Javed , Balawal Shabir , Zunera Jalil , Ahmad Mohsin

Deep neural networks are vulnerable to small input perturbations known as adversarial attacks. Inspired by the fact that these adversaries are constructed by iteratively minimizing the confidence of a network for the true class label, we…

Machine Learning · Computer Science 2021-12-17 Motasem Alfarra , Juan C. Pérez , Ali Thabet , Adel Bibi , Philip H. S. Torr , Bernard Ghanem

Recent research showed that deep neural networks are highly sensitive to so-called adversarial perturbations, which are tiny perturbations of the input data purposely designed to fool a machine learning classifier. Most classification…

Machine Learning · Computer Science 2018-01-15 Akram Erraqabi , Aristide Baratin , Yoshua Bengio , Simon Lacoste-Julien

Recent work has demonstrated that deep neural networks are vulnerable to adversarial examples---inputs that are almost indistinguishable from natural data and yet classified incorrectly by the network. In fact, some of the latest findings…

Machine Learning · Statistics 2019-09-06 Aleksander Madry , Aleksandar Makelov , Ludwig Schmidt , Dimitris Tsipras , Adrian Vladu

Deep Neural Networks (DNNs) have recently achieved great success in many classification tasks. Unfortunately, they are vulnerable to adversarial attacks that generate adversarial examples with a small perturbation to fool DNN models,…

Machine Learning · Computer Science 2022-07-07 Xiaowei Zhou , Ivor W. Tsang , Jie Yin

In this work, we consider model robustness of deep neural networks against adversarial attacks from a global manifold perspective. Leveraging both the local and global latent information, we propose a novel adversarial training method…

Machine Learning · Computer Science 2022-10-04 Zhuang Qian , Shufei Zhang , Kaizhu Huang , Qiufeng Wang , Rui Zhang , Xinping Yi

Deep neural network models are used today in various applications of artificial intelligence, the strengthening of which, in the face of adversarial attacks is of particular importance. An appropriate solution to adversarial attacks is…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Mohammad Khalooei , Mohammad Mehdi Homayounpour , Maryam Amirmazlaghani

Despite their performance, Artificial Neural Networks are not reliable enough for most of industrial applications. They are sensitive to noises, rotations, blurs and adversarial examples. There is a need to build defenses that protect…

Machine Learning · Computer Science 2020-08-20 Alfred Laugros , Alice Caplier , Matthieu Ospici

Neural networks are known to be vulnerable to adversarial attacks -- slight but carefully constructed perturbations of the inputs which can drastically impair the network's performance. Many defense methods have been proposed for improving…

Deep convolutional neural networks are susceptible to adversarial attacks. They can be easily deceived to give an incorrect output by adding a tiny perturbation to the input. This presents a great challenge in making CNNs robust against…

Machine Learning · Computer Science 2021-04-21 Yunrui Yu , Xitong Gao , Cheng-Zhong Xu

Adversarial training (AT) and its variants have spearheaded progress in improving neural network robustness to adversarial perturbations and common corruptions in the last few years. Algorithm design of AT and its variants are focused on…

Machine Learning · Computer Science 2022-06-15 Kaustubh Sridhar , Souradeep Dutta , Ramneet Kaur , James Weimer , Oleg Sokolsky , Insup Lee

Deep learning methods have shown state of the art performance in a range of tasks from computer vision to natural language processing. However, it is well known that such systems are vulnerable to attackers who craft inputs in order to…

Machine Learning · Computer Science 2020-09-29 Giulio Zizzo , Chris Hankin , Sergio Maffeis , Kevin Jones

The vulnerability of deep neural networks (DNNs) to adversarial attack, which is an attack that can mislead state-of-the-art classifiers into making an incorrect classification with high confidence by deliberately perturbing the original…

Machine Learning · Computer Science 2021-06-18 Lina Wang , Rui Tang , Yawei Yue , Xingshu Chen , Wei Wang , Yi Zhu , Xuemei Zeng

Machine learning systems based on deep neural networks, being able to produce state-of-the-art results on various perception tasks, have gained mainstream adoption in many applications. However, they are shown to be vulnerable to…

Machine Learning · Computer Science 2018-01-16 Bo Luo , Yannan Liu , Lingxiao Wei , Qiang Xu
‹ Prev 1 2 3 10 Next ›