English
Related papers

Related papers: Layer-Wise Perturbations via Sparse Autoencoders f…

200 papers

Sparse adversarial attacks can fool deep neural networks (DNNs) by only perturbing a few pixels (regularized by l_0 norm). Recent efforts combine it with another l_infty imperceptible on the perturbation magnitudes. The resultant sparse and…

Machine Learning · Computer Science 2021-06-14 Mingkang Zhu , Tianlong Chen , Zhangyang Wang

The Deep Neural Networks are vulnerable toadversarial exam-ples(Figure 1), making the DNNs-based systems collapsed byadding the inconspicuous perturbations to the images. Most of the existing works for adversarial attack are gradient-based…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Shaohao Lu , Yuqiao Xian , Ke Yan , Yi Hu , Xing Sun , Xiaowei Guo , Feiyue Huang , Wei-Shi Zheng

Machine unlearning aims to remove specific concepts from pretrained text-to-image diffusion models, yet several white- and black-box attacks have been introduced to make the model generate such unlearned concepts. These attacks,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Arian Komaei Koma , Seyed Amir Kasaei , AmirMahdi Sadeghzadeh , Mohammad Hossein Rohban

Diffusion models have become the go-to method for text-to-image generation, producing high-quality images from pure noise. However, the inner workings of diffusion models is still largely a mystery due to their black-box nature and complex,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Berk Tinaz , Zalan Fabian , Mahdi Soltanolkotabi

Due to the remarkable generative potential of diffusion-based models, numerous researches have investigated jailbreak attacks targeting these frameworks. A particularly concerning threat within image models is the generation of…

Cryptography and Security · Computer Science 2024-12-12 Xin Zhao , Xiaojun Chen , Haoyu Gao

Adversarial perturbations can mislead Multimodal Large Language Models (MLLMs) recognize a benign image as a specific target object, posing serious risks in safety-critical scenarios such as autonomous driving and medical diagnosis. This…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Haobo Wang , Xiaorong Ma , Weiqi Luo , Xiaojun Jia , Jiwu Huang

Sparse autoencoders (SAEs) provide a powerful mechanism for decomposing the dense representations produced by Large Language Models (LLMs) into interpretable latent features. We posit that SAEs constitute a natural foundation for Learned…

Machine Learning · Computer Science 2026-03-17 Thibault Formal , Maxime Louis , Hervé Dejean , Stéphane Clinchant

We propose a novel genetic-algorithm technique that generates black-box adversarial examples which successfully fool neural network based text classifiers. We perform a genetic search with multi-objective optimization guided by deep…

Artificial Intelligence · Computer Science 2020-11-11 Alex Mathai , Shreya Khare , Srikanth Tamilselvam , Senthil Mani

The growth of hateful online content, or hate speech, has been associated with a global increase in violent crimes against minorities [23]. Harmful online content can be produced easily, automatically and anonymously. Even though, some form…

Computation and Language · Computer Science 2023-10-09 David Herel , Hugo Cisneros , Tomas Mikolov

Recent LLMs like DeepSeek-R1 have demonstrated state-of-the-art performance by integrating deep thinking and complex reasoning during generation. However, the internal mechanisms behind these reasoning processes remain unexplored. We…

Computation and Language · Computer Science 2025-08-07 Andrey Galichin , Alexey Dontsov , Polina Druzhinina , Anton Razzhigaev , Oleg Y. Rogov , Elena Tutubalina , Ivan Oseledets

Adversarial attacks involve adding perturbations to the source image to cause misclassification by the target model, which demonstrates the potential of attacking face recognition models. Existing adversarial face image generation methods…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Decheng Liu , Xijun Wang , Chunlei Peng , Nannan Wang , Ruiming Hu , Xinbo Gao

Deep neural network image classifiers are reported to be susceptible to adversarial evasion attacks, which use carefully crafted images created to mislead a classifier. Many adversarial attacks belong to the category of dense attacks, which…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 He Zhao , Thanh Nguyen , Trung Le , Paul Montague , Olivier De Vel , Tamas Abraham , Dinh Phung

Unrestricted adversarial examples (UAEs), allow the attacker to create non-constrained adversarial examples without given clean samples, posing a severe threat to the safety of deep learning models. Recent works utilize diffusion models to…

Machine Learning · Computer Science 2025-04-17 Zeyu Dai , Shengcai Liu , Rui He , Jiahao Wu , Ning Lu , Wenqi Fan , Qing Li , Ke Tang

Recent research has shown that Large Language Models (LLMs) are vulnerable to automated jailbreak attacks, where adversarial suffixes crafted by algorithms appended to harmful queries bypass safety alignment and trigger unintended…

Computation and Language · Computer Science 2025-11-10 Chung-En Sun , Xiaodong Liu , Weiwei Yang , Tsui-Wei Weng , Hao Cheng , Aidan San , Michel Galley , Jianfeng Gao

Recent works have shown that deep neural networks are vulnerable to adversarial examples that find samples close to the original image but can make the model misclassify. Even with access only to the model's output, an attacker can employ…

Machine Learning · Computer Science 2023-10-03 Quang H. Nguyen , Yingjie Lao , Tung Pham , Kok-Seng Wong , Khoa D. Doan

Adversarial attacks pose significant challenges to deep neural networks (DNNs) such as Transformer models in natural language processing (NLP). This paper introduces a novel defense strategy, called GenFighter, which enhances adversarial…

Machine Learning · Computer Science 2024-04-18 Md Athikul Islam , Edoardo Serra , Sushil Jajodia

Automatic speech recognition (ASR) systems are known to be vulnerable to adversarial attacks. This paper addresses detection and defence against targeted white-box attacks on speech signals for ASR systems. While existing work has utilised…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-13 Nikolai L. Kühne , Astrid H. F. Kitchen , Marie S. Jensen , Mikkel S. L. Brøndt , Martin Gonzalez , Christophe Biscio , Zheng-Hua Tan

We study the unique, less-well understood problem of generating sparse adversarial samples simply by observing the score-based replies to model queries. Sparse attacks aim to discover a minimum number-the l0 bounded-perturbations to model…

Machine Learning · Computer Science 2024-06-04 Viet Quoc Vo , Ehsan Abbasnejad , Damith C. Ranasinghe

Generating high-quality and interpretable adversarial examples in the text domain is a much more daunting task than it is in the image domain. This is due partly to the discrete nature of text, partly to the problem of ensuring that the…

Machine Learning · Computer Science 2019-05-31 Samuel Barham , Soheil Feizi

Deep learning is a kind of feature learning method with strong nonliear feature transformation and becomes more and more important in many fields of artificial intelligence. Deep autoencoder is one representative method of the deep learning…

Machine Learning · Computer Science 2020-02-18 Yongming Li , Yan Lei , Pin Wang , Yuchuan Liu