English
Related papers

Related papers: Erased but Exploitable: Black-box Embedding-Aware …

200 papers

Many existing adversarial attacks generate $L_p$-norm perturbations on image RGB space. Despite some achievements in transferability and attack success rate, the crafted adversarial examples are easily perceived by human eyes. Towards…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Jianqi Chen , Hao Chen , Keyan Chen , Yilan Zhang , Zhengxia Zou , Zhenwei Shi

Large Language Models (LLMs) are seeing significant adoption in every type of organization due to their exceptional generative capabilities. However, LLMs are found to be vulnerable to various adversarial attacks, particularly prompt…

Cryptography and Security · Computer Science 2024-10-30 Md. Ahsan Ayub , Subhabrata Majumdar

Recent studies have highlighted that deep neural networks (DNNs) are vulnerable to adversarial attacks, even in a black-box scenario. However, most of the existing black-box attack algorithms need to make a huge amount of queries to perform…

Machine Learning · Statistics 2018-09-11 Yali Du , Meng Fang , Jinfeng Yi , Jun Cheng , Dacheng Tao

Adversarial examples have posed a severe threat to deep neural networks due to their transferable nature. Currently, various works have paid great efforts to enhance the cross-model transferability, which mostly assume the substitute model…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Qilong Zhang , Xiaodan Li , Yuefeng Chen , Jingkuan Song , Lianli Gao , Yuan He , Hui Xue

Backdoor attacks present a substantial security concern for deep learning models, especially those utilized in applications critical to safety and security. These attacks manipulate model behavior by embedding a hidden trigger during the…

Machine Learning · Computer Science 2024-01-09 Yujing Jiang , Xingjun Ma , Sarah Monazam Erfani , Yige Li , James Bailey

Vision-language models (VLMs) have significantly advanced autonomous driving (AD) by enhancing reasoning capabilities; however, these models remain highly susceptible to adversarial attacks. While existing research has explored white-box…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Lu Wang , Tianyuan Zhang , Yang Qu , Siyuan Liang , Yuwei Chen , Aishan Liu , Xianglong Liu , Dacheng Tao

Deep Learning models are vulnerable to adversarial examples, i.e.\ images obtained via deliberate imperceptible perturbations, such that the model misclassifies them with high confidence. However, class confidence by itself is an incomplete…

Machine Learning · Statistics 2017-11-23 Ambrish Rawat , Martin Wistuba , Maria-Irina Nicolae

Large language models (LLMs) possess strong semantic understanding, driving significant progress in data mining applications. This is further enhanced by large reasoning models (LRMs), which provide explicit multi-step reasoning traces. On…

Machine Learning · Computer Science 2026-04-07 Aobo Chen , Chenxu Zhao , Chenglin Miao , Mengdi Huai

Recent work has proposed automated red-teaming methods for testing the vulnerabilities of a given target large language model (LLM). These methods use red-teaming LLMs to uncover inputs that induce harmful behavior in a target LLM. In this…

Machine Learning · Computer Science 2025-01-15 Jonathan Nöther , Adish Singla , Goran Radanović

Concept unlearning has emerged as a promising direction for reducing the risks of harmful content generation in text-to-image diffusion models by selectively erasing undesirable concepts from a model's parameters. Existing approaches…

Artificial Intelligence · Computer Science 2026-03-20 Duc Hao Pham , Van Duy Truong , Duy Khanh Dinh , Tien Cuong Nguyen , Dien Hy Ngo , Tuan Anh Bui

Despite the impressive performances reported by deep neural networks in different application domains, they remain largely vulnerable to adversarial examples, i.e., input samples that are carefully perturbed to cause misclassification at…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Angelo Sotgiu , Ambra Demontis , Marco Melis , Battista Biggio , Giorgio Fumera , Xiaoyi Feng , Fabio Roli

Large Vision-Language Models (VLMs) have demonstrated remarkable performance across multimodal tasks by integrating vision encoders with large language models (LLMs). However, these models remain vulnerable to adversarial attacks. Among…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Hee-Seon Kim , Minbeom Kim , Changick Kim

Ensuring trustworthiness in open-world visual recognition requires models that are interpretable, fair, and robust to distribution shifts. Yet modern vision systems are increasingly deployed as proprietary black-box APIs, exposing only…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Simone Carnemolla , Chiara Russo , Simone Palazzo , Quentin Bouniot , Daniela Giordano , Zeynep Akata , Matteo Pennisi , Concetto Spampinato

Machine unlearning (MU) removes specific data points or concepts from deep learning models to enhance privacy and prevent sensitive content generation. Adversarial prompts can exploit unlearned models to generate content containing removed…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Hyun Jun Yook , Ga San Jhun , Jae Hyun Cho , Min Jeon , Donghyun Kim , Tae Hyung Kim , Youn Kyu Lee

Prompt-based learning is a new language model training paradigm that adapts the Pre-trained Language Models (PLMs) to downstream tasks, which revitalizes the performance benchmarks across various natural language processing (NLP) tasks.…

Computation and Language · Computer Science 2024-04-10 Yue Xu , Wenjie Wang

Backdoor attacks compromise the integrity and reliability of machine learning models by embedding a hidden trigger during the training process, which can later be activated to cause unintended misbehavior. We propose a novel backdoor…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Felix Hsieh , Huy H. Nguyen , AprilPyone MaungMaung , Dmitrii Usynin , Isao Echizen

Deep learning based image classification models are shown vulnerable to adversarial attacks by injecting deliberately crafted noises to clean images. To defend against adversarial attacks in a training-free and attack-agnostic manner, this…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Li Ding , Yongwei Wang , Xin Ding , Kaiwen Yuan , Ping Wang , Hua Huang , Z. Jane Wang

Distributed learning frameworks, which partition neural network models across multiple computing nodes, enhance efficiency in collaborative edge-cloud systems, but may also introduce new vulnerabilities to evasion attacks, often in the form…

Cryptography and Security · Computer Science 2025-12-08 Giulio Rossolini , Tommaso Baldi , Alessandro Biondi , Giorgio Buttazzo

With further development in the fields of computer vision, network security, natural language processing and so on so forth, deep learning technology gradually exposed certain security risks. The existing deep learning algorithms cannot…

Cryptography and Security · Computer Science 2020-11-18 Rui Zhao

Machine unlearning, where users can request the deletion of a forget dataset, is becoming increasingly important because of numerous privacy regulations. Initial works on ``exact'' unlearning (e.g., retraining) incur large computational…

Machine Learning · Computer Science 2025-11-17 Ali Ebrahimpour-Boroojeny , Hari Sundaram , Varun Chandrasekaran