English
Related papers

Related papers: Erased but Exploitable: Black-box Embedding-Aware …

200 papers

With the recent surge of language models in different applications, attention to safety and robustness of these models has gained significant importance. Here we introduce a joint framework in which we simultaneously probe and improve the…

Artificial Intelligence · Computer Science 2023-11-17 Ninareh Mehrabi , Palash Goyal , Anil Ramakrishna , Jwala Dhamala , Shalini Ghosh , Richard Zemel , Kai-Wei Chang , Aram Galstyan , Rahul Gupta

Machine learning classifiers are vulnerable to adversarial examples -- input-specific perturbations that manipulate models' output. Universal Adversarial Perturbations (UAPs), which identify noisy patterns that generalize across the input…

Cryptography and Security · Computer Science 2022-02-03 Raphael Labaca-Castro , Luis Muñoz-González , Feargus Pendlebury , Gabi Dreo Rodosek , Fabio Pierazzi , Lorenzo Cavallaro

Machine Learning (ML) and Deep Learning (DL) models have achieved state-of-the-art performance on multiple learning tasks, from vision to natural language modelling. With the growing adoption of ML and DL to many areas of computer science,…

Machine Learning · Computer Science 2019-06-11 Anshuman Chhabra , Abhishek Roy , Prasant Mohapatra

The paper introduces a white-box attack on computer vision models using SHAP values. It demonstrates how adversarial evasion attacks can compromise the performance of deep learning models by reducing output confidence or inducing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Frank Mollard , Marcus Becker , Florian Roehrbein

Although Large Language Models (LLMs) have demonstrated impressive capabilities across a wide range of tasks, growing concerns have emerged over the misuse of sensitive, copyrighted, or harmful data during training. To address these…

Cryptography and Security · Computer Science 2025-06-03 Jie Ren , Zhenwei Dai , Xianfeng Tang , Yue Xing , Shenglai Zeng , Hui Liu , Jingying Zeng , Qiankun Peng , Samarth Varshney , Suhang Wang , Qi He , Charu C. Aggarwal , Hui Liu

Traditional white-box methods for creating adversarial perturbations against LLMs typically rely only on gradient computation from the targeted model, ignoring the internal mechanisms responsible for attack success or failure. Conversely,…

Machine Learning · Computer Science 2025-05-07 Thomas Winninger , Boussad Addad , Katarzyna Kapusta

Fine-tuning-as-a-service, while commercially successful for Large Language Model (LLM) providers, exposes models to harmful fine-tuning attacks. As a widely explored defense paradigm against such attacks, unlearning attempts to remove…

Cryptography and Security · Computer Science 2025-05-23 Biao Yi , Tiansheng Huang , Baolei Zhang , Tong Li , Lihai Nie , Zheli Liu , Li Shen

Deep learning techniques have shown promising results in image compression, with competitive bitrate and image reconstruction quality from compressed latent. However, while image compression has progressed towards a higher peak…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Kang Liu , Di Wu , Yiru Wang , Dan Feng , Benjamin Tan , Siddharth Garg

Machine learning has seen tremendous advances in the past few years, which has lead to deep learning models being deployed in varied applications of day-to-day life. Attacks on such models using perturbations, particularly in real-life…

Machine Learning · Computer Science 2020-02-10 Siddhant Bhambri , Sumanyu Muku , Avinash Tulasi , Arun Balaji Buduru

Deep neural networks (DNNs) have achieved remarkable success in diverse fields. However, it has been demonstrated that DNNs are very vulnerable to adversarial examples even in black-box settings. A large number of black-box attack methods…

Machine Learning · Computer Science 2022-03-29 Junjie Fu , Jian Sun , Gang Wang

Representation learning of textual networks poses a significant challenge as it involves capturing amalgamated information from two modalities: (i) underlying network structure, and (ii) node textual attributes. For this, most existing…

Computation and Language · Computer Science 2020-11-06 Tony Gracious , Ambedkar Dukkipati

Machine learning models are vulnerable to adversarial examples. Iterative adversarial training has shown promising results against strong white-box attacks. However, adversarial training is very expensive, and every time a model needs to be…

Machine Learning · Computer Science 2019-05-28 Hebi Li , Qi Xiao , Shixin Tian , Jin Tian

Deep neural networks provide unprecedented performance in all image classification problems, taking advantage of huge amounts of data available for training. Recent studies, however, have shown their vulnerability to adversarial attacks,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Diego Gragnaniello , Francesco Marra , Giovanni Poggi , Luisa Verdoliva

Large Language Model (LLM) services and models often come with legal rules on who can use them and how they must use them. Assessing the compliance of the released LLMs is crucial, as these rules protect the interests of the LLM contributor…

Machine Learning · Computer Science 2024-06-07 Martin Gubri , Dennis Ulmer , Hwaran Lee , Sangdoo Yun , Seong Joon Oh

The expansion of large-scale text-to-image diffusion models has raised growing concerns about their potential to generate undesirable or harmful content, ranging from fabricated depictions of public figures to sexually explicit images. To…

Cryptography and Security · Computer Science 2025-05-01 Jonas Henry Grebe , Tobias Braun , Marcus Rohrbach , Anna Rohrbach

In this paper, we investigate the impact of adversarial attacks on the explainability of deep learning models, which are commonly criticized for their black-box nature despite their capacity for autonomous feature extraction. This black-box…

Machine Learning · Computer Science 2024-12-17 Gazi Nazia Nur , Mohammad Ahnaf Sadat

White-box Adversarial Example (AE) attacks towards Deep Neural Networks (DNNs) have a more powerful destructive capacity than black-box AE attacks in the fields of AE strategies. However, almost all the white-box approaches lack…

Machine Learning · Computer Science 2021-10-15 Yixiang Wang , Jiqiang Liu , Xiaolin Chang , Jianhua Wang , Ricardo J. Rodríguez

Recent advances in text-to-image generative models have raised concerns about their potential to produce harmful content when provided with malicious input text prompts. To address this issue, two main approaches have emerged: (1)…

Machine Learning · Computer Science 2025-11-13 Jiwoo Shin , Byeonghu Na , Mina Kang , Wonhyeok Choi , Il-Chul Moon

The use of large language models (LLMs) in peer review systems has attracted growing attention, making it essential to examine their potential vulnerabilities. Prior attacks rely on prompt injection, which alters manuscript content and…

Computation and Language · Computer Science 2026-01-13 Masahiro Kaneko

Machine unlearning aims to remove specific outputs from trained models, often at the concept level, such as forgetting all occurrences of a particular celebrity or filtering content via text prompts. However, many undesired outputs, such as…

Machine Learning · Computer Science 2026-03-13 Kyungryeol Lee , Kyeonghyun Lee , Seongmin Hong , Byung Hyun Lee , Se Young Chun