中文
相关论文

相关论文: Investigating Adversarial Trigger Transfer in Larg…

200 篇论文

Multimodal Large Language Models (MLLMs) demonstrate exceptional performance in cross-modality interaction, yet they also suffer adversarial vulnerabilities. In particular, the transferability of adversarial examples remains an ongoing…

计算机视觉与模式识别 · 计算机科学 2025-07-22 Hao Cheng , Erjia Xiao , Jiayan Yang , Jinhao Duan , Yichi Wang , Jiahang Cao , Qiang Zhang , Le Yang , Kaidi Xu , Jindong Gu , Renjing Xu

Automatic adversarial prompt generation provides remarkable success in jailbreaking safely-aligned large language models (LLMs). Existing gradient-based attacks, while demonstrating outstanding performance in jailbreaking white-box LLMs,…

机器学习 · 计算机科学 2025-01-22 Qizhang Li , Xiaochen Yang , Wangmeng Zuo , Yiwen Guo

Transformer-based pre-trained models of code (PTMC) have been widely utilized and have achieved state-of-the-art performance in many mission-critical applications. However, they can be vulnerable to adversarial attacks through identifier…

密码学与安全 · 计算机科学 2023-11-27 Xiaohu Du , Ming Wen , Zichao Wei , Shangwen Wang , Hai Jin

With the great advancements in large language models (LLMs), adversarial attacks against LLMs have recently attracted increasing attention. We found that pre-existing adversarial attack methodologies exhibit limited transferability and are…

计算与语言 · 计算机科学 2024-09-10 Zelin Li , Kehai Chen , Lemao Liu , Xuefeng Bai , Mingming Yang , Yang Xiang , Min Zhang

Neural network models are vulnerable to adversarial examples, and adversarial transferability further increases the risk of adversarial attacks. Current methods based on transferability often rely on substitute models, which can be…

计算与语言 · 计算机科学 2023-11-07 Minxuan Lv , Chengwei Dai , Kun Li , Wei Zhou , Songlin Hu

Large language models are now tuned to align with the goals of their creators, namely to be "helpful and harmless." These models should respond helpfully to user questions, but refuse to answer requests that could cause harm. However,…

Large Language Models (LLMs) have been extensively used across diverse domains, including virtual assistants, automated code generation, and scientific research. However, they remain vulnerable to jailbreak attacks, which manipulate the…

密码学与安全 · 计算机科学 2026-01-05 Haoran Gu , Handing Wang , Yi Mei , Mengjie Zhang , Yaochu Jin

Large language models (LLMs) increasingly operate in multi-agent and safety-critical settings, raising open questions about how their vulnerabilities scale when models interact adversarially. This study examines whether larger models can…

机器学习 · 计算机科学 2026-01-05 Samuel Nathanson , Rebecca Williams , Cynthia Matuszek

Deep neural network-based image classification can be misled by adversarial examples with small and quasi-imperceptible perturbations. Furthermore, the adversarial examples created on one classification model can also fool another different…

计算机视觉与模式识别 · 计算机科学 2021-11-23 Jindong Gu , Hengshuang Zhao , Volker Tresp , Philip Torr

This paper proposes a classification framework with a rejection option to mitigate the performance deterioration caused by adversarial examples. While recent machine learning algorithms achieve high prediction performance, they are…

机器学习 · 计算机科学 2020-10-27 Masahiro Kato , Zhenghang Cui , Yoshihiro Fukuhara

Many machine learning models are vulnerable to adversarial examples: inputs that are specially crafted to cause a machine learning model to produce an incorrect output. Adversarial examples that affect one model often affect another model,…

密码学与安全 · 计算机科学 2016-05-25 Nicolas Papernot , Patrick McDaniel , Ian Goodfellow

Transferability captures the ability of an attack against a machine-learning model to be effective against a different, potentially unknown, model. Empirical evidence for transferability has been shown in previous work, but the underlying…

Reliable deployment of machine learning models such as neural networks continues to be challenging due to several limitations. Some of the main shortcomings are the lack of interpretability and the lack of robustness against adversarial…

机器学习 · 计算机科学 2025-02-18 Jon Vadillo , Roberto Santana , Jose A. Lozano

Though deep neural networks perform challenging tasks excellently, they are susceptible to adversarial examples, which mislead classifiers by applying human-imperceptible perturbations on clean inputs. Under the query-free black-box…

机器学习 · 计算机科学 2020-11-05 Zifei Zhang , Kai Qiao , Jian Chen , Ningning Liang

Despite advances in AI alignment, large language models (LLMs) remain vulnerable to adversarial attacks or jailbreaking, in which adversaries can modify prompts to induce unwanted behavior. While some defenses have been proposed, they have…

机器学习 · 计算机科学 2024-11-11 Andy Zhou , Bo Li , Haohan Wang

Growing at a fast pace, modern autonomous systems will soon be deployed at scale, opening up the possibility for cooperative multi-agent systems. Sharing information and distributing workloads allow autonomous agents to better perform tasks…

机器学习 · 计算机科学 2021-10-13 James Tu , Tsunhsuan Wang , Jingkang Wang , Sivabalan Manivasagam , Mengye Ren , Raquel Urtasun

Large Language Models (LLMs) are swiftly advancing in architecture and capability, and as they integrate more deeply into complex systems, the urgency to scrutinize their security properties grows. This paper surveys research in the…

计算与语言 · 计算机科学 2023-10-18 Erfan Shayegani , Md Abdullah Al Mamun , Yu Fu , Pedram Zaree , Yue Dong , Nael Abu-Ghazaleh

Deep neural networks are vulnerable to adversarial examples that are crafted by imposing imperceptible changes to the inputs. However, these adversarial examples are most successful in white-box settings where the model and its parameters…

机器学习 · 计算机科学 2021-12-20 Tianjin Huang , Vlado Menkovski , Yulong Pei , YuHao Wang , Mykola Pechenizkiy

Deep neural networks are vulnerable to adversarial examples (AEs), which have adversarial transferability: AEs generated for the source model can mislead another (target) model's predictions. However, the transferability has not been…

机器学习 · 计算机科学 2022-10-21 Futa Waseda , Sosuke Nishikawa , Trung-Nghia Le , Huy H. Nguyen , Isao Echizen

Deep neural networks are vulnerable to adversarial examples, which can mislead classifiers by adding imperceptible perturbations. An intriguing property of adversarial examples is their good transferability, making black-box attacks…

计算机视觉与模式识别 · 计算机科学 2019-04-08 Yinpeng Dong , Tianyu Pang , Hang Su , Jun Zhu