中文
相关论文

相关论文: Adversarial Defence without Adversarial Defence: E…

200 篇论文

Owing to security implications of adversarial vulnerability, adversarial robustness of deep metric learning models has to be improved. In order to avoid model collapse due to excessively hard examples, the existing defenses dismiss the…

机器学习 · 计算机科学 2022-03-04 Mo Zhou , Vishal M. Patel

The fact that deep neural networks are susceptible to crafted perturbations severely impacts the use of deep learning in certain domains of application. Among many developed defense models against such attacks, adversarial training emerges…

机器学习 · 计算机科学 2020-07-13 Anh Bui , Trung Le , He Zhao , Paul Montague , Olivier deVel , Tamas Abraham , Dinh Phung

Existing works show that augmenting the training data of pre-trained language models (PLMs) for classification tasks fine-tuned via parameter-efficient fine-tuning methods (PEFT) using both clean and adversarial examples can enhance their…

计算与语言 · 计算机科学 2024-06-18 Tuc Nguyen , Thai Le

Misaligned research objectives have considerably hindered progress in adversarial robustness research over the past decade. For instance, an extensive focus on optimizing target metrics, while neglecting rigorous standardized evaluation,…

The wide-ranging applications of large language models (LLMs), especially in safety-critical domains, necessitate the proper evaluation of the LLM's adversarial robustness. This paper proposes an efficient tool to audit the LLM's…

密码学与安全 · 计算机科学 2023-10-23 Xilie Xu , Keyi Kong , Ning Liu , Lizhen Cui , Di Wang , Jingfeng Zhang , Mohan Kankanhalli

Large language models (LLMs) can often be made to behave in undesirable ways that they are explicitly fine-tuned not to. For example, the LLM red-teaming literature has produced a wide variety of 'jailbreaking' techniques to elicit harmful…

Large language models (LLMs) have exhibited outstanding performance in natural language processing tasks. However, these models remain susceptible to adversarial attacks in which slight input perturbations can lead to harmful or misleading…

计算机视觉与模式识别 · 计算机科学 2024-12-19 Minkyoung Kim , Yunha Kim , Hyeram Seo , Heejung Choi , Jiye Han , Gaeun Kee , Soyoung Ko , HyoJe Jung , Byeolhee Kim , Young-Hak Kim , Sanghyun Park , Tae Joon Jun

Neural networks are vulnerable to adversarial attacks -- small visually imperceptible crafted noise which when added to the input drastically changes the output. The most effective method of defending against these adversarial attacks is to…

It is broadly known that deep neural networks are susceptible to being fooled by adversarial examples with perturbations imperceptible by humans. Various defenses have been proposed to improve adversarial robustness, among which adversarial…

机器学习 · 计算机科学 2023-03-30 Wei Wei , Jiahuan Zhou , Ying Wu

Adversarial training is one of the most effective defenses against adversarial attacks, but it incurs a high computational cost. In this study, we present the first theoretical analysis suggesting that adversarially pretrained transformers…

机器学习 · 计算机科学 2026-03-03 Soichiro Kumano , Hiroshi Kera , Toshihiko Yamasaki

Fine-tuning pre-trained language models (LMs) has become the de facto standard in many NLP tasks. Nevertheless, fine-tuned LMs are still prone to robustness issues, such as adversarial robustness and model calibration. Several perspectives…

计算与语言 · 计算机科学 2023-12-08 Jaehyung Kim , Yuning Mao , Rui Hou , Hanchao Yu , Davis Liang , Pascale Fung , Qifan Wang , Fuli Feng , Lifu Huang , Madian Khabsa

We evaluate machine comprehension models' robustness to noise and adversarial attacks by performing novel perturbations at the character, word, and sentence level. We experiment with different amounts of perturbations to examine model…

计算与语言 · 计算机科学 2020-05-04 Winston Wu , Dustin Arendt , Svitlana Volkova

Intentionally crafted adversarial samples have effectively exploited weaknesses in deep neural networks. A standard method in adversarial robustness assumes a framework to defend against samples crafted by minimally perturbing a sample such…

机器学习 · 计算机科学 2022-11-07 Anaelia Ovalle , Evan Czyzycki , Cho-Jui Hsieh

ML-based malware detection on dynamic analysis reports is vulnerable to both evasion and spurious correlations. In this work, we investigate a specific ML architecture employed in the pipeline of a widely-known commercial antivirus company,…

Large-scale language models achieved state-of-the-art performance over a number of language tasks. However, they fail on adversarial language examples, which are sentences optimized to fool the language models but with similar semantic…

计算与语言 · 计算机科学 2023-10-31 Noah Thomas McDermott , Junfeng Yang , Chengzhi Mao

Despite the impressive adaptability of large language models (LLMs), challenges remain in ensuring their security, transparency, and interpretability. Given their susceptibility to adversarial attacks, LLMs need to be defended with an…

人工智能 · 计算机科学 2024-10-11 Tomas Bueno Momcilovic , Beat Buesser , Giulio Zizzo , Mark Purcell , Dian Balta

Fine-tuning pre-trained Vision-Language Models (VLMs) has shown remarkable capabilities in medical image and textual depiction synergy. Nevertheless, many pre-training datasets are restricted by patient privacy concerns, potentially…

计算机视觉与模式识别 · 计算机科学 2025-01-09 Xu Han , Linghao Jin , Xuezhe Ma , Xiaofeng Liu

We attribute the vulnerability of natural language processing models to the fact that similar inputs are converted to dissimilar representations in the embedding space, leading to inconsistent outputs, and we propose a novel robust training…

计算与语言 · 计算机科学 2022-07-28 Yichen Yang , Xiaosen Wang , Kun He

Adversarial training has emerged as an effective approach to train robust neural network models that are resistant to adversarial attacks, even in low-label regimes where labeled data is scarce. In this paper, we introduce a novel…

机器学习 · 计算机科学 2024-11-28 Tian Ye , Rajgopal Kannan , Viktor Prasanna

We investigate the adversarial robustness of LLMs in transfer learning scenarios. Through comprehensive experiments on multiple datasets (MBIB Hate Speech, MBIB Political Bias, MBIB Gender Bias) and various model architectures (BERT,…

计算与语言 · 计算机科学 2025-06-10 Bohdan Turbal , Anastasiia Mazur , Jiaxu Zhao , Mykola Pechenizkiy