中文
相关论文

相关论文: BERT Lost Patience Won't Be Robust to Adversarial …

200 篇论文

Inspired by the success of self attention mechanism and Transformer architecture in sequence transduction and image generation applications, we propose novel self attention-based architectures to improve the performance of adversarial…

计算与语言 · 计算机科学 2020-04-21 Jules Gagnon-Marchand , Hamed Sadeghi , Md. Akmal Haidar , Mehdi Rezagholizadeh

Recently, adversarial training has been incorporated in self-supervised contrastive pre-training to augment label efficiency with exciting adversarial robustness. However, the robustness came at a cost of expensive adversarial training. In…

机器学习 · 计算机科学 2022-11-01 Yijiang Pang , Boyang Liu , Jiayu Zhou

Adversarial training has been actively studied in recent computer vision research to improve the robustness of models. However, due to the huge computational cost of generating adversarial samples, adversarial training methods are often…

计算机视觉与模式识别 · 计算机科学 2022-11-22 Yihan Wu , Xinda Li , Florian Kerschbaum , Heng Huang , Hongyang Zhang

Large Language Models (LLMs) have become vital tools in software development tasks such as code generation, completion, and analysis. As their integration into workflows deepens, ensuring robustness against vulnerabilities especially those…

软件工程 · 计算机科学 2025-07-21 Yang Liu , Armstrong Foundjem , Foutse Khomh , Heng Li

Robustness of deep learning models is a property that has recently gained increasing attention. We explore a notion of robustness for generative adversarial models that is pertinent to their internal interactive structure, and show that,…

机器学习 · 计算机科学 2019-10-11 Zhi Xu , Chengtao Li , Stefanie Jegelka

We present FireBERT, a set of three proof-of-concept NLP classifiers hardened against TextFooler-style word-perturbation by producing diverse alternatives to original samples. In one approach, we co-tune BERT against the training data and…

计算与语言 · 计算机科学 2020-08-11 Gunnar Mein , Kevin Hartman , Andrew Morris

In this paper, we experimentally analyze the robustness of selected Federated Learning (FL) systems in the presence of adversarial clients. We find that temporal attacks significantly affect model performance in the FL models tested,…

机器学习 · 计算机科学 2025-01-22 Rohit Mapakshi , Sayma Akther , Mark Stamp

Sensitivity of deep-neural models to input noise is known to be a challenging problem. In NLP, model performance often deteriorates with naturally occurring noise, such as spelling errors. To mitigate this issue, models may leverage…

计算与语言 · 计算机科学 2021-11-18 Jakub Náplava , Martin Popel , Milan Straka , Jana Straková

Transformer-based pre-trained models of code (PTMC) have been widely utilized and have achieved state-of-the-art performance in many mission-critical applications. However, they can be vulnerable to adversarial attacks through identifier…

密码学与安全 · 计算机科学 2023-11-27 Xiaohu Du , Ming Wen , Zichao Wei , Shangwen Wang , Hai Jin

While Large Language Models (LLMs) have achieved tremendous success in various applications, they are also susceptible to jailbreaking attacks. Several primary defense strategies have been proposed to protect LLMs from producing harmful…

机器学习 · 计算机科学 2024-11-01 Yichuan Mo , Yuji Wang , Zeming Wei , Yisen Wang

Deep Neural Networks have taken Natural Language Processing by storm. While this led to incredible improvements across many tasks, it also initiated a new research field, questioning the robustness of these neural networks by attacking…

计算与语言 · 计算机科学 2021-09-16 Jens Hauser , Zhao Meng , Damián Pascual , Roger Wattenhofer

The vulnerability of deep neural networks (DNNs) to adversarial examples has attracted great attention in the machine learning community. The problem is related to non-flatness and non-smoothness of normally obtained loss landscapes.…

机器学习 · 计算机科学 2023-02-13 Qizhang Li , Yiwen Guo , Wangmeng Zuo , Hao Chen

Large Language Models (LLMs) have shown exceptional results on current benchmarks when working individually. The advancement in their capabilities, along with a reduction in parameter size and inference times, has facilitated the use of…

计算与语言 · 计算机科学 2024-06-27 Alfonso Amayuelas , Xianjun Yang , Antonis Antoniades , Wenyue Hua , Liangming Pan , William Wang

Word-level adversarial attacks have shown success in NLP models, drastically decreasing the performance of transformer-based models in recent years. As a countermeasure, adversarial defense has been explored, but relatively few efforts have…

计算与语言 · 计算机科学 2022-03-04 KiYoon Yoo , Jangho Kim , Jiho Jang , Nojun Kwak

The detection of offensive language in the context of a dialogue has become an increasingly important application of natural language processing. The detection of trolls in public forums (Gal\'an-Garc\'ia et al., 2016), and the deployment…

计算与语言 · 计算机科学 2019-08-20 Emily Dinan , Samuel Humeau , Bharath Chintagunta , Jason Weston

The growing cybersecurity threats make it essential to use high-quality data to train Machine Learning (ML) models for network traffic analysis, without noisy or missing data. By selecting the most relevant features for cyber-attack…

密码学与安全 · 计算机科学 2024-07-09 João Vitorino , Miguel Silva , Eva Maia , Isabel Praça

The widespread adoption of deep neural networks in computer vision applications has brought forth a significant interest in adversarial robustness. Existing research has shown that maliciously perturbed inputs specifically tailored for a…

机器学习 · 计算机科学 2022-09-16 Alexander Cann , Ian Colbert , Ihab Amer

Recent studies have found that removing the norm-bounded projection and increasing search steps in adversarial training can significantly improve robustness. However, we observe that a too large number of search steps can hurt accuracy. We…

计算与语言 · 计算机科学 2022-04-29 Bin Zhu , Zhaoquan Gu , Le Wang , Jinyin Chen , Qi Xuan

There exists a vast number of adversarial attacks and defences for machine learning algorithms of various types which makes assessing the robustness of algorithms a daunting task. To make matters worse, there is an intrinsic bias in these…

机器学习 · 计算机科学 2020-07-17 Shashank Kotyan , Danilo Vasconcellos Vargas

Recent studies have shown that modern deep neural network classifiers are easy to fool, assuming that an adversary is able to slightly modify their inputs. Many papers have proposed adversarial attacks, defenses and methods to measure…

机器学习 · 计算机科学 2020-03-17 Igor Buzhinsky , Arseny Nerinovsky , Stavros Tripakis