中文
相关论文

相关论文: "That Is a Suspicious Reaction!": Interpreting Log…

200 篇论文

Deep neural networks are at the forefront of machine learning research. However, despite achieving impressive performance on complex tasks, they can be very sensitive: Small perturbations of inputs can be sufficient to induce incorrect…

计算机视觉与模式识别 · 计算机科学 2020-09-04 Alex Serban , Erik Poll , Joost Visser

Adversarial attacks on machine learning models often rely on small, imperceptible perturbations to mislead classifiers. Such strategy focuses on minimizing the visual perturbation for humans so they are not confused, and also maximizing the…

计算机视觉与模式识别 · 计算机科学 2025-02-28 Anthony Etim , Jakub Szefer

Warning: this paper contains content that maybe offensive or upsetting. Recent research in Natural Language Processing (NLP) has advanced the development of various toxicity detection models with the intention of identifying and mitigating…

计算与语言 · 计算机科学 2022-05-06 Ninareh Mehrabi , Ahmad Beirami , Fred Morstatter , Aram Galstyan

Neural networks are vulnerable to adversarial attacks -- small visually imperceptible crafted noise which when added to the input drastically changes the output. The most effective method of defending against these adversarial attacks is to…

Machine learning and deep learning in particular has advanced tremendously on perceptual tasks in recent years. However, it remains vulnerable against adversarial perturbations of the input that have been crafted specifically to fool the…

机器学习 · 统计学 2017-02-22 Jan Hendrik Metzen , Tim Genewein , Volker Fischer , Bastian Bischoff

An ever-growing body of work has demonstrated the rich information content available in eye movements for user modelling, e.g. for predicting users' activities, cognitive processes, or even personality traits. We show that state-of-the-art…

密码学与安全 · 计算机科学 2020-06-02 Inken Hagestedt , Michael Backes , Andreas Bulling

Despite the great progress of neural network-based (NN-based) machinery fault diagnosis methods, their robustness has been largely neglected, for they can be easily fooled through adding imperceptible perturbation to the input. For fault…

密码学与安全 · 计算机科学 2022-03-11 Jiahao Chen , Diqun Yan

Neural Machine Translation (NMT) models have been shown to be vulnerable to adversarial attacks, wherein carefully crafted perturbations of the input can mislead the target model. In this paper, we introduce ACT, a novel adversarial attack…

计算与语言 · 计算机科学 2024-02-23 Sahar Sadrizadeh , Ljiljana Dolamic , Pascal Frossard

Deep Neural Networks are well known to be vulnerable to adversarial attacks and backdoor attacks, where minor modifications on the input are able to mislead the models to give wrong results. Although defenses against adversarial attacks…

机器学习 · 计算机科学 2022-08-01 Kaidi Jin , Tianwei Zhang , Chao Shen , Yufei Chen , Ming Fan , Chenhao Lin , Ting Liu

The frustratingly fragile nature of neural network models make current natural language generation (NLG) systems prone to backdoor attacks and generate malicious sequences that could be sexist or offensive. Unfortunately, little effort has…

计算与语言 · 计算机科学 2023-10-10 Xiaofei Sun , Xiaoya Li , Yuxian Meng , Xiang Ao , Lingjuan Lyu , Jiwei Li , Tianwei Zhang

The prevalence and strong capability of large language models (LLMs) present significant safety and ethical risks if exploited by malicious users. To prevent the potentially deceptive usage of LLMs, recent works have proposed algorithms to…

计算与语言 · 计算机科学 2023-10-20 Zhouxing Shi , Yihan Wang , Fan Yin , Xiangning Chen , Kai-Wei Chang , Cho-Jui Hsieh

Deep neural networks (DNNs) have achieved remarkable success in the field of natural language processing (NLP), leading to widely recognized applications such as ChatGPT. However, the vulnerability of these models to adversarial attacks…

人工智能 · 计算机科学 2025-02-25 Yangshijie Zhang

Neural networks are vulnerable to adversarially-constructed perturbations of their inputs. Most research so far has considered perturbations of a fixed magnitude under some $l_p$ norm. Although studying these attacks is valuable, there has…

机器学习 · 计算机科学 2019-10-02 Isaac Dunn , Hadrien Pouget , Tom Melham , Daniel Kroening

As powerful Large Language Models (LLMs) are now widely used for numerous practical applications, their safety is of critical importance. While alignment techniques have significantly improved overall safety, LLMs remain vulnerable to…

机器学习 · 计算机科学 2024-10-28 Samuel Jacob Chacko , Sajib Biswas , Chashi Mahiul Islam , Fatema Tabassum Liza , Xiuwen Liu

Pre-trained language models have achieved remarkable success across a wide range of natural language processing (NLP) tasks, particularly when fine-tuned on large, domain-relevant datasets. However, they remain vulnerable to backdoor…

计算与语言 · 计算机科学 2026-02-02 Anindya Sundar Das , Kangjie Chen , Monowar Bhuyan

While recent works have been considerably improving the quality of the natural language explanations (NLEs) generated by a model to justify its predictions, there is very limited research in detecting and alleviating inconsistencies among…

Adversarial attacks expose vulnerabilities of deep learning models by introducing minor perturbations to the input, which lead to substantial alterations in the output. Our research focuses on the impact of such adversarial attacks on…

计算与语言 · 计算机科学 2023-09-14 Pavel Burnyshev , Elizaveta Kostenok , Alexey Zaytsev

Textual adversarial samples play important roles in multiple subfields of NLP research, including security, evaluation, explainability, and data augmentation. However, most work mixes all these roles, obscuring the problem definitions and…

计算与语言 · 计算机科学 2022-10-20 Yangyi Chen , Hongcheng Gao , Ganqu Cui , Fanchao Qi , Longtao Huang , Zhiyuan Liu , Maosong Sun

Recent studies show that neural natural language processing (NLP) models are vulnerable to backdoor attacks. Injected with backdoors, models perform normally on benign examples but produce attacker-specified predictions when the backdoor is…

计算与语言 · 计算机科学 2021-06-14 Fanchao Qi , Yuan Yao , Sophia Xu , Zhiyuan Liu , Maosong Sun

Research of adversarial attacks is important for AI security because it shows the vulnerability of deep learning models and helps to build more robust models. Adversarial attacks on images are most widely studied, which include noise-based…

密码学与安全 · 计算机科学 2024-10-14 Xiaopei Zhu , Peiyang Xu , Guanning Zeng , Yingpeng Dong , Xiaolin Hu