中文
相关论文

相关论文: Context-aware Adversarial Attack on Named Entity R…

200 篇论文

Adversarial examples expose the vulnerabilities of natural language processing (NLP) models, and can be used to evaluate and improve their robustness. Existing techniques of generating such examples are typically driven by local heuristic…

计算与语言 · 计算机科学 2021-03-16 Dianqi Li , Yizhe Zhang , Hao Peng , Liqun Chen , Chris Brockett , Ming-Ting Sun , Bill Dolan

Generating high-quality textual adversarial examples is critical for investigating the pitfalls of natural language processing (NLP) models and further promoting their robustness. Existing attacks are usually realized through word-level or…

计算与语言 · 计算机科学 2022-05-25 Yibin Lei , Yu Cao , Dianqi Li , Tianyi Zhou , Meng Fang , Mykola Pechenizkiy

To guarantee safe and robust deployment of large language models (LLMs) at scale, it is critical to accurately assess their adversarial robustness. Existing adversarial attacks typically target harmful responses in single-point greedy…

机器学习 · 计算机科学 2026-02-24 Tim Beyer , Yan Scholten , Leo Schwinn , Stephan Günnemann

Deep learning based systems are susceptible to adversarial attacks, where a small, imperceptible change at the input alters the model prediction. However, to date the majority of the approaches to detect these attacks have been designed for…

计算与语言 · 计算机科学 2022-09-27 Vyas Raina , Mark Gales

Building an effective adversarial attacker and elaborating on countermeasures for adversarial attacks for natural language processing (NLP) have attracted a lot of research in recent years. However, most of the existing approaches focus on…

计算与语言 · 计算机科学 2020-10-20 Wenjuan Han , Liwen Zhang , Yong Jiang , Kewei Tu

Adversarial attacks are a major challenge faced by current machine learning research. These purposely crafted inputs fool even the most advanced models, precluding their deployment in safety-critical applications. Extensive research in…

人工智能 · 计算机科学 2023-06-30 Edoardo Mosca , Shreyash Agarwal , Javier Rando , Georg Groh

Recent work has shown the importance of adaptation of broad-coverage contextualised embedding models on the domain of the target task of interest. Current self-supervised adaptation methods are simplistic, as the training signal comes from…

计算与语言 · 计算机科学 2020-10-06 Thuy-Trang Vu , Dinh Phung , Gholamreza Haffari

Machine learning systems based on deep neural networks, being able to produce state-of-the-art results on various perception tasks, have gained mainstream adoption in many applications. However, they are shown to be vulnerable to…

机器学习 · 计算机科学 2018-01-16 Bo Luo , Yannan Liu , Lingxiao Wei , Qiang Xu

The integration of Large Language Models (LLMs) into healthcare applications offers promising advancements in medical diagnostics, treatment recommendations, and patient care. However, the susceptibility of LLMs to adversarial attacks poses…

人工智能 · 计算机科学 2024-12-18 Yifan Yang , Qiao Jin , Furong Huang , Zhiyong Lu

The surge of state-of-the-art Transformer-based models has undoubtedly pushed the limits of NLP model performance, excelling in a variety of tasks. We cast the spotlight on the underexplored task of Natural Language Inference (NLI), since…

计算与语言 · 计算机科学 2025-08-04 Alexandros Koulakos , Maria Lymperaiou , Giorgos Filandrianos , Giorgos Stamou

Membership Inference Attacks (MIAs) on pre-trained Large Language Models (LLMs) aim at determining if a data point was part of the model's training set. Prior MIAs that are built for classification models fail at LLMs, due to ignoring the…

计算与语言 · 计算机科学 2025-09-17 Hongyan Chang , Ali Shahin Shamsabadi , Kleomenis Katevas , Hamed Haddadi , Reza Shokri

With the development of high computational devices, deep neural networks (DNNs), in recent years, have gained significant popularity in many Artificial Intelligence (AI) applications. However, previous efforts have shown that DNNs were…

计算与语言 · 计算机科学 2019-04-12 Wei Emma Zhang , Quan Z. Sheng , Ahoud Alhazmi , Chenliang Li

Transformer-based pre-trained models of code (PTMC) have been widely utilized and have achieved state-of-the-art performance in many mission-critical applications. However, they can be vulnerable to adversarial attacks through identifier…

密码学与安全 · 计算机科学 2023-11-27 Xiaohu Du , Ming Wen , Zichao Wei , Shangwen Wang , Hai Jin

Neural language models (LM) trained on diverse corpora are known to work well on previously seen entities, however, updating these models with dynamically changing entities such as place names, song titles and shopping items requires…

计算与语言 · 计算机科学 2021-09-16 Ravi Teja Gadde , Ivan Bulyko

Vision systems that deploy Deep Neural Networks (DNNs) are known to be vulnerable to adversarial examples. Recent research has shown that checking the intrinsic consistencies in the input data is a promising way to detect adversarial…

计算机视觉与模式识别 · 计算机科学 2021-08-20 Mingjun Yin , Shasha Li , Zikui Cai , Chengyu Song , M. Salman Asif , Amit K. Roy-Chowdhury , Srikanth V. Krishnamurthy

Recent years have seen the wide application of NLP models in crucial areas such as finance, medical treatment, and news media, raising concerns of the model robustness and vulnerabilities. In this paper, we propose a novel prompt-based…

计算与语言 · 计算机科学 2022-03-22 Yuting Yang , Pei Huang , Juan Cao , Jintao Li , Yun Lin , Jin Song Dong , Feifei Ma , Jian Zhang

An adversarial attack paradigm explores various scenarios for the vulnerability of deep learning models: minor changes of the input can force a model failure. Most of the state of the art frameworks focus on adversarial attacks for images…

机器学习 · 计算机科学 2020-06-22 I. Fursov , A. Zaytsev , N. Kluchnikov , A. Kravchenko , E. Burnaev

An adversarial attack is an exploitative process in which minute alterations are made to natural inputs, causing the inputs to be misclassified by neural models. In the field of speech recognition, this has become an issue of increasing…

声音 · 计算机科学 2018-09-13 Krishan Rajaratnam , Kunal Shah , Jugal Kalita

Large Language Models (LLMs), characterized by being trained on broad amounts of data in a self-supervised manner, have shown impressive performance across a wide range of tasks. Indeed, their generative abilities have aroused interest on…

机器学习 · 计算机科学 2024-07-30 Jorge García-Carrasco , Alejandro Maté , Juan Trujillo

In recent years, Large Language Models (LLM) have emerged as pivotal tools in various applications. However, these models are susceptible to adversarial prompt attacks, where attackers can carefully curate input strings that mislead LLMs…

计算与语言 · 计算机科学 2024-02-20 Zhengmian Hu , Gang Wu , Saayan Mitra , Ruiyi Zhang , Tong Sun , Heng Huang , Viswanathan Swaminathan