English
Related papers

Related papers: Human-in-the-Loop Generation of Adversarial Texts:…

200 papers

Dialogue systems are usually built on either generation-based or retrieval-based approaches, yet they do not benefit from the advantages of different models. In this paper, we propose a Retrieval-Enhanced Adversarial Training (REAT) method…

Computation and Language · Computer Science 2019-05-24 Qingfu Zhu , Lei Cui , Weinan Zhang , Furu Wei , Ting Liu

Training generative models that can generate high-quality text with sufficient diversity is an important open problem for Natural Language Generation (NLG) community. Recently, generative adversarial models have been applied extensively on…

Computation and Language · Computer Science 2020-03-26 Haiyan Yin , Dingcheng Li , Xu Li , Ping Li

Robustness evaluation against adversarial examples has become increasingly important to unveil the trustworthiness of the prevailing deep models in natural language processing (NLP). However, in contrast to the computer vision domain where…

Computation and Language · Computer Science 2022-12-20 Bairu Hou , Jinghan Jia , Yihua Zhang , Guanhua Zhang , Yang Zhang , Sijia Liu , Shiyu Chang

Adversarial attacks are major threats to the deployment of machine learning (ML) models in many applications. Testing ML models against such attacks is becoming an essential step for evaluating and improving ML models. In this paper, we…

Cryptography and Security · Computer Science 2024-10-10 Yuanzhe Jin , Min Chen

Machine generated text is increasingly difficult to distinguish from human authored text. Powerful open-source models are freely available, and user-friendly tools that democratize access to generative models are proliferating. ChatGPT,…

Computation and Language · Computer Science 2023-05-09 Evan Crothers , Nathalie Japkowicz , Herna Viktor

The fine-tuning of pre-trained language models has a great success in many NLP fields. Yet, it is strikingly vulnerable to adversarial examples, e.g., word substitution attacks using only synonyms can easily fool a BERT-based sentiment…

Computation and Language · Computer Science 2021-12-23 Xinhsuai Dong , Luu Anh Tuan , Min Lin , Shuicheng Yan , Hanwang Zhang

In retrieval-based dialogue systems, a response selection model acts as a ranker to select the most appropriate response among several candidates. However, such selection models tend to rely on context-response content similarity, which…

Computation and Language · Computer Science 2022-11-01 Nyoungwoo Lee , ChaeHun Park , Ho-Jin Choi , Jaegul Choo

Recent advancements in Generative AI and Large Language Models (LLMs) have enabled the creation of highly realistic synthetic content, raising concerns about the potential for malicious use, such as misinformation and manipulation.…

Computation and Language · Computer Science 2025-06-02 Andrea Pedrotti , Michele Papucci , Cristiano Ciaccio , Alessio Miaschi , Giovanni Puccetti , Felice Dell'Orletta , Andrea Esuli

Adversarial attacks are a major challenge faced by current machine learning research. These purposely crafted inputs fool even the most advanced models, precluding their deployment in safety-critical applications. Extensive research in…

Artificial Intelligence · Computer Science 2023-06-30 Edoardo Mosca , Shreyash Agarwal , Javier Rando , Georg Groh

Neural network models are vulnerable to adversarial examples, and adversarial transferability further increases the risk of adversarial attacks. Current methods based on transferability often rely on substitute models, which can be…

Computation and Language · Computer Science 2023-11-07 Minxuan Lv , Chengwei Dai , Kun Li , Wei Zhou , Songlin Hu

Although pre-trained language models (PrLMs) have achieved significant success, recent studies demonstrate that PrLMs are vulnerable to adversarial attacks. By generating adversarial examples with slight perturbations on different levels…

Computation and Language · Computer Science 2022-08-23 Jiayi Wang , Rongzhou Bao , Zhuosheng Zhang , Hai Zhao

Recent works have illustrated that modern NLP models trained for diverse tasks ranging from sentiment analysis to language generation succumb to universal adversarial attacks, a class of input-agnostic attacks where a common trigger…

Computation and Language · Computer Science 2026-05-19 Benedict Florance Arockiaraj , Alexander Feng , Jianxiong Cai , Xiaoyu Cheng

Neural networks (NN) classification models for Natural Language Processing (NLP) are vulnerable to the Universal Adversarial Triggers (UAT) attack that triggers a model to produce a specific prediction for any input. DARCY borrows the…

Computation and Language · Computer Science 2024-09-06 Zuquan Peng , Yuanyuan He , Jianbing Ni , Ben Niu

Adversarial training for LLMs is one of the most promising methods to reliably improve robustness against adversaries. However, despite significant progress, models remain vulnerable to simple in-distribution exploits, such as rewriting…

Machine Learning · Computer Science 2026-02-19 Chengzhi Hu , Jonas Dornbusch , David Lüdke , Stephan Günnemann , Leo Schwinn

Adversarial attacks and backdoor attacks are two common security threats that hang over deep learning. Both of them harness task-irrelevant features of data in their implementation. Text style is a feature that is naturally irrelevant to…

Computation and Language · Computer Science 2021-10-15 Fanchao Qi , Yangyi Chen , Xurui Zhang , Mukai Li , Zhiyuan Liu , Maosong Sun

Adversarial attacks pose significant challenges to deep neural networks (DNNs) such as Transformer models in natural language processing (NLP). This paper introduces a novel defense strategy, called GenFighter, which enhances adversarial…

Machine Learning · Computer Science 2024-04-18 Md Athikul Islam , Edoardo Serra , Sushil Jajodia

Text generation is the automated process of producing written or spoken language using computational methods. It involves generating coherent and contextually relevant text based on predefined rules or learned patterns. However, challenges…

Computation and Language · Computer Science 2025-01-30 Rahimanuddin Shaik , Katikela Sreeharsha Kishore

Despite recent success on various tasks, deep learning techniques still perform poorly on adversarial examples with small perturbations. While optimization-based methods for adversarial attacks are well-explored in the field of computer…

Computation and Language · Computer Science 2023-06-09 Lifan Yuan , Yichi Zhang , Yangyi Chen , Wei Wei

A Human-in-the-Loop (HITL) approach leverages generative AI to enhance personalized learning by directly integrating student feedback into AI-generated solutions. Students critique and modify AI responses using predefined feedback tags,…

Human-Computer Interaction · Computer Science 2025-08-18 Bhavishya Tarun , Haoze Du , Dinesh Kannan , Edward F. Gehringer

The surge of state-of-the-art Transformer-based models has undoubtedly pushed the limits of NLP model performance, excelling in a variety of tasks. We cast the spotlight on the underexplored task of Natural Language Inference (NLI), since…

Computation and Language · Computer Science 2025-08-04 Alexandros Koulakos , Maria Lymperaiou , Giorgos Filandrianos , Giorgos Stamou