English
Related papers

Related papers: Retrieval-Enhanced Adversarial Training for Neural…

200 papers

Deep learning models exhibit a preference for statistical fitting over logical reasoning. Spurious correlations might be memorized when there exists statistical bias in training data, which severely limits the model performance especially…

Machine Learning · Computer Science 2021-09-13 Wei Wang , Boxin Wang , Ning Shi , Jinfeng Li , Bingyu Zhu , Xiangyu Liu , Rong Zhang

Deep neural networks (DNN) have found wide applicability in numerous fields due to their ability to accurately learn very complex input-output relations. Despite their accuracy and extensive use, DNNs are highly susceptible to adversarial…

Machine Learning · Computer Science 2023-08-25 Ali Haisam Muhammad Rafid , Adrian Sandu

Given a textual passage and an answer, humans are able to ask questions with various expressions, but this ability is still challenging for most question generation (QG) systems. Existing solutions mainly focus on the internal knowledge…

Computation and Language · Computer Science 2023-10-24 Qi Gou , Zehua Xia , Bowen Yu , Haiyang Yu , Fei Huang , Yongbin Li , Nguyen Cam-Tu

This paper proposes a classification framework with a rejection option to mitigate the performance deterioration caused by adversarial examples. While recent machine learning algorithms achieve high prediction performance, they are…

Machine Learning · Computer Science 2020-10-27 Masahiro Kato , Zhenghang Cui , Yoshihiro Fukuhara

Autoregressive models recently achieved comparable results versus state-of-the-art Generative Adversarial Networks (GANs) with the help of Vector Quantized Variational AutoEncoders (VQ-VAE). However, autoregressive models have several…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Kenan E. Ak , Ning Xu , Zhe Lin , Yilin Wang

Adversarial training has been proven to be an effective technique for improving the adversarial robustness of models. However, there seems to be an inherent trade-off between optimizing the model for accuracy and robustness. To this end, we…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Elahe Arani , Fahad Sarfraz , Bahram Zonooz

Sound event detection systems are widely used in various applications such as surveillance and environmental monitoring where data is automatically collected, processed, and sent to a cloud for sound recognition. However, this process may…

Sound · Computer Science 2024-01-04 Shayan Gharib , Minh Tran , Diep Luong , Konstantinos Drossos , Tuomas Virtanen

Since the launch of ChatGPT at the end of 2022, generative dialogue models represented by ChatGPT have quickly become essential tools in daily life. As user expectations increase, enhancing the capability of generative dialogue models to…

Computation and Language · Computer Science 2024-09-02 Yuetong Zhao , Hongyu Cao , Xianyu Zhao , Zhijian Ou

Adversarial training has become one of the most effective methods for improving robustness of neural networks. However, it often suffers from poor generalization on both clean and perturbed data. In this paper, we propose a new algorithm,…

Machine Learning · Computer Science 2020-02-19 Minhao Cheng , Qi Lei , Pin-Yu Chen , Inderjit Dhillon , Cho-Jui Hsieh

With the widespread use of machine learning, concerns over its security and reliability have become prevalent. As such, many have developed defenses to harden neural networks against adversarial examples, imperceptibly perturbed inputs that…

Machine Learning · Computer Science 2022-05-09 Pratik Vaishnavi , Kevin Eykholt , Amir Rahmati

Deep neural networks have been shown to perform well in many classical machine learning problems, especially in image classification tasks. However, researchers have found that neural networks can be easily fooled, and they are surprisingly…

Computer Vision and Pattern Recognition · Computer Science 2019-05-24 Huaxia Wang , Chun-Nam Yu

Neural language models show vulnerability to adversarial examples which are semantically similar to their original counterparts with a few words replaced by their synonyms. A common way to improve model robustness is adversarial training…

Computation and Language · Computer Science 2022-03-25 Hanjie Chen , Yangfeng Ji

In this paper, we explore machine translation improvement via Generative Adversarial Network (GAN) architecture. We take inspiration from RelGAN, a model for text generation, and NMT-GAN, an adversarial machine translation model, to…

Computation and Language · Computer Science 2021-12-01 Jay Ahn , Hari Madhu , Viet Nguyen

In this paper, we introduce Reward-RAG, a novel approach designed to enhance the Retrieval-Augmented Generation (RAG) model through Reward-Driven Supervision. Unlike previous RAG methodologies, which focus on training language models (LMs)…

Computation and Language · Computer Science 2024-10-08 Thang Nguyen , Peter Chin , Yu-Wing Tai

Retrieval-Augmented Generation (RAG) systems have recently shown remarkable advancements by integrating retrieval mechanisms into language models, enhancing their ability to produce more accurate and contextually relevant responses.…

Computation and Language · Computer Science 2025-01-14 Siran Li , Linus Stenzel , Carsten Eickhoff , Seyed Ali Bahrainian

Neural network models are vulnerable to adversarial examples, and adversarial transferability further increases the risk of adversarial attacks. Current methods based on transferability often rely on substitute models, which can be…

Computation and Language · Computer Science 2023-11-07 Minxuan Lv , Chengwei Dai , Kun Li , Wei Zhou , Songlin Hu

Despite extensive diagnostics and debugging by developers, AI systems sometimes exhibit harmful unintended behaviors. Finding and fixing these is challenging because the attack surface is so large -- it is not tractable to exhaustively…

Cryptography and Security · Computer Science 2025-07-30 Stephen Casper , Lennart Schulze , Oam Patel , Dylan Hadfield-Menell

Open-domain neural dialogue models have achieved high performance in response ranking and evaluation tasks. These tasks are formulated as a binary classification of responses given in a dialogue context, and models generally learn to make…

Computation and Language · Computer Science 2021-06-11 Prakhar Gupta , Yulia Tsvetkov , Jeffrey P. Bigham

Domain Adaptation arises when we aim at learning from source domain a model that can per- form acceptably well on a different target domain. It is especially crucial for Natural Language Generation (NLG) in Spoken Dialogue Systems when…

Computation and Language · Computer Science 2018-08-09 Van-Khanh Tran , Le-Minh Nguyen

Adversarial examples are helpful for analyzing and improving the robustness of text classifiers. Generating high-quality adversarial examples is a challenging task as it requires generating fluent adversarial sentences that are semantically…

Computation and Language · Computer Science 2022-10-21 Lei Xu , Alfredo Cuesta-Infante , Laure Berti-Equille , Kalyan Veeramachaneni