中文
相关论文

相关论文: Retrieval-Enhanced Adversarial Training for Neural…

200 篇论文

Reinforcement learning (RL) is an effective approach to learn an optimal dialog policy for task-oriented visual dialog systems. A common practice is to apply RL on a neural sequence-to-sequence (seq2seq) framework with the action space…

计算与语言 · 计算机科学 2019-10-30 Mingyang Zhou , Josh Arnold , Zhou Yu

Lately, the self-attention mechanism has marked a new milestone in the field of automatic speech recognition (ASR). Nevertheless, its performance is susceptible to environmental intrusions as the system predicts the next output symbol…

音频与语音处理 · 电气工程与系统科学 2021-04-06 Lujun Li , Yikai Kang , Yuchen Shi , Ludwig Kürzinger , Tobias Watzel , Gerhard Rigoll

This work presents a thorough review concerning recent studies and text generation advancements using Generative Adversarial Networks. The usage of adversarial learning for text generation is promising as it provides alternatives to…

计算与语言 · 计算机科学 2022-12-22 Gustavo Henrique de Rosa , João Paulo Papa

Retrieval-augmented generation (RAG) for language models significantly improves language understanding systems. The basic retrieval-then-read pipeline of response generation has evolved into a more extended process due to the integration of…

计算与语言 · 计算机科学 2025-04-22 Yunxiao Shi , Xing Zi , Zijing Shi , Haimin Zhang , Qiang Wu , Min Xu

Adversarial training (AT) and its variants have spearheaded progress in improving neural network robustness to adversarial perturbations and common corruptions in the last few years. Algorithm design of AT and its variants are focused on…

机器学习 · 计算机科学 2022-06-15 Kaustubh Sridhar , Souradeep Dutta , Ramneet Kaur , James Weimer , Oleg Sokolsky , Insup Lee

Generative adversarial imitation learning (GAIL) is a model-free algorithm that has been shown to provide strong results in imitating complex behaviors in high-dimensional environments. In this paper, we utilize the GAIL model for text…

计算与语言 · 计算机科学 2021-05-28 Pratyush Muthukumar , Karishma Muthukumar , Deepan Muthirayan , Pramod Khargonekar

Knowledge Tracing (KT) monitors students' knowledge states and simulates their responses to question sequences. Existing KT models typically follow a single-step training paradigm, which leads to discrepancies with the multi-step inference…

机器学习 · 计算机科学 2026-01-06 Lingyue Fu , Ting Long , Jianghao Lin , Wei Xia , Xinyi Dai , Ruiming Tang , Yasheng Wang , Weinan Zhang , Yong Yu

Fine-tuning large-scale pre-trained language models has been demonstrated effective for various natural language processing (NLP) tasks. Previous studies have established that incorporating adversarial training during the fine-tuning stage…

计算与语言 · 计算机科学 2023-06-29 Zhehua Zhong , Tianyi Chen , Zhen Wang

With the emergence of large language models, such as LLaMA and OpenAI GPT-3, In-Context Learning (ICL) gained significant attention due to its effectiveness and efficiency. However, ICL is very sensitive to the choice, order, and verbaliser…

计算与语言 · 计算机科学 2024-10-10 Simon Yu , Jie He , Pasquale Minervini , Jeff Z. Pan

Text generation is a crucial task in NLP. Recently, several adversarial generative models have been proposed to improve the exposure bias problem in text generation. Though these models gain great success, they still suffer from the…

计算与语言 · 计算机科学 2018-06-08 Zhan Shi , Xinchi Chen , Xipeng Qiu , Xuanjing Huang

Generative Adversarial Networks (GANs) have experienced a recent surge in popularity, performing competitively in a variety of tasks, especially in computer vision. However, GAN training has shown limited success in natural language…

计算与语言 · 计算机科学 2019-01-03 David Donahue , Anna Rumshisky

Adversarial training is an effective defense method to protect classification models against adversarial attacks. However, one limitation of this approach is that it can require orders of magnitude additional training time due to high cost…

机器学习 · 计算机科学 2020-07-03 Haizhong Zheng , Ziqi Zhang , Juncheng Gu , Honglak Lee , Atul Prakash

We propose a new method for event extraction (EE) task based on an imitation learning framework, specifically, inverse reinforcement learning (IRL) via generative adversarial network (GAN). The GAN estimates proper rewards according to the…

计算与语言 · 计算机科学 2018-04-24 Tongtao Zhang , Heng Ji

Automatic Essay Scoring (AES) is widely used to evaluate candidates for educational purposes. However, due to the lack of representative data, most existing AES systems are not robust, and their scoring predictions are biased towards the…

计算与语言 · 计算机科学 2024-09-10 Haddad Philip , Tsegaye Misikir Tashu

Real human conversation data are complicated, heterogeneous, and noisy, from which building open-domain dialogue systems remains a challenging task. In fact, such dialogue data still contains a wealth of information and knowledge, however,…

计算与语言 · 计算机科学 2022-09-16 Yihe Wang , Yitong Li , Yasheng Wang , Fei Mi , Pingyi Zhou , Xin Wang , Jin Liu , Xin Jiang , Qun Liu

This paper presents an adversarial learning method for recognition-synthesis based non-parallel voice conversion. A recognizer is used to transform acoustic features into linguistic representations while a synthesizer recovers output…

音频与语音处理 · 电气工程与系统科学 2020-08-07 Jing-Xuan Zhang , Zhen-Hua Ling , Li-Rong Dai

Retrieval-augmented generation (RAG) has emerged to address the knowledge-intensive visual question answering (VQA) task. Current methods mainly employ separate retrieval and generation modules to acquire external knowledge and generate…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Xinwei Long , Zhiyuan Ma , Ermo Hua , Kaiyan Zhang , Biqing Qi , Bowen Zhou

Adversarial distillation (AD) is a knowledge distillation technique that facilitates the transfer of robustness from teacher deep neural network (DNN) models to lightweight target (student) DNN models, enabling the target models to perform…

计算机视觉与模式识别 · 计算机科学 2025-08-26 Zhenyu Liu , Huizhi Liang , Xinrun Li , Vaclav Snasel , Varun Ojha

Recent studies demonstrate that Graph Neural Networks (GNNs) are vulnerable to slight but adversarially designed perturbations, known as adversarial examples. To address this issue, robust training methods against adversarial examples have…

机器学习 · 计算机科学 2022-11-22 Jintang Li , Jiaying Peng , Liang Chen , Zibin Zheng , Tingting Liang , Qing Ling

Generative adversarial networks (GAN) have been effective for learning generative models for real-world data. However, existing GANs (GAN and its variants) tend to suffer from training problems such as instability and mode collapse. In this…

机器学习 · 计算机科学 2018-03-05 Chaoyue Wang , Chang Xu , Xin Yao , Dacheng Tao