English
Related papers

Related papers: Adversarial Mutual Information for Text Generation

200 papers

Adversarial examples tremendously threaten the availability and integrity of machine learning-based systems. While the feasibility of such attacks has been observed first in the domain of image processing, recent research shows that speech…

Sound · Computer Science 2020-10-15 Tom Dörr , Karla Markert , Nicolas M. Müller , Konstantin Böttinger

Generative Adversarial Networks (GANs) have been studied in text generation to tackle the exposure bias problem. Despite their remarkable development, they adopt autoregressive structures so suffering from high latency in both training and…

Computation and Language · Computer Science 2024-10-03 Da Ren , Yi Cai , Qing Li

Adversarial attacks constitute a notable threat to machine learning systems, given their potential to induce erroneous predictions and classifications. However, within real-world contexts, the essential specifics of the deployed model are…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Jingwen Ye , Ruonan Yu , Songhua Liu , Xinchao Wang

Recently, token-level adaptive training has achieved promising improvement in machine translation, where the cross-entropy loss function is adjusted by assigning different training weights to different tokens, in order to alleviate the…

Computation and Language · Computer Science 2021-05-28 Yangyifan Xu , Yijin Liu , Fandong Meng , Jiajun Zhang , Jinan Xu , Jie Zhou

We propose an information-theoretic knowledge distillation approach for the compression of generative adversarial networks, which aims to maximize the mutual information between teacher and student networks via a variational optimization…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Minsoo Kang , Hyewon Yoo , Eunhee Kang , Sehwan Ki , Hyong-Euk Lee , Bohyung Han

Adversarial examples causing evasive predictions are widely used to evaluate and improve the robustness of machine learning models. However, current studies focus on supervised learning tasks, relying on the ground-truth data label, a…

Machine Learning · Computer Science 2021-12-09 Chia-Yi Hsu , Pin-Yu Chen , Songtao Lu , Sijia Liu , Chia-Mu Yu

Multimodal learning involves developing models that can integrate information from various sources like images and texts. In this field, multimodal text generation is a crucial aspect that involves processing data from multiple modalities…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Youze Wang , Wenbo Hu , Richang Hong

Automatically generating coherent and semantically meaningful text has many applications in machine translation, dialogue systems, image captioning, etc. Recently, by combining with policy gradient, Generative Adversarial Nets (GAN) that…

Computation and Language · Computer Science 2017-12-11 Jiaxian Guo , Sidi Lu , Han Cai , Weinan Zhang , Yong Yu , Jun Wang

In the age of advanced large language models (LLMs), the boundaries between human and AI-generated text are becoming increasingly blurred. We address the challenge of segmenting mixed-authorship text, that is identifying transition points…

Computation and Language · Computer Science 2026-01-06 L. D. M. S. Sai Teja , N. Siva Gopala Krishna , Ufaq Khan , Muhammad Haris Khan , Atul Mishra

AI creation, such as poem or lyrics generation, has attracted increasing attention from both industry and academic communities, with many promising models proposed in the past few years. Existing methods usually estimate the outputs based…

Artificial Intelligence · Computer Science 2024-09-05 Qian Cao , Xu Chen , Ruihua Song , Hao Jiang , Guang Yang , Zhao Cao

Recent advances in large language models (LLMs) have revolutionized natural language processing, yet evaluating their intrinsic linguistic understanding remains challenging. Moving beyond specialized evaluation tasks, we propose an…

Computation and Language · Computer Science 2025-06-02 Shaojie Wang , Sirui Ding , Na Zou

Adversarial examples are helpful for analyzing and improving the robustness of text classifiers. Generating high-quality adversarial examples is a challenging task as it requires generating fluent adversarial sentences that are semantically…

Computation and Language · Computer Science 2022-10-21 Lei Xu , Alfredo Cuesta-Infante , Laure Berti-Equille , Kalyan Veeramachaneni

Generative Adversarial Networks (GAN) is a model for data synthesis, which creates plausible data through the competition of generator and discriminator. Although GAN application to image synthesis is extensively studied, it has inherent…

Computation and Language · Computer Science 2025-01-07 Jun-Min Lee , Tae-Bin Ha

With the advent of generative adversarial networks, synthesizing images from textual descriptions has recently become an active research area. It is a flexible and intuitive way for conditional image generation with significant progress in…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Stanislav Frolov , Tobias Hinz , Federico Raue , Jörn Hees , Andreas Dengel

Generative Adversarial Networks have been shown to be powerful in generating content. To this end, they have been studied intensively in the last few years. Nonetheless, training these networks requires solving a saddle point problem that…

Machine Learning · Computer Science 2019-10-09 Jingrong Lin , Keegan Lensink , Eldad Haber

Focusing on text-to-image (T2I) generation, we propose Text and Image Mutual-Translation Adversarial Networks (TIME), a lightweight but effective model that jointly learns a T2I generator G and an image captioning discriminator D under the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Bingchen Liu , Kunpeng Song , Yizhe Zhu , Gerard de Melo , Ahmed Elgammal

The autoregressive language model (ALM) trained with maximum likelihood estimation (MLE) is widely used in unconditional text generation. Due to exposure bias, the generated texts still suffer from low quality and diversity. This presents…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Xingyuan Chen , Ping Cai , Peng Jin , Hongjun Wang , Xinyu Dai , Jiajun Chen

In the context of generative models, text-to-image generation achieved impressive results in recent years. Models using different approaches were proposed and trained in huge datasets of pairs of texts and images. However, some methods rely…

Neural and Evolutionary Computing · Computer Science 2022-07-08 Victor Costa , Nuno Lourenço , João Correia , Penousal Machado

Although many pretrained models exist for text or images, there have been relatively fewer attempts to train representations specifically for dialog understanding. Prior works usually relied on finetuned representations based on generic…

Computation and Language · Computer Science 2022-05-04 Bishal Santra , Sumegh Roychowdhury , Aishik Mandal , Vasu Gurram , Atharva Naik , Manish Gupta , Pawan Goyal

Despite the rapid development of adversarial machine learning, most adversarial attack and defense researches mainly focus on the perturbation-based adversarial examples, which is constrained by the input images. In comparison with existing…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Xiaosen Wang , Kun He , Chuanbiao Song , Liwei Wang , John E. Hopcroft