English
Related papers

Related papers: Adversarial Text-to-Image Synthesis: A Review

200 papers

Gatys et al. (2015) showed that optimizing pixels to match features in a convolutional network with respect reference image features is a way to render images of high visual quality. We show that unrolling this gradient-based optimization…

Machine Learning · Computer Science 2016-12-14 Daniel Jiwoong Im , Chris Dongjoo Kim , Hui Jiang , Roland Memisevic

Generative adversarial networks (GANs) and other adversarial methods are based on a game-theoretical perspective on joint optimization of two neural networks as players in a game. Adversarial techniques have been extensively used to…

Computer Vision and Pattern Recognition · Computer Science 2018-10-25 Jelmer M. Wolterink , Konstantinos Kamnitsas , Christian Ledig , Ivana Išgum

In this paper, we propose a novel controllable text-to-image generative adversarial network (ControlGAN), which can effectively synthesise high-quality images and also control parts of the image generation according to natural language…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Bowen Li , Xiaojuan Qi , Thomas Lukasiewicz , Philip H. S. Torr

As a sub-domain of text-to-image synthesis, text-to-face generation has huge potentials in public safety domain. With lack of dataset, there are almost no related research focusing on text-to-face synthesis. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Xiang Chen , Lingbo Qing , Xiaohai He , Xiaodong Luo , Yining Xu

We propose a novel lightweight generative adversarial network for efficient image manipulation using natural language descriptions. To achieve this, a new word-level discriminator is proposed, which provides the generator with fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Bowen Li , Xiaojuan Qi , Philip H. S. Torr , Thomas Lukasiewicz

In this paper, we propose Text2Scene, a model that generates various forms of compositional scene representations from natural language descriptions. Unlike recent works, our method does NOT use Generative Adversarial Networks (GANs).…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Fuwen Tan , Song Feng , Vicente Ordonez

Generative adversarial networks (GANs) have shown considerable success, especially in the realistic generation of images. In this work, we apply similar techniques for the generation of text. We propose a novel approach to handle the…

Computation and Language · Computer Science 2019-04-05 Akshay Budhkar , Krishnapriya Vishnubhotla , Safwan Hossain , Frank Rudzicz

We propose a novel end-to-end semi-supervised adversarial framework to generate photorealistic face images of new identities with wide ranges of expressions, poses, and illuminations conditioned by a 3D morphable model. Previous adversarial…

Computer Vision and Pattern Recognition · Computer Science 2020-09-09 Baris Gecer , Binod Bhattarai , Josef Kittler , Tae-Kyun Kim

Generative Adversarial Networks (GAN) have greatly influenced the development of computer vision and artificial intelligence in the past decade and also connected art and machine intelligence together. This book begins with a detailed…

Generative adversarial networks (GANs) are a hot research topic recently. GANs have been widely studied since 2014, and a large number of algorithms have been proposed. However, there is few comprehensive study explaining the connections…

Machine Learning · Computer Science 2020-01-22 Jie Gui , Zhenan Sun , Yonggang Wen , Dacheng Tao , Jieping Ye

Adversarial examples pose a significant challenge to deep neural networks (DNNs) across both image and text domains, with the intent to degrade model performance through meticulously altered inputs. Adversarial texts, however, are distinct…

Machine Learning · Computer Science 2025-01-24 Shakila Mahjabin Tonni , Pedro Faustini , Mark Dras

In this paper, we propose a novel conditional-generative-adversarial-nets-based image captioning framework as an extension of traditional reinforcement-learning (RL)-based encoder-decoder architecture. To deal with the inconsistent…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Chen Chen , Shuai Mu , Wanpeng Xiao , Zexiong Ye , Liesi Wu , Qi Ju

Neural Image Classifiers are effective but inherently hard to interpret and susceptible to adversarial attacks. Solutions to both problems exist, among others, in the form of counterfactual examples generation to enhance explainability or…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Rafael Bischof , Florian Scheidegger , Michael A. Kraus , A. Cristiano I. Malossi

Face synthesis has been a fascinating yet challenging problem in computer vision and machine learning. Its main research effort is to design algorithms to generate photo-realistic face images via given semantic domain. It has been a crucial…

Computer Vision and Pattern Recognition · Computer Science 2017-06-16 Zhihe Lu , Zhihang Li , Jie Cao , Ran He , Zhenan Sun

Recent research has found that many families of machine learning models are vulnerable to adversarial examples: inputs that are specifically designed to cause the target model to produce erroneous outputs. In this survey, we focus on…

Machine Learning · Computer Science 2019-11-19 Rey Reza Wiyatno , Anqi Xu , Ousmane Dia , Archy de Berker

Within the text analysis and processing fields, generated text attacks have been made easier to create than ever before. To combat these attacks open sourcing models and datasets have become a major trend to create automated detection…

Computation and Language · Computer Science 2022-10-13 Jesus Guerrero , Izzat Alsmadi

Enormous online textual information provides intriguing opportunities for understandings of social and economic semantics. In this paper, we propose a novel text regression model based on a conditional generative adversarial network (GAN),…

Computation and Language · Computer Science 2019-04-25 Tao Li , Xudong Liu , Shihan Su

Visual saliency patterns are the result of a variety of factors aside from the image being parsed, however existing approaches have ignored these. To address this limitation, we propose a novel saliency estimation model which leverages the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-12 Tharindu Fernando , Simon Denman , Sridha Sridharan , Clinton Fookes

Despite the substantial progress in recent years, the image captioning techniques are still far from being perfect.Sentences produced by existing methods, e.g. those based on RNNs, are often overly rigid and lacking in variability. This…

Computer Vision and Pattern Recognition · Computer Science 2017-08-14 Bo Dai , Sanja Fidler , Raquel Urtasun , Dahua Lin

Deep neural networks (DNN) have achieved unprecedented success in numerous machine learning tasks in various domains. However, the existence of adversarial examples has raised concerns about applying deep learning to safety-critical…

Machine Learning · Computer Science 2019-10-10 Han Xu , Yao Ma , Haochen Liu , Debayan Deb , Hui Liu , Jiliang Tang , Anil K. Jain