English
Related papers

Related papers: Are You Talking to Me? Reasoned Visual Dialog Gene…

200 papers

In open-domain dialogue systems, generative approaches have attracted much attention for response generation. However, existing methods are heavily plagued by generating safe responses and unnatural responses. To alleviate these two…

Computation and Language · Computer Science 2019-06-25 Shaobo Cui , Rongzhong Lian , Di Jiang , Yuanfeng Song , Siqi Bao , Yong Jiang

We propose an adversarial learning approach for generating multi-turn dialogue responses. Our proposed framework, hredGAN, is based on conditional generative adversarial networks (GANs). The GAN's generator is a modified hierarchical…

Computation and Language · Computer Science 2019-06-27 Oluwatobi Olabiyi , Alan Salimov , Anish Khazane , Erik T. Mueller

We are creating multimedia contents everyday and everywhere. While automatic content generation has played a fundamental challenge to multimedia community for decades, recent advances of deep learning have made this problem feasible. For…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Yingwei Pan , Zhaofan Qiu , Ting Yao , Houqiang Li , Tao Mei

Generating relevant responses in a dialog is challenging, and requires not only proper modeling of context in the conversation but also being able to generate fluent sentences during inference. In this paper, we propose a two-step framework…

Computation and Language · Computer Science 2020-11-04 Kashif Khan , Gaurav Sahu , Vikash Balasubramanian , Lili Mou , Olga Vechtomova

Generative Adversarial Networks (GAN) have emerged as a formidable AI tool to generate realistic outputs based on training datasets. However, the challenge of exerting control over the generation process of GANs remains a significant…

Conditional image generation is an active research topic including text2image and image translation. Recently image manipulation with linguistic instruction brings new challenges of multimodal conditional generation. However, traditional…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Zhenhuan Liu , Jincan Deng , Liang Li , Shaofei Cai , Qianqian Xu , Shuhui Wang , Qingming Huang

Understanding, predicting, and generating object motions and transformations is a core problem in artificial intelligence. Modeling sequences of evolving images may provide better representations and models of motion and may ultimately be…

Computer Vision and Pattern Recognition · Computer Science 2016-12-07 Arnab Ghosh , Viveka Kulharia , Amitabha Mukerjee , Vinay Namboodiri , Mohit Bansal

A picture is worth a thousand words, thus, it is crucial for conversational agents to understand, perceive, and effectively respond with pictures. However, we find that directly employing conventional image generation techniques is…

Computation and Language · Computer Science 2024-02-09 Xiaowen Sun , Jiazhan Feng , Yuxuan Wang , Yuxuan Lai , Xingyu Shen , Dongyan Zhao

Generating qualitative responses has always been a challenge for human-computer dialogue systems. Existing dialogue systems generally derive from either retrieval-based or generative-based approaches, both of which have their own pros and…

Computation and Language · Computer Science 2020-05-01 Jiayi Zhang , Chongyang Tao , Zhenjing Xu , Qiaojing Xie , Wei Chen , Rui Yan

Besides the well-known classification task, these days neural networks are frequently being applied to generate or transform data, such as images and audio signals. In such tasks, the conventional loss functions like the mean squared error…

"Art is the lie that enables us to realize the truth." - Pablo Picasso. For centuries, humans have dedicated themselves to producing arts to convey their imagination. The advancement in technology and deep learning in particular, has caught…

Artificial Intelligence · Computer Science 2021-08-17 Sakib Shahriar

Generative Adversarial Networks (GANs) have experienced a recent surge in popularity, performing competitively in a variety of tasks, especially in computer vision. However, GAN training has shown limited success in natural language…

Computation and Language · Computer Science 2019-01-03 David Donahue , Anna Rumshisky

Generative Adversarial Networks (GAN) is a model for data synthesis, which creates plausible data through the competition of generator and discriminator. Although GAN application to image synthesis is extensively studied, it has inherent…

Computation and Language · Computer Science 2025-01-07 Jun-Min Lee , Tae-Bin Ha

Recent advances in Generative Adversarial Networks (GANs) continue to attract the attention of researchers in different fields due to the wide range of applications devised to take advantage of their key features. Most recent GANs are…

Human-Computer Interaction · Computer Science 2023-05-31 Mohammad Lataifeh , Xavier Carrasco , Ashraf Elnagar , Naveed Ahmed

A crucial factor to trust Machine Learning (ML) algorithm decisions is a good representation of its application field by the training dataset. This is particularly true when parts of the training data have been artificially generated to…

Machine Learning · Computer Science 2020-01-03 Hiba Arnout , Johannes Kehrer , Johanna Bronner , Thomas Runkler

The task of conducting visually grounded dialog involves learning goal-oriented cooperative dialog between autonomous agents who exchange information about a scene through several rounds of questions and answers in natural language. We…

Computer Vision and Pattern Recognition · Computer Science 2018-09-10 Akshat Agarwal , Swaminathan Gurumurthy , Vasu Sharma , Mike Lewis , Katia Sycara

Responsing with image has been recognized as an important capability for an intelligent conversational agent. Yet existing works only focus on exploring the multimodal dialogue models which depend on retrieval-based methods, but neglecting…

Computation and Language · Computer Science 2022-03-30 Qingfeng Sun , Yujing Wang , Can Xu , Kai Zheng , Yaming Yang , Huang Hu , Fei Xu , Jessica Zhang , Xiubo Geng , Daxin Jiang

Generative adversarial networks (GANs) are a novel approach to generative modelling, a task whose goal it is to learn a distribution of real data points. They have often proved difficult to train: GANs are unlike many techniques in machine…

Machine Learning · Computer Science 2018-07-02 Samuel A. Barnett

While most image captioning aims to generate objective descriptions of images, the last few years have seen work on generating visually grounded image captions which have a specific style (e.g., incorporating positive or negative…

Computer Vision and Pattern Recognition · Computer Science 2019-08-09 Omid Mohamad Nezami , Mark Dras , Stephen Wan , Cecile Paris , Len Hamey

Generative Adversarial Networks (GANs) have gathered a lot of attention from the computer vision community, yielding impressive results for image generation. Advances in the adversarial generation of natural language from noise however are…

Computation and Language · Computer Science 2017-06-01 Sai Rajeswar , Sandeep Subramanian , Francis Dutil , Christopher Pal , Aaron Courville