English
Related papers

Related papers: Speech-Driven Expressive Talking Lips with Conditi…

200 papers

Generative Networks have proved to be extremely effective in image restoration and reconstruction in the past few years. Generating faces from textual descriptions is one such application where the power of generative algorithms can be…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Sandeep Shinde , Tejas Pradhan , Aniket Ghorpade , Mihir Tale

In recent times, many of the breakthroughs in various vision-related tasks have revolved around improving learning of deep models; these methods have ranged from network architectural improvements such as Residual Networks, to various forms…

Machine Learning · Statistics 2018-05-15 Yan Zuo , Gil Avraham , Tom Drummond

Generative adversarial imitation learning (GAIL) is a model-free algorithm that has been shown to provide strong results in imitating complex behaviors in high-dimensional environments. In this paper, we utilize the GAIL model for text…

Computation and Language · Computer Science 2021-05-28 Pratyush Muthukumar , Karishma Muthukumar , Deepan Muthirayan , Pramod Khargonekar

Generative Adversarial Networks (GANs) for text generation have recently received many criticisms, as they perform worse than their MLE counterparts. We suspect previous text GANs' inferior performance is due to the lack of a reliable…

Computation and Language · Computer Science 2021-04-28 Qingyang Wu , Lei Li , Zhou Yu

Integrated sensing and communication (ISAC) technology has been explored as a potential advancement for future wireless networks, striving to effectively use spectral resources for both communication and sensing. The integration of…

Signal Processing · Electrical Eng. & Systems 2025-02-25 Alice Faisal , Ibrahim Al-Nahhal , Kyesan Lee , Octavia A. Dobre , Hyundong Shin

The Generative Adversarial Network (GAN) has achieved great success in generating realistic (real-valued) synthetic data. However, convergence issues and difficulties dealing with discrete data hinder the applicability of GAN to text. We…

Machine Learning · Statistics 2017-11-21 Yizhe Zhang , Zhe Gan , Kai Fan , Zhi Chen , Ricardo Henao , Dinghan Shen , Lawrence Carin

Conditional Generative Adversarial Nets (CGAN) is often used to improve conditional image generation performance. However, there is little research on Representation learning with CGAN for causal inference. This paper proposes a new method…

Machine Learning · Computer Science 2024-07-04 Zhaotian Weng , Jianbo Hong , Lan Wang

This paper presents a new adversarial learning method for generative conversational agents (GCA) besides a new model of GCA. Similar to previous works on adversarial learning for dialogue generation, our method assumes the GCA as a…

Computation and Language · Computer Science 2018-01-10 Oswaldo Ludwig

Conditional image generation is effective for diverse tasks including training data synthesis for learning-based computer vision. However, despite the recent advances in generative adversarial networks (GANs), it is still a challenging task…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Yutaro Miyauchi , Yusuke Sugano , Yasuyuki Matsushita

Neural text generation models are often autoregressive language models or seq2seq models. These models generate text by sampling words sequentially, with each word conditioned on the previous word, and are state-of-the-art for several…

Machine Learning · Statistics 2018-03-02 William Fedus , Ian Goodfellow , Andrew M. Dai

We investigate the effectiveness of generative adversarial networks (GANs) for speech enhancement, in the context of improving noise robustness of automatic speech recognition (ASR) systems. Prior work demonstrates that GANs can effectively…

Sound · Computer Science 2018-11-01 Chris Donahue , Bo Li , Rohit Prabhavalkar

Traditional voice conversion(VC) has been focused on speaker identity conversion for speech with a neutral expression. We note that emotional expression plays an essential role in daily communication, and the emotional style of speech can…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-22 Zongyang Du , Berrak Sisman , Kun Zhou , Haizhou Li

In recent years, Generative Adversarial Networks (GANs) have improved steadily towards generating increasingly impressive real-world images. It is useful to steer the image generation process for purposes such as content creation. This can…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 David Stap , Maurits Bleeker , Sarah Ibrahimi , Maartje ter Hoeve

Powerful generative adversarial networks (GAN) have been developed to automatically synthesize realistic images from text. However, most existing tasks are limited to generating simple images such as flowers from captions. In this work, we…

Machine Learning · Computer Science 2019-11-27 Osaid Rehman Nasir , Shailesh Kumar Jha , Manraj Singh Grover , Yi Yu , Ajit Kumar , Rajiv Ratn Shah

Conversational agents (CAs) are increasingly embedded in daily life, yet their ability to navigate user emotions efficiently is still evolving. This study investigates how users with varying traits -- gender, personality, and cultural…

Human-Computer Interaction · Computer Science 2025-11-11 Yuchong Zhang , Yong Ma , Di Fu , Stephanie Zubicueta Portales , Morten Fjeld , Danica Kragic

This paper investigates the use of generative adversarial network (GAN)-based models for converting the spectrogram of a speech signal into that of a singing one, without reference to the phoneme sequence underlying the speech. This is…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-06 Da-Yi Wu , Yi-Hsuan Yang

In this paper, we investigate the use of generative adversarial networks in the task of image generation according to subjective measures of semantic attributes. Unlike the standard (CGAN) that generates images from discrete categorical…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Yassir Saquil , Kwang In Kim , Peter Hall

In this paper, we propose a novel controllable text-to-image generative adversarial network (ControlGAN), which can effectively synthesise high-quality images and also control parts of the image generation according to natural language…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Bowen Li , Xiaojuan Qi , Thomas Lukasiewicz , Philip H. S. Torr

This paper addresses the problem of manipulating images using natural language description. Our task aims to semantically modify visual attributes of an object in an image according to the text describing the new visual appearance. Although…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Seonghyeon Nam , Yunji Kim , Seon Joo Kim

The cross-subject application of EEG-based brain-computer interface (BCI) has always been limited by large individual difference and complex characteristics that are difficult to perceive. Therefore, it takes a long time to collect the…

Machine Learning · Computer Science 2021-02-10 Yonghao Song , Lie Yang , Xueyu Jia , Longhan Xie