中文
相关论文

相关论文: Speak the Art: A Direct Speech to Image Generation…

200 篇论文

Recent advances in neural network -based text-to-speech have reached human level naturalness in synthetic speech. The present sequence-to-sequence models can directly map text to mel-spectrogram acoustic features, which are convenient for…

音频与语音处理 · 电气工程与系统科学 2019-06-27 Lauri Juvela , Bajibabu Bollepalli , Junichi Yamagishi , Paavo Alku

We propose AudioStyleGAN (ASGAN), a new generative adversarial network (GAN) for unconditional speech synthesis. As in the StyleGAN family of image synthesis models, ASGAN maps sampled noise to a disentangled latent vector which is then…

声音 · 计算机科学 2022-10-12 Matthew Baas , Herman Kamper

The impressive capacity shown by recent text-to-image diffusion models to generate high-quality pictures from textual input prompts has leveraged the debate about the very definition of art. Nonetheless, these models have been trained using…

计算与语言 · 计算机科学 2022-10-20 Ricardo Kleinlein , Cristina Luna-Jiménez , Fernando Fernández-Martínez

Generating images according to natural language descriptions is a challenging task. Prior research has mainly focused to enhance the quality of generation by investigating the use of spatial attention and/or textual attention thereby…

计算机视觉与模式识别 · 计算机科学 2022-01-17 Henning Schulze , Dogucan Yaman , Alexander Waibel

Editing facial expressions by only changing what we want is a long-standing research problem in Generative Adversarial Networks (GANs) for image manipulation. Most of the existing methods that rely only on a global generator usually suffer…

计算机视觉与模式识别 · 计算机科学 2021-12-10 Rumeysa Bodur , Binod Bhattarai , Tae-Kyun Kim

Synthesizing high-quality realistic images from text descriptions is a challenging task. Existing text-to-image Generative Adversarial Networks generally employ a stacked architecture as the backbone yet still remain three flaws. First, the…

计算机视觉与模式识别 · 计算机科学 2022-10-18 Ming Tao , Hao Tang , Fei Wu , Xiao-Yuan Jing , Bing-Kun Bao , Changsheng Xu

Recent approaches in text-to-speech (TTS) synthesis employ neural network strategies to vocode perceptually-informed spectrogram representations directly into listenable waveforms. Such vocoding procedures create a computational bottleneck…

声音 · 计算机科学 2019-07-29 Paarth Neekhara , Chris Donahue , Miller Puckette , Shlomo Dubnov , Julian McAuley

Generative adversarial nets (GANs) have been successfully applied to the artificial generation of image data. In terms of text data, much has been done on the artificial generation of natural language from a single corpus. We consider…

计算与语言 · 计算机科学 2017-12-27 Baiyang Wang , Diego Klabjan

Generative Adversarial Networks (GANs) have established themselves as a prevalent approach to image synthesis. Of these, StyleGAN offers a fascinating case study, owing to its remarkable visual quality and an ability to support a large…

计算机视觉与模式识别 · 计算机科学 2022-03-01 Amit H. Bermano , Rinon Gal , Yuval Alaluf , Ron Mokady , Yotam Nitzan , Omer Tov , Or Patashnik , Daniel Cohen-Or

In recent years, the use of deep learning is becoming increasingly popular in computer vision. However, the effective training of deep architectures usually relies on huge sets of annotated data. This is critical in the medical field where…

图像与视频处理 · 电气工程与系统科学 2019-07-30 Paolo Andreini , Simone Bonechi , Monica Bianchini , Alessandro Mecocci , Franco Scarselli , Andrea Sodi

Currently, image generation and synthesis have remarkably progressed with generative models. Despite photo-realistic results, intrinsic discrepancies are still observed in the frequency domain. The spectral discrepancy appeared not only in…

计算机视觉与模式识别 · 计算机科学 2024-03-11 Seokjun Lee , Seung-Won Jung , Hyunseok Seo

Powerful generative adversarial networks (GAN) have been developed to automatically synthesize realistic images from text. However, most existing tasks are limited to generating simple images such as flowers from captions. In this work, we…

机器学习 · 计算机科学 2019-11-27 Osaid Rehman Nasir , Shailesh Kumar Jha , Manraj Singh Grover , Yi Yu , Ajit Kumar , Rajiv Ratn Shah

Generative Adversarial Networks (GANs) have proven to be a powerful tool in generating artistic images, capable of mimicking the styles of renowned painters, such as Claude Monet. This paper introduces a tiered GAN model to progressively…

计算机视觉与模式识别 · 计算机科学 2024-12-10 FNU Neha , Deepshikha Bhati , Deepak Kumar Shukla , Md Amiruzzaman

In the field of remote sensing, the scarcity of stereo-matched and particularly lack of accurate ground truth data often hinders the training of deep neural networks. The use of synthetically generated images as an alternative, alleviates…

计算机视觉与模式识别 · 计算机科学 2024-04-16 Vasudha Venkatesan , Daniel Panangian , Mario Fuentes Reyes , Ksenia Bittner

We propose a new system for generating art. The system generates art by looking at art and learning about style; and becomes creative by increasing the arousal potential of the generated art by deviating from the learned styles. We build…

人工智能 · 计算机科学 2017-06-23 Ahmed Elgammal , Bingchen Liu , Mohamed Elhoseiny , Marian Mazzone

To simplify the generation process, several text-to-speech (TTS) systems implicitly learn intermediate latent representations instead of relying on predefined features (e.g., mel-spectrogram). However, their generation quality is…

声音 · 计算机科学 2023-08-29 Hyungchan Yoon , Seyun Um , Changwhan Kim , Hong-Goo Kang

Generating human portraits is a hot topic in the image generation area, e.g. mask-to-face generation and text-to-face generation. However, these unimodal generation methods lack controllability in image generation. Controllability can be…

计算机视觉与模式识别 · 计算机科学 2024-09-18 Debin Meng , Christos Tzelepis , Ioannis Patras , Georgios Tzimiropoulos

Neural networks have proven their capabilities by outperforming many other approaches on regression or classification tasks on various kinds of data. Other astonishing results have been achieved using neural nets as data generators,…

计算机视觉与模式识别 · 计算机科学 2018-10-16 Andrej Junginger , Markus Hanselmann , Thilo Strauss , Sebastian Boblest , Jens Buchner , Holger Ulmer

Generating images via the generative adversarial network (GAN) has attracted much attention recently. However, most of the existing GAN-based methods can only produce low-resolution images of limited quality. Directly generating…

计算机视觉与模式识别 · 计算机科学 2019-04-01 Yong Guo , Qi Chen , Jian Chen , Qingyao Wu , Qinfeng Shi , Mingkui Tan

Generative adversarial networks (GANs) can now generate photo-realistic images. However, how to best control the image content remains an open challenge. We introduce LatentKeypointGAN, a two-stage GAN internally conditioned on a set of…

计算机视觉与模式识别 · 计算机科学 2023-06-10 Xingzhe He , Bastian Wandt , Helge Rhodin