中文
相关论文

相关论文: Self-Attention Generative Adversarial Network for …

200 篇论文

We propose a novel model named Multi-Channel Attention Selection Generative Adversarial Network (SelectionGAN) for guided image-to-image translation, where we translate an input image into another while respecting an external semantic…

计算机视觉与模式识别 · 计算机科学 2022-10-07 Hao Tang , Philip H. S. Torr , Nicu Sebe

Generative adversarial networks (GAN) present state-of-the-art results in the generation of samples following the distribution of the input dataset. However, GANs are difficult to train, and several aspects of the model should be previously…

神经与进化计算 · 计算机科学 2019-12-16 Victor Costa , Nuno Lourenço , João Correia , Penousal Machado

The conversion from text to speech relies on the accurate mapping from linguistic to acoustic symbol sequences, for which current practice employs recurrent statistical models like recurrent neural networks. Despite the good performance of…

声音 · 计算机科学 2018-11-07 Santiago Pascual , Antonio Bonafonte , Joan Serrà

In many applications, including surveillance, entertainment, and restoration, there is a need to increase both the spatial resolution and the frame rate of a video sequence. The aim is to improve visual quality, refine details, and create a…

图像与视频处理 · 电气工程与系统科学 2024-07-25 Congrui Fu , Hui Yuan , Liquan Shen , Raouf Hamzaoui , Hao Zhang

In this paper, we show that a simple self-supervised pre-trained audio model can achieve comparable inference efficiency to more complicated pre-trained models with speech transformer encoders. These speech transformers rely on mixing…

声音 · 计算机科学 2024-02-09 Sungho Jeon , Ching-Feng Yeh , Hakan Inan , Wei-Ning Hsu , Rashi Rungta , Yashar Mehdad , Daniel Bikel

Facial attribute editing aims to manipulate attributes on the human face, e.g., adding a mustache or changing the hair color. Existing approaches suffer from a serious compromise between correct attribute generation and preservation of the…

计算机视觉与模式识别 · 计算机科学 2020-07-14 Zhenliang He , Meina Kan , Jichao Zhang , Shiguang Shan

Self-attention is a method of encoding sequences of vectors by relating these vectors to each-other based on pairwise similarities. These models have recently shown promising results for modeling discrete sequences, but they are non-trivial…

计算与语言 · 计算机科学 2018-06-19 Matthias Sperber , Jan Niehues , Graham Neubig , Sebastian Stüker , Alex Waibel

In this paper we demonstrate that it is possible to generate more meaningful electroencephalography (EEG) features from raw EEG features using generative adversarial networks (GAN) to improve the performance of EEG based continuous speech…

音频与语音处理 · 电气工程与系统科学 2020-06-03 Gautam Krishna , Co Tran , Mason Carnahan , Ahmed Tewfik

Generating images according to natural language descriptions is a challenging task. Prior research has mainly focused to enhance the quality of generation by investigating the use of spatial attention and/or textual attention thereby…

计算机视觉与模式识别 · 计算机科学 2022-01-17 Henning Schulze , Dogucan Yaman , Alexander Waibel

GANs involve training two networks in an adversarial game, where each network's task depends on its adversary. Recently, several works have framed GAN training as an online or continual learning problem. We focus on the discriminator, which…

机器学习 · 计算机科学 2018-12-06 Ting Chen , Xiaohua Zhai , Neil Houlsby

Training generative adversarial networks (GANs) with limited data is challenging because the discriminator is prone to overfitting. Previously proposed differentiable augmentation demonstrates improved data efficiency of training GANs.…

机器学习 · 计算机科学 2023-12-29 Liang Hou , Qi Cao , Yige Yuan , Songtao Zhao , Chongyang Ma , Siyuan Pan , Pengfei Wan , Zhongyuan Wang , Huawei Shen , Xueqi Cheng

Although state-of-the-art parallel WaveNet has addressed the issue of real-time waveform generation, there remains problems. Firstly, due to the noisy input signal of the model, there is still a gap between the quality of generated and…

音频与语音处理 · 电气工程与系统科学 2019-07-22 Qiao Tian , Xucheng Wan , Shan Liu

Encoder-decoder based architecture has been widely used in the generator of generative adversarial networks for facial manipulation. However, we observe that the current architecture fails to recover the input image color, rich facial…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Arbish Akram , Nazar Khan

We present the first generative adversarial network (GAN) for natural image matting. Our novel generator network is trained to predict visually appealing alphas with the addition of the adversarial loss from the discriminator that is…

计算机视觉与模式识别 · 计算机科学 2018-07-27 Sebastian Lutz , Konstantinos Amplianitis , Aljosa Smolic

Self-attention (SA) mechanisms can capture effectively global dependencies in deep neural networks, and have been applied to natural language processing and image processing successfully. However, SA modules for image reconstruction have…

计算机视觉与模式识别 · 计算机科学 2019-05-21 Zheng Wang , Jianwu Li , Ge Song , Tieling Li

Generative adversarial networks (GANs) are a powerful approach to unsupervised learning. They have achieved state-of-the-art performance in the image domain. However, GANs are limited in two ways. They often learn distributions with low…

机器学习 · 统计学 2019-10-11 Adji B. Dieng , Francisco J. R. Ruiz , David M. Blei , Michalis K. Titsias

Gradient-based attention modeling has been used widely as a way to visualize and understand convolutional neural networks. However, exploiting these visual explanations during the training of generative adversarial networks (GANs) is an…

计算机视觉与模式识别 · 计算机科学 2021-08-18 Runze Li , Tomaso Fontanini , Luca Donati , Andrea Prati , Bir Bhanu

Recently image inpainting has witnessed rapid progress due to generative adversarial networks (GAN) that are able to synthesize realistic contents. However, most existing GAN-based methods for semantic inpainting apply an auto-encoder…

计算机视觉与模式识别 · 计算机科学 2017-12-22 Haofeng Li , Guanbin Li , Liang Lin , Yizhou Yu

Generative Adversarial Networks (GANs) have shown impressive results in various image synthesis tasks. Vast studies have demonstrated that GANs are more powerful in feature and expression learning compared to other generative models and…

计算机视觉与模式识别 · 计算机科学 2025-04-09 Omar De Mitri , Ruyu Wang , Marco F. Huber

Generative Adversarial Networks (GANs) triggered an increased interest in problem of image generation due to their improved output image quality and versatility for expansion towards new methods. Numerous GAN-based works attempt to improve…

计算机视觉与模式识别 · 计算机科学 2020-10-09 Gulcin Baykal , Gozde Unal