English
Related papers

Related papers: StyleVideoGAN: A Temporal Generative Model using a…

200 papers

In this paper we introduce StyleWaveGAN, a style-based drum sound generator that is a variation of StyleGAN, a state-of-the-art image generator. By conditioning StyleWaveGAN on both the type of drum and several audio descriptors, we are…

Sound · Computer Science 2022-08-29 Antoine Lavault , Axel Roebel , Matthieu Voiry

Generative Adversarial Network (GAN) is one of the state-of-the-art generative models for realistic image synthesis. While training and evaluating GAN becomes increasingly important, the current GAN research ecosystem does not provide…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Minguk Kang , Joonghyuk Shin , Jaesik Park

Truncation is widely used in generative models for improving the quality of the generated samples, at the expense of reducing their diversity. We propose to leverage the StyleGAN generative architecture to devise a new truncation technique,…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Oren Katzir , Vicky Perepelook , Dani Lischinski , Daniel Cohen-Or

Discovering meaningful directions in the latent space of GANs to manipulate semantic attributes typically requires large amounts of labeled data. Recent work aims to overcome this limitation by leveraging the power of Contrastive…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Umut Kocasari , Alara Dirik , Mert Tiftikci , Pinar Yanardag

Quantization is a widely adopted technique for deep neural networks to reduce the memory and computational resources required. However, when quantized, most models would need a suitable calibration process to keep their performance intact,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Athanasios Masouris , Mansi Sharma , Adrian Boguszewski , Alexander Kozlov , Zhuo Wu , Raymond Lo

We present an algorithm for re-rendering a person from a single image under arbitrary poses. Existing methods often have difficulties in hallucinating occluded contents photo-realistically while preserving the identity and fine details in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Badour AlBahar , Jingwan Lu , Jimei Yang , Zhixin Shu , Eli Shechtman , Jia-Bin Huang

State-of-the-art generative models (e.g. StyleGAN3 \cite{karras2021alias}) often generate photorealistic images based on vectors sampled from their latent space. However, the ability to control the output is limited. Here we present our…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Róbert Belanec , Peter Lacko , Kristína Malinovská

Recent advances in generative adversarial networks have shown that it is possible to generate high-resolution and hyperrealistic images. However, the images produced by GANs are only as fair and representative as the datasets on which they…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Cemre Karakas , Alara Dirik , Eylul Yalcinkaya , Pinar Yanardag

Generative Adversarial Networks (GANs) are capable of synthesizing high-quality facial images. Despite their success, GANs do not provide any information about the relationship between the input vectors and the generated images. Currently,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Ali Pourramezan Fard , Mohammad H. Mahoor , Sarah Ariel Lamer , Timothy Sweeny

Generative Adversarial Networks (GANs) have received a great deal of attention due in part to recent success in generating original, high-quality samples from visual domains. However, most current methods only allow for users to guide this…

Graphics · Computer Science 2019-04-05 Eric Heim

Generative Adversarial Networks (GAN) is a model for data synthesis, which creates plausible data through the competition of generator and discriminator. Although GAN application to image synthesis is extensively studied, it has inherent…

Computation and Language · Computer Science 2025-01-07 Jun-Min Lee , Tae-Bin Ha

Deep generative models have recently presented impressive results in generating realistic face images of random synthetic identities. To generate multiple samples of a certain synthetic identity, previous works proposed to disentangle the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Fadi Boutros , Marcel Klemt , Meiling Fang , Arjan Kuijper , Naser Damer

Text-driven image manipulation is developed since the vision-language model (CLIP) has been proposed. Previous work has adopted CLIP to design a text-image consistency-based objective to address this issue. However, these methods require…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Wanfeng Zheng , Qiang Li , Xiaoyan Guo , Pengfei Wan , Zhongyuan Wang

Generative adversarial networks (GAN) have shown remarkable results in image generation tasks. High fidelity class-conditional GAN methods often rely on stabilization techniques by constraining the global Lipschitz continuity. Such…

Machine Learning · Computer Science 2020-08-11 Jiachen Zhong , Xuanqing Liu , Cho-Jui Hsieh

The extension of image generation to video generation turns out to be a very difficult task, since the temporal dimension of videos introduces an extra challenge during the generation process. Besides, due to the limitation of memory and…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 Dinesh Acharya , Zhiwu Huang , Danda Pani Paudel , Luc Van Gool

The inversion of real images into StyleGAN's latent space is a well-studied problem. Nevertheless, applying existing approaches to real-world scenarios remains an open challenge, due to an inherent trade-off between reconstruction and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Yuval Alaluf , Omer Tov , Ron Mokady , Rinon Gal , Amit H. Bermano

The recent advancements in image-text diffusion models have stimulated research interest in large-scale 3D generative models. Nevertheless, the limited availability of diverse 3D resources presents significant challenges to learning. In…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Chi Zhang , Yiwen Chen , Yijun Fu , Zhenglin Zhou , Gang YU , Billzb Wang , Bin Fu , Tao Chen , Guosheng Lin , Chunhua Shen

Videos express highly structured spatio-temporal patterns of visual data. A video can be thought of as being governed by two factors: (i) temporally invariant (e.g., person identity), or slowly varying (e.g., activity), attribute-induced…

Computer Vision and Pattern Recognition · Computer Science 2018-03-26 Jiawei He , Andreas Lehrmann , Joseph Marino , Greg Mori , Leonid Sigal

StyleGAN has achieved great progress in 2D face reconstruction and semantic editing via image inversion and latent editing. While studies over extending 2D StyleGAN to 3D faces have emerged, a corresponding generic 3D GAN inversion…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Yushi Lan , Xuyi Meng , Shuai Yang , Chen Change Loy , Bo Dai

In this paper, we propose to model the video dynamics by learning the trajectory of independently inverted latent codes from GANs. The entire sequence is seen as discrete-time observations of a continuous trajectory of the initial latent…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Weihao Xia , Yujiu Yang , Jing-Hao Xue