中文
相关论文

相关论文: Rayleigh EigenDirections (REDs): GAN latent space …

200 篇论文

Generative image modeling techniques such as GAN demonstrate highly convincing image generation result. However, user interaction is often necessary to obtain the desired results. Existing attempts add interactivity but require either…

图形学 · 计算机科学 2020-09-01 Toby Chong Long Hin , I-Chao Shen , Issei Sato , Takeo Igarashi

Generative models rely on the key idea that data can be represented in terms of latent variables which are uncorrelated by definition. Lack of correlation is important because it suggests that the latent space manifold is simpler to…

机器学习 · 计算机科学 2021-02-11 J. Quetzalcoatl Toledo-Marin , James A. Glazier

In this paper, we propose $\tau$GAN a tensor-based method for modeling the latent space of generative models. The objective is to identify semantic directions in latent space. To this end, we propose to fit a multilinear tensor model on a…

计算机视觉与模式识别 · 计算机科学 2021-11-09 René Haas , Stella Graßhof , Sami Sebastian Brandt

Generative models such as Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs) play an increasingly important role in medical image analysis. The latent spaces of these models often show semantically meaningful…

图像与视频处理 · 电气工程与系统科学 2022-07-21 Julian Schön , Raghavendra Selvan , Jens Petersen

3D face editing is a significant task in multimedia, aimed at the manipulation of 3D face models across various control signals. The success of 3D-aware GAN provides expressive 3D models learned from 2D single-view images only, encouraging…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Zhuo Chen , Yichao Yan , Sehngqi Liu , Yuhao Cheng , Weiming Zhao , Lincheng Li , Mengxiao Bi , Xiaokang Yang

This paper describes a simple technique to analyze Generative Adversarial Networks (GANs) and create interpretable controls for image synthesis, such as change of viewpoint, aging, lighting, and time of day. We identify important latent…

计算机视觉与模式识别 · 计算机科学 2022-07-05 Erik Härkönen , Aaron Hertzmann , Jaakko Lehtinen , Sylvain Paris

The StyleGAN family succeed in high-fidelity image generation and allow for flexible and plausible editing of generated images by manipulating the semantic-rich latent style space.However, projecting a real image into its latent space…

计算机视觉与模式识别 · 计算机科学 2023-02-01 Bingchuan Li , Tianxiang Ma , Peng Zhang , Miao Hua , Wei Liu , Qian He , Zili Yi

State-of-the-art generative models (e.g. StyleGAN3 \cite{karras2021alias}) often generate photorealistic images based on vectors sampled from their latent space. However, the ability to control the output is limited. Here we present our…

计算机视觉与模式识别 · 计算机科学 2024-02-28 Róbert Belanec , Peter Lacko , Kristína Malinovská

Facial expression transfer and reenactment has been an important research problem given its applications in face editing, image manipulation, and fabricated videos generation. We present a novel method for image-based facial expression…

计算机视觉与模式识别 · 计算机科学 2019-12-16 Chao Yang , Ser-Nam Lim

StyleGAN2 was demonstrated to be a powerful image generation engine that supports semantic editing. However, in order to manipulate a real-world image, one first needs to be able to retrieve its corresponding latent representation in…

计算机视觉与模式识别 · 计算机科学 2023-02-23 Erez Sheffi , Michael Rotman , Lior Wolf

Generative adversarial networks (GANs) have recently found applications in image editing. However, most GAN based image editing methods often require large scale datasets with semantic segmentation annotations for training, only provide…

计算机视觉与模式识别 · 计算机科学 2021-11-08 Huan Ling , Karsten Kreis , Daiqing Li , Seung Wook Kim , Antonio Torralba , Sanja Fidler

Generative adversarial nets (GANs) have been successfully applied in many fields like image generation, inpainting, super-resolution and drug discovery, etc., by now, the inner process of GANs is far from been understood. To get deeper…

计算机视觉与模式识别 · 计算机科学 2020-07-24 Ziqiang Li , Rentuo Tao , Hongjing Niu , Bin Li

Employing the latent space of pretrained generators has recently been shown to be an effective means for GAN-based face manipulation. The success of this approach heavily relies on the innate disentanglement of the latent space axes of the…

计算机视觉与模式识别 · 计算机科学 2022-02-08 Xianxu Hou , Linlin Shen , Or Patashnik , Daniel Cohen-Or , Hui Huang

StyleGAN has achieved great progress in 2D face reconstruction and semantic editing via image inversion and latent editing. While studies over extending 2D StyleGAN to 3D faces have emerged, a corresponding generic 3D GAN inversion…

计算机视觉与模式识别 · 计算机科学 2022-12-19 Yushi Lan , Xuyi Meng , Shuai Yang , Chen Change Loy , Bo Dai

In recent years, Generative Adversarial Networks have become ubiquitous in both research and public perception, but how GANs convert an unstructured latent code to a high quality output is still an open question. In this work, we…

计算机视觉与模式识别 · 计算机科学 2021-06-07 Lucy Chai , Jonas Wulff , Phillip Isola

As recent generative models can generate photo-realistic images, people seek to understand the mechanism behind the generation process. Interpretable generation process is beneficial to various image editing applications. In this work, we…

计算机视觉与模式识别 · 计算机科学 2020-12-01 Yu-Ding Lu , Hsin-Ying Lee , Hung-Yu Tseng , Ming-Hsuan Yang

Previous approaches to generate shapes in a 3D setting train a GAN on the latent space of an autoencoder (AE). Even though this produces convincing results, it has two major shortcomings. As the GAN is limited to reproduce the dataset the…

计算机视觉与模式识别 · 计算机科学 2021-07-23 Moritz Ibing , Isaak Lim , Leif Kobbelt

Recent research has shown remarkable success in revealing "steering" directions in the latent spaces of pre-trained GANs. These directions correspond to semantically meaningful image transformations e.g., shift, zoom, color manipulations),…

计算机视觉与模式识别 · 计算机科学 2021-01-26 Nurit Spingarn-Eliezer , Ron Banner , Tomer Michaeli

In this work, we are dedicated to text-guided image generation and propose a novel framework, i.e., CLIP2GAN, by leveraging CLIP model and StyleGAN. The key idea of our CLIP2GAN is to bridge the output feature embedding space of CLIP and…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Yixuan Wang , Wengang Zhou , Jianmin Bao , Weilun Wang , Li Li , Houqiang Li

The use of beauty filters on social media, which enhance the appearance of individuals in images, is a well-researched area, with existing methods proving to be highly effective. Traditionally, such enhancements are performed using…

计算机视觉与模式识别 · 计算机科学 2025-01-03 Erik Nguyen , Spencer Htin