中文
相关论文

相关论文: StyleGAN2 Distillation for Feed-forward Image Mani…

200 篇论文

The inversion of real images into StyleGAN's latent space is a well-studied problem. Nevertheless, applying existing approaches to real-world scenarios remains an open challenge, due to an inherent trade-off between reconstruction and…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Yuval Alaluf , Omer Tov , Ron Mokady , Rinon Gal , Amit H. Bermano

StyleGAN models show editing capabilities via their semantically interpretable latent organizations which require successful GAN inversion methods to edit real images. Many works have been proposed for inverting images into StyleGAN's…

计算机视觉与模式识别 · 计算机科学 2023-12-19 Ahmet Burak Yildirim , Hamza Pehlivan , Aysegul Dundar

The exploration of the latent space in StyleGANs and GAN inversion exemplify impressive real-world image editing, yet the trade-off between reconstruction quality and editing quality remains an open problem. In this study, we revisit…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Kai Katsumata , Duc Minh Vo , Bei Liu , Hideki Nakayama

Inspired by the ability of StyleGAN to generate highly realistic images in a variety of domains, much recent work has focused on understanding how to use the latent spaces of StyleGAN to manipulate generated and real images. However,…

计算机视觉与模式识别 · 计算机科学 2021-04-01 Or Patashnik , Zongze Wu , Eli Shechtman , Daniel Cohen-Or , Dani Lischinski

Many recent works have been proposed for face image editing by leveraging the latent space of pretrained GANs. However, few attempts have been made to directly apply them to videos, because 1) they do not guarantee temporal consistency, 2)…

计算机视觉与模式识别 · 计算机科学 2022-06-28 Jiyang Yu , Jingen Liu , Jing Huang , Wei Zhang , Tao Mei

Generative Adversarial Networks (GANs) have established themselves as a prevalent approach to image synthesis. Of these, StyleGAN offers a fascinating case study, owing to its remarkable visual quality and an ability to support a large…

计算机视觉与模式识别 · 计算机科学 2022-03-01 Amit H. Bermano , Rinon Gal , Yuval Alaluf , Ron Mokady , Yotam Nitzan , Omer Tov , Or Patashnik , Daniel Cohen-Or

Generating human portraits is a hot topic in the image generation area, e.g. mask-to-face generation and text-to-face generation. However, these unimodal generation methods lack controllability in image generation. Controllability can be…

计算机视觉与模式识别 · 计算机科学 2024-09-18 Debin Meng , Christos Tzelepis , Ioannis Patras , Georgios Tzimiropoulos

While recent research has progressively overcome the low-resolution constraint of one-shot face video re-enactment with the help of StyleGAN's high-fidelity portrait generation, these approaches rely on at least one of the following:…

计算机视觉与模式识别 · 计算机科学 2023-02-16 Trevine Oorloff , Yaser Yacoob

The latent code of the recent popular model StyleGAN has learned disentangled representations thanks to the multi-layer style-based generator. Embedding a given image back to the latent space of StyleGAN enables wide interesting semantic…

计算机视觉与模式识别 · 计算机科学 2020-07-06 Shanyan Guan , Ying Tai , Bingbing Ni , Feida Zhu , Feiyue Huang , Xiaokang Yang

Several research groups have shown that Generative Adversarial Networks (GANs) can generate photo-realistic images in recent years. Using the GANs, a map is created between a latent code and a photo-realistic image. This process can also be…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Andrea Giardina , Soumya Subhra Paria , Adhikari Kaustubh

StyleGANs have shown impressive results on data generation and manipulation in recent years, thanks to its disentangled style latent space. A lot of efforts have been made in inverting a pretrained generator, where an encoder is trained ad…

计算机视觉与模式识别 · 计算机科学 2021-10-19 Ligong Han , Sri Harsha Musunuri , Martin Renqiang Min , Ruijiang Gao , Yu Tian , Dimitris Metaxas

Deep generative models like StyleGAN hold the promise of semantic image editing: modifying images by their content, rather than their pixel values. Unfortunately, working with arbitrary images requires inverting the StyleGAN generator,…

计算机视觉与模式识别 · 计算机科学 2022-05-16 Yohan Poirier-Ginter , Alexandre Lessard , Ryan Smith , Jean-François Lalonde

In this work, we are dedicated to text-guided image generation and propose a novel framework, i.e., CLIP2GAN, by leveraging CLIP model and StyleGAN. The key idea of our CLIP2GAN is to bridge the output feature embedding space of CLIP and…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Yixuan Wang , Wengang Zhou , Jianmin Bao , Weilun Wang , Li Li , Houqiang Li

One highly promising direction for enabling flexible real-time on-device image editing is utilizing data distillation by leveraging large-scale text-to-image diffusion models to generate paired datasets used for training generative…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Yifan Gong , Zheng Zhan , Qing Jin , Yanyu Li , Yerlan Idelbayev , Xian Liu , Andrey Zharkov , Kfir Aberman , Sergey Tulyakov , Yanzhi Wang , Jian Ren

Existing GAN inversion and editing methods work well for aligned objects with a clean background, such as portraits and animal faces, but often struggle for more difficult categories with complex scene layouts and object occlusions, such as…

计算机视觉与模式识别 · 计算机科学 2022-06-17 Gaurav Parmar , Yijun Li , Jingwan Lu , Richard Zhang , Jun-Yan Zhu , Krishna Kumar Singh

Computed medical imaging systems require a computational reconstruction procedure for image formation. In order to recover a useful estimate of the object to-be-imaged when the recorded measurements are incomplete, prior knowledge about the…

图像与视频处理 · 电气工程与系统科学 2022-02-21 Varun A. Kelkar , Mark A. Anastasio

A promise of Generative Adversarial Networks (GANs) is to provide cheap photorealistic data for training and validating AI models in autonomous driving. Despite their huge success, their performance on complex images featuring multiple…

计算机视觉与模式识别 · 计算机科学 2023-05-17 George Eskandar , Youssef Farag , Tarun Yenamandra , Daniel Cremers , Karim Guirguis , Bin Yang

StyleGAN is able to produce photorealistic images that are almost indistinguishable from real photos. The reverse problem of finding an embedding for a given image poses a challenge. Embeddings that reconstruct an image well are not always…

计算机视觉与模式识别 · 计算机科学 2021-10-19 Peihao Zhu , Rameen Abdal , Yipeng Qin , John Femiani , Peter Wonka

Recent studies have shown remarkable success in the unsupervised image to image (I2I) translation. However, due to the imbalance in the data, learning joint distribution for various domains is still very challenging. Although existing…

计算机视觉与模式识别 · 计算机科学 2021-06-24 Jihye Back

We present an invert-and-edit framework to automatically transform facial weight of an input face image to look thinner or heavier by leveraging semantic facial attributes encoded in the latent space of Generative Adversarial Networks…

计算机视觉与模式识别 · 计算机科学 2020-11-06 V N S Rama Krishna Pinnimty , Matt Zhao , Palakorn Achananuparp , Ee-Peng Lim