English
Related papers

Related papers: Adaptive Nonlinear Latent Transformation for Condi…

200 papers

We consider unsupervised cell nuclei segmentation in this paper. Exploiting the recently-proposed unpaired image-to-image translation between cell nuclei images and randomly synthetic masks, existing approaches, e.g., CycleGAN, have…

Image and Video Processing · Electrical Eng. & Systems 2022-03-11 Kai Yao , Kaizhu Huang , Jie Sun , Curran Jude

The dominant approach to unsupervised "style transfer" in text is based on the idea of learning a latent representation, which is independent of the attributes specifying its "style". In this paper, we show that this condition is not…

Computation and Language · Computer Science 2019-09-23 Sandeep Subramanian , Guillaume Lample , Eric Michael Smith , Ludovic Denoyer , Marc'Aurelio Ranzato , Y-Lan Boureau

While recent research has progressively overcome the low-resolution constraint of one-shot face video re-enactment with the help of StyleGAN's high-fidelity portrait generation, these approaches rely on at least one of the following:…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Trevine Oorloff , Yaser Yacoob

We present a novel high-resolution face swapping method using the inherent prior knowledge of a pre-trained GAN model. Although previous research can leverage generative priors to produce high-resolution results, their quality can suffer…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Yangyang Xu , Bailin Deng , Junle Wang , Yanqing Jing , Jia Pan , Shengfeng He

As recent advances in Neural Radiance Fields (NeRF) have enabled high-fidelity 3D face reconstruction and novel view synthesis, its manipulation also became an essential task in 3D vision. However, existing manipulation methods require…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Sungwon Hwang , Junha Hyung , Daejin Kim , Min-Jung Kim , Jaegul Choo

This paper tackles the problem of disentangling the latent variables of style and content in language models. We propose a simple yet effective approach, which incorporates auxiliary multi-task and adversarial objectives, for label…

Computation and Language · Computer Science 2018-09-12 Vineet John , Lili Mou , Hareesh Bahuleyan , Olga Vechtomova

Understating and controlling generative models' latent space is a complex task. In this paper, we propose a novel method for learning to control any desired attribute in a pre-trained GAN's latent space, for the purpose of editing…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Nir Diamant , Nitsan Sandor , Alex M Bronstein

The task of age transformation illustrates the change of an individual's appearance over time. Accurately modeling this complex transformation over an input facial image is extremely challenging as it requires making convincing, possibly…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Yuval Alaluf , Or Patashnik , Daniel Cohen-Or

Several factors contribute to the appearance of an object in a visual scene, including pose, illumination, and deformation, among others. Each factor accounts for a source of variability in the data, while the multiplicative interactions of…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Mengjiao Wang , Zhixin Shu , Shiyang Cheng , Yannis Panagakis , Dimitris Samaras , Stefanos Zafeiriou

Recent advances in face manipulation using StyleGAN have produced impressive results. However, StyleGAN is inherently limited to cropped aligned faces at a fixed image resolution it is pre-trained on. In this paper, we propose a simple and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Shuai Yang , Liming Jiang , Ziwei Liu , Chen Change Loy

StyleGAN2 is a state-of-the-art network in generating realistic images. Besides, it was explicitly trained to have disentangled directions in latent space, which allows efficient image manipulation by varying latent factors. Editing…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Yuri Viazovetskyi , Vladimir Ivashkin , Evgeny Kashin

Diffusion-based Image Editing has achieved significant success in recent years. However, it remains challenging to achieve high-quality image editing while maintaining the background similarity without sacrificing speed or memory…

Graphics · Computer Science 2025-09-03 Siyi Liu , Weiming Chen , Yushun Tang , Zhihai He

Semantic face editing has achieved substantial progress in recent years. Known as a growingly popular method, latent space manipulation performs face editing by changing the latent code of an input face to liberate users from painting…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Wenjing Huang , Shikui Tu , Lei Xu

We propose LatentSwap, a simple face swapping framework generating a face swap latent code of a given generator. Utilizing randomly sampled latent codes, our framework is light and does not require datasets besides employing the pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Changho Choi , Minho Kim , Junhyeok Lee , Hyoung-Kyu Song , Younggeun Kim , Seungryong Kim

Current face reenactment and swapping methods mainly rely on GAN frameworks, but recent focus has shifted to pre-trained diffusion models for their superior generation capabilities. However, training these models is resource-intensive, and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Yue Han , Junwei Zhu , Keke He , Xu Chen , Yanhao Ge , Wei Li , Xiangtai Li , Jiangning Zhang , Chengjie Wang , Yong Liu

Motivated by the following two observations: 1) people are aging differently under different conditions for changeable facial attributes, e.g., skin color may become darker when working outside, and 2) it needs to keep some unchanged facial…

Computer Vision and Pattern Recognition · Computer Science 2019-12-23 Haien Zeng , Hanjiang Lai , Jian Yin

Recently, a multitude of methods for image-to-image translation have demonstrated impressive results on problems such as multi-domain or multi-attribute transfer. The vast majority of such works leverages the strengths of adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 James Oldfield , Yannis Panagakis , Mihalis A. Nicolaou

Various controls over the generated data can be extracted from the latent space of a pre-trained GAN, as it implicitly encodes the semantics of the training data. The discovered controls allow to vary semantic attributes in the generated…

Machine Learning · Computer Science 2022-01-28 Perla Doubinsky , Nicolas Audebert , Michel Crucianu , Hervé Le Borgne

Unsupervised text attribute transfer automatically transforms a text to alter a specific attribute (e.g. sentiment) without using any parallel data, while simultaneously preserving its attribute-independent content. The dominant approaches…

Computation and Language · Computer Science 2019-12-13 Ke Wang , Hang Hua , Xiaojun Wan

Traditional face editing methods often require a number of sophisticated and task specific algorithms to be applied one after the other --- a process that is tedious, fragile, and computationally intensive. In this paper, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2017-04-14 Zhixin Shu , Ersin Yumer , Sunil Hadap , Kalyan Sunkavalli , Eli Shechtman , Dimitris Samaras