English
Related papers

Related papers: Multi-Directional Subspace Editing in Style-Space

200 papers

Image editing using a pretrained StyleGAN generator has emerged as a powerful paradigm for facial editing, providing disentangled controls over age, expression, illumination, etc. However, the approach cannot be directly adopted for video…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Rameen Abdal , Peihao Zhu , Niloy J. Mitra , Peter Wonka

Recent studies have shown that StyleGANs provide promising prior models for downstream tasks on image synthesis and editing. However, since the latent codes of StyleGANs are designed to control global styles, it is hard to achieve a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Yichun Shi , Xiao Yang , Yangyue Wan , Xiaohui Shen

Recent research has shown that it is possible to find interpretable directions in the latent spaces of pre-trained GANs. These directions enable controllable generation and support a variety of semantic editing operations. While previous…

Computer Vision and Pattern Recognition · Computer Science 2022-02-25 Umut Kocasari , Alperen Bag , Oguz Kaan Yuksel , Pinar Yanardag

The ability to edit facial expressions has a wide range of applications in computer graphics. The ideal facial expression editing algorithm needs to satisfy two important criteria. First, it should allow precise and targeted editing of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Alara Zindancıoğlu , T. Metin Sezgin

We propose a method to disentangle linear-encoded facial semantics from StyleGAN without external supervision. The method derives from linear regression and sparse representation learning concepts to make the disentangled latent…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Yutong Zheng , Yu-Kai Huang , Ran Tao , Zhiqiang Shen , Marios Savvides

Image manipulation with StyleGAN has been an increasing concern in recent years.Recent works have achieved tremendous success in analyzing several semantic latent spaces to edit the attributes of the generated images.However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Rui Wang , Jian Chen , Gang Yu , Li Sun , Changqian Yu , Changxin Gao , Nong Sang

Employing the latent space of pretrained generators has recently been shown to be an effective means for GAN-based face manipulation. The success of this approach heavily relies on the innate disentanglement of the latent space axes of the…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Xianxu Hou , Linlin Shen , Or Patashnik , Daniel Cohen-Or , Hui Huang

The success of StyleGAN has enabled unprecedented semantic editing capabilities, on both synthesized and real images. However, such editing operations are either trained with semantic supervision or described using human guidance. In…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Rameen Abdal , Peihao Zhu , John Femiani , Niloy J. Mitra , Peter Wonka

High-quality, diverse, and photorealistic images can now be generated by unconditional GANs (e.g., StyleGAN). However, limited options exist to control the generation process using (semantic) attributes, while still preserving the quality…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Rameen Abdal , Peihao Zhu , Niloy Mitra , Peter Wonka

Real-world objects perform complex motions that involve multiple independent motion components. For example, while talking, a person continuously changes their expressions, head, and body pose. In this work, we propose a novel method to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Rishubh Parihar , Raghav Magazine , Piyush Tiwari , R. Venkatesh Babu

Existing attribute editing methods treat semantic attributes as binary, resulting in a single edit per attribute. However, attributes such as eyeglasses, smiles, or hairstyles exhibit a vast range of diversity. In this work, we formulate…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Rishubh Parihar , Prasanna Balaji , Raghav Magazine , Sarthak Vora , Tejan Karmali , Varun Jampani , R. Venkatesh Babu

The semantic controllability of StyleGAN is enhanced by unremitting research. Although the existing weak supervision methods work well in manipulating the style codes along one attribute, the accuracy of manipulating multiple attributes is…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Bingchuan Li , Shaofei Cai , Wei Liu , Peng Zhang , Qian He , Miao Hua , Zili Yi

Editing of portrait images is a very popular and important research topic with a large variety of applications. For ease of use, control should be provided via a semantically meaningful parameterization that is akin to computer animation…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Ayush Tewari , Mohamed Elgharib , Mallikarjun B R. , Florian Bernard , Hans-Peter Seidel , Patrick Pérez , Michael Zollhöfer , Christian Theobalt

We present StyleFusion, a new mapping architecture for StyleGAN, which takes as input a number of latent codes and fuses them into a single style code. Inserting the resulting style code into a pre-trained StyleGAN generator results in a…

Computer Vision and Pattern Recognition · Computer Science 2021-07-16 Omer Kafri , Or Patashnik , Yuval Alaluf , Daniel Cohen-Or

Recent works for face editing usually manipulate the latent space of StyleGAN via the linear semantic directions. However, they usually suffer from the entanglement of facial attributes, need to tune the optimal editing strength, and are…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Zhizhong Huang , Siteng Ma , Junping Zhang , Hongming Shan

The discovery of interpretable directions in the latent spaces of pre-trained GAN models has recently become a popular topic. In particular, StyleGAN2 has enabled various image generation and manipulation tasks due to its rich and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Enis Simsar , Umut Kocasari , Ezgi Gülperi Er , Pinar Yanardag

Recent advances in generative adversarial networks (GANs) have led to remarkable achievements in face image synthesis. While methods that use style-based GANs can generate strikingly photorealistic face images, it is often difficult to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Safa C. Medin , Bernhard Egger , Anoop Cherian , Ye Wang , Joshua B. Tenenbaum , Xiaoming Liu , Tim K. Marks

The latent space of GANs contains rich semantics reflecting the training data. Different methods propose to learn edits in latent space corresponding to semantic attributes, thus allowing to modify generated images. Most supervised methods…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Perla Doubinsky , Nicolas Audebert , Michel Crucianu , Hervé Le Borgne

In this paper, we propose $\tau$GAN a tensor-based method for modeling the latent space of generative models. The objective is to identify semantic directions in latent space. To this end, we propose to fit a multilinear tensor model on a…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 René Haas , Stella Graßhof , Sami Sebastian Brandt

Conditional GANs are frequently used for manipulating the attributes of face images, such as expression, hairstyle, pose, or age. Even though the state-of-the-art models successfully modify the requested attributes, they simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Adrian Suwała , Bartosz Wójcik , Magdalena Proszewska , Jacek Tabor , Przemysław Spurek , Marek Śmieja