English
Related papers

Related papers: Discovering Multiple and Diverse Directions for Co…

200 papers

We present a method for finding paths in a deep generative model's latent space that can maximally vary one set of image features while holding others constant. Crucially, unlike past traversal approaches, ours can manipulate…

Computer Vision and Pattern Recognition · Computer Science 2022-01-26 Guha Balakrishnan , Raghudeep Gadde , Aleix Martinez , Pietro Perona

Despite the success of diffusion models (DMs), we still lack a thorough understanding of their latent space. While image editing with GANs builds upon latent space, DMs rely on editing the conditions such as text prompts. We present an…

Computer Vision and Pattern Recognition · Computer Science 2023-02-27 Yong-Hyun Park , Mingi Kwon , Junghyo Jo , Youngjung Uh

With the advantages of fast inference and human-friendly flexible manipulation, image-agnostic style manipulation via text guidance enables new applications that were not previously available. The state-of-the-art text-guided image-agnostic…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Yoonjeon Kim , Hyunsu Kim , Junho Kim , Yunjey Choi , Eunho Yang

Denoising Diffusion Models (DDMs) have emerged as a strong competitor to Generative Adversarial Networks (GANs). However, despite their widespread use in image synthesis and editing applications, their latent space is still not as well…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 René Haas , Inbar Huberman-Spiegelglas , Rotem Mulayoff , Stella Graßhof , Sami S. Brandt , Tomer Michaeli

Generative models make huge progress to the photorealistic image synthesis in recent years. To enable human to steer the image generation process and customize the output, many works explore the interpretable dimensions of the latent space…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Jianyuan Wang , Lalit Bhagat , Ceyuan Yang , Yinghao Xu , Yujun Shen , Hongdong Li , Bolei Zhou

We propose an image-to-image translation framework for facial attribute editing with disentangled interpretable latent directions. Facial attribute editing task faces the challenges of targeted attribute editing with controllable strength…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yusuf Dalva , Hamza Pehlivan , Cansu Moran , Öykü Irmak Hatipoğlu , Ayşegül Dündar

We present a framework for training GANs with explicit control over generated images. We are able to control the generated image by settings exact attributes such as age, pose, expression, etc. Most approaches for editing GAN-generated…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Alon Shoshan , Nadav Bhonker , Igor Kviatkovsky , Gerard Medioni

This paper is on face/head reenactment where the goal is to transfer the facial pose (3D head orientation and expression) of a target face to a source face. Previous methods focus on learning embedding networks for identity and pose…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Stella Bounareli , Vasileios Argyriou , Georgios Tzimiropoulos

Mitigating biases in generative AI and, particularly in text-to-image models, is of high importance given their growing implications in society. The biased datasets used for training pose challenges in ensuring the responsible development…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Carolina Lopez Olmos , Alexandros Neophytou , Sunando Sengupta , Dim P. Papadopoulos

As applications of generative AI become mainstream, it is important to understand what generative models are capable of producing, and the extent to which one can predictably control their outputs. In this paper, we propose a visualization…

Human-Computer Interaction · Computer Science 2024-07-01 Sangwon Jeong , Mingwei Li , Matthew Berger , Shusen Liu

Image manipulation with StyleGAN has been an increasing concern in recent years.Recent works have achieved tremendous success in analyzing several semantic latent spaces to edit the attributes of the generated images.However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Rui Wang , Jian Chen , Gang Yu , Li Sun , Changqian Yu , Changxin Gao , Nong Sang

We propose a novel method for solving regression tasks using few-shot or weak supervision. At the core of our method is the fundamental observation that GANs are incredibly successful at encoding semantic information within their latent…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Yotam Nitzan , Rinon Gal , Ofir Brenner , Daniel Cohen-Or

Text-driven image manipulation is developed since the vision-language model (CLIP) has been proposed. Previous work has adopted CLIP to design a text-image consistency-based objective to address this issue. However, these methods require…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Wanfeng Zheng , Qiang Li , Xiaoyan Guo , Pengfei Wan , Zhongyuan Wang

This work addresses the problem of discovering, in an unsupervised manner, interpretable paths in the latent space of pretrained GANs, so as to provide an intuitive and easy way of controlling the underlying generative factors. In doing so,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Christos Tzelepis , Georgios Tzimiropoulos , Ioannis Patras

We propose a novel model named Multi-Channel Attention Selection Generative Adversarial Network (SelectionGAN) for guided image-to-image translation, where we translate an input image into another while respecting an external semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Hao Tang , Philip H. S. Torr , Nicu Sebe

Generative Adversarial Network (GAN) is widely adopted in numerous application areas, such as data preprocessing, image editing, and creativity support. However, GAN's 'black box' nature prevents non-expert users from controlling what data…

Human-Computer Interaction · Computer Science 2022-08-16 Noyan Evirgen , Xiang 'Anthony' Chen

Semantic editing of images is the fundamental goal of computer vision. Although deep learning methods, such as generative adversarial networks (GANs), are capable of producing high-quality images, they often do not have an inherent way of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Takehiro Aoshima , Takashi Matsubara

Generative Adversarial Networks (GANs) with style-based generators (e.g. StyleGAN) successfully enable semantic control over image synthesis, and recent studies have also revealed that interpretable image translations could be obtained by…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Yunfan Liu , Qi Li , Zhenan Sun , Tieniu Tan

Generative models such as Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs) play an increasingly important role in medical image analysis. The latent spaces of these models often show semantically meaningful…

Image and Video Processing · Electrical Eng. & Systems 2022-07-21 Julian Schön , Raghavendra Selvan , Jens Petersen

Attribute image manipulation has been a very active topic since the introduction of Generative Adversarial Networks (GANs). Exploring the disentangled attribute space within a transformation is a very challenging task due to the multiple…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Andrés Romero , Luc Van Gool , Radu Timofte