English
Related papers

Related papers: Revealing Directions for Text-guided 3D Face Editi…

200 papers

We propose ClipFace, a novel self-supervised approach for text-guided editing of textured 3D morphable model of faces. Specifically, we employ user-friendly language prompts to enable control of the expressions as well as appearance of 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Shivangi Aneja , Justus Thies , Angela Dai , Matthias Nießner

Diffusion models dominate image editing, yet their global denoising mechanism entangles edited regions with surrounding context, causing modifications to propagate into areas that should remain intact. We propose a fundamentally different…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Wei Chow , Linfeng Li , Xian Sun , Lingdong Kong , Zefeng Li , Qi Xu , Hang Song , Tian Ye , Xian Wang , Jinbin Bai , Shilin Xu , Xiangtai Li , Junting Pan , Shaoteng Liu , Ran Zhou , Tianshu Yang , Songhua Liu

This paper tackles text-guided control of StyleGAN for editing garments in full-body human images. Existing StyleGAN-based methods suffer from handling the rich diversity of garments and body shapes and poses. We propose a framework for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Takato Yoshikawa , Yuki Endo , Yoshihiro Kanamori

We propose a simple yet powerful Landmark guided Generative Adversarial Network (LandmarkGAN) for the facial expression-to-expression translation using a single image, which is an important and challenging task in computer vision since the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Hao Tang , Nicu Sebe

While Generative Adversarial Networks (GANs) have recently found applications in image editing, most previous GAN-based image editing methods require largescale datasets with semantic segmentation annotations for training, only provide high…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Yuhan Cao , Haoran Jiang , Zhenghong Yu , Qi Li , Xuyang Li

Manipulating facial expressions is a challenging task due to fine-grained shape changes produced by facial muscles and the lack of input-output pairs for supervised learning. Unlike previous methods using Generative Adversarial Networks…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Rumeysa Bodur , Binod Bhattarai , Tae-Kyun Kim

We explore and analyze the latent style space of StyleGAN2, a state-of-the-art architecture for image generation, using models pretrained on several different datasets. We first show that StyleSpace, the space of channel-wise style…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Zongze Wu , Dani Lischinski , Eli Shechtman

Facial expression transfer and reenactment has been an important research problem given its applications in face editing, image manipulation, and fabricated videos generation. We present a novel method for image-based facial expression…

Computer Vision and Pattern Recognition · Computer Science 2019-12-16 Chao Yang , Ser-Nam Lim

Recent studies have shown how disentangling images into content and feature spaces can provide controllable image translation/ manipulation. In this paper, we propose a framework to enable utilizing discrete multi-labels to control which…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Guanqi Zhan , Yihao Zhao , Bingchan Zhao , Haoqi Yuan , Baoquan Chen , Hao Dong

Can a text-to-image diffusion model be used as a training objective for adapting a GAN generator to another domain? In this paper, we show that the classifier-free guidance can be leveraged as a critic and enable generators to distill…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Kunpeng Song , Ligong Han , Bingchen Liu , Dimitris Metaxas , Ahmed Elgammal

The ability to create high-quality 3D faces from a single image has become increasingly important with wide applications in video conferencing, AR/VR, and advanced video editing in movie industries. In this paper, we propose Face Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Hao Zhang , Yanbo Xu , Tianyuan Dai , Yu-Wing Tai , Chi-Keung Tang

Generative adversarial networks (GANs) have attained photo-realistic quality in image generation. However, how to best control the image content remains an open challenge. We introduce LatentKeypointGAN, a two-stage GAN which is trained…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xingzhe He , Bastian Wandt , Helge Rhodin

Image generation has recently seen tremendous advances, with diffusion models allowing to synthesize convincing images for a large variety of text prompts. In this article, we propose DiffEdit, a method to take advantage of text-conditioned…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Guillaume Couairon , Jakob Verbeek , Holger Schwenk , Matthieu Cord

Face personalization aims to insert specific faces, taken from images, into pretrained text-to-image diffusion models. However, it is still challenging for previous methods to preserve both the identity similarity and editability due to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Kaede Shiohara , Toshihiko Yamasaki

Text-to-image diffusion models have revolutionized image synthesis and editing, but precise control over stylistic attributes remains a challenge, often causing unintended content modifications. We propose an approach for fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Max Reimann , Benito Buchheim , Jürgen Döllner

The creation of manufacturable and editable 3D shapes through Computer-Aided Design (CAD) remains a highly manual and time-consuming task, hampered by the complex topology of boundary representations of 3D solids and unintuitive design…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Md Ferdous Alam , Faez Ahmed

We train a feed-forward text-to-3D diffusion generator for human characters using only single-view 2D data for supervision. Existing 3D generative models cannot yet match the fidelity of image or video generative models. State-of-the-art 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Souhaib Attaiki , Paul Guerrero , Duygu Ceylan , Niloy J. Mitra , Maks Ovsjanikov

Despite the ability of existing large-scale text-to-image (T2I) models to generate high-quality images from detailed textual descriptions, they often lack the ability to precisely edit the generated or real images. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Chong Mou , Xintao Wang , Jiechong Song , Ying Shan , Jian Zhang

Evaluating diffusion-based image-editing models is a crucial task in the field of Generative AI. Specifically, it is imperative to assess their capacity to execute diverse editing tasks while preserving the image content and realism. While…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Stefan Stefanache , Lluís Pastor Pérez , Julen Costa Watanabe , Ernesto Sanchez Tejedor , Thomas Hofmann , Enis Simsar

High-quality, diverse, and photorealistic images can now be generated by unconditional GANs (e.g., StyleGAN). However, limited options exist to control the generation process using (semantic) attributes, while still preserving the quality…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Rameen Abdal , Peihao Zhu , Niloy Mitra , Peter Wonka