English
Related papers

Related papers: CLIP-Guided StyleGAN Inversion for Text-Driven Rea…

200 papers

Face recognition systems store face templates for efficient matching. Once leaked, these templates pose a threat: inverting them can yield photorealistic surrogates that compromise privacy and enable impersonation. Although existing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Longchen Dai , Zixuan Shen , Zhiheng Zhou , Peipeng Yu , Zhihua Xia

High quality facial image editing is a challenging problem in the movie post-production industry, requiring a high degree of control and identity preservation. Previous works that attempt to tackle this problem may suffer from the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Xu Yao , Alasdair Newson , Yann Gousseau , Pierre Hellier

The large-scale visual-language pre-trained model, Contrastive Language-Image Pre-training (CLIP), has significantly improved image captioning for scenarios without human-annotated image-caption pairs. Recent advanced CLIP-based image…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Jiarui Yu , Haoran Li , Yanbin Hao , Bin Zhu , Tong Xu , Xiangnan He

Diffusion-based point editing methods have gained significant traction in image editing tasks due to their ability to manipulate image semantics and fine details by applying localized perturbations on the manifold of noise latent. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Haoyang Hu , Masataka Seo , Yen-Wei Chen

Photorealistic editing of portraits is a challenging task as humans are very sensitive to inconsistencies in faces. We present an approach for high-quality intuitive editing of the camera viewpoint and scene illumination in a portrait…

Deep generative models like StyleGAN hold the promise of semantic image editing: modifying images by their content, rather than their pixel values. Unfortunately, working with arbitrary images requires inverting the StyleGAN generator,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Yohan Poirier-Ginter , Alexandre Lessard , Ryan Smith , Jean-François Lalonde

Recently, we have seen a surge of personalization methods for text-to-image (T2I) diffusion models to learn a concept using a few images. Existing approaches, when used for face personalization, suffer to achieve convincing inversion with…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Rishubh Parihar , Sachidanand VS , Sabariswaran Mani , Tejan Karmali , R. Venkatesh Babu

In recent years, image editing has advanced remarkably. With increased human control, it is now possible to edit an image in a plethora of ways; from specifying in text what we want to change, to straight up dragging the contents of the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Thao Nguyen , Utkarsh Ojha , Yuheng Li , Haotian Liu , Yong Jae Lee

Real-world image manipulation has achieved fantastic progress in recent years as a result of the exploration and utilization of GAN latent spaces. GAN inversion is the first step in this pipeline, which aims to map the real image to the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Tan M. Dinh , Anh Tuan Tran , Rang Nguyen , Binh-Son Hua

While the quality of GAN image synthesis has improved tremendously in recent years, our ability to control and condition the output is still limited. Focusing on StyleGAN, we introduce a simple and effective method for making local,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Edo Collins , Raja Bala , Bob Price , Sabine Süsstrunk

The StyleGAN family succeed in high-fidelity image generation and allow for flexible and plausible editing of generated images by manipulating the semantic-rich latent style space.However, projecting a real image into its latent space…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Bingchuan Li , Tianxiang Ma , Peng Zhang , Miao Hua , Wei Liu , Qian He , Zili Yi

Generative Adversarial Networks (GANs) with style-based generators (e.g. StyleGAN) successfully enable semantic control over image synthesis, and recent studies have also revealed that interpretable image translations could be obtained by…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Yunfan Liu , Qi Li , Zhenan Sun , Tieniu Tan

Recently, a surge of face editing techniques have been proposed to employ the pretrained StyleGAN for semantic manipulation. To successfully edit a real image, one must first convert the input image into StyleGAN's latent variables.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Yin Yu , Ghasedi Kamran , Wu HsiangTao , Yang Jiaolong , Tong Xi , Fu Yun

Editing of portrait images is a very popular and important research topic with a large variety of applications. For ease of use, control should be provided via a semantically meaningful parameterization that is akin to computer animation…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Ayush Tewari , Mohamed Elgharib , Mallikarjun B R. , Florian Bernard , Hans-Peter Seidel , Patrick Pérez , Michael Zollhöfer , Christian Theobalt

Face reenactment methods attempt to restore and re-animate portrait videos as realistically as possible. Existing methods face a dilemma in quality versus controllability: 2D GAN-based methods achieve higher image quality but suffer in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Lizhen Wang , Xiaochen Zhao , Jingxiang Sun , Yuxiang Zhang , Hongwen Zhang , Tao Yu , Yebin Liu

Text-guided image editing is an essential task that enables users to modify images through natural language descriptions. Recent advances in diffusion models and rectified flows have significantly improved editing quality, primarily relying…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yufei Wang , Lanqing Guo , Zhihao Li , Jiaxing Huang , Pichao Wang , Bihan Wen , Jian Wang

We present a novel image inversion framework and a training pipeline to achieve high-fidelity image inversion with high-quality attribute editing. Inverting real images into StyleGAN's latent space is an extensively studied problem, yet the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Hamza Pehlivan , Yusuf Dalva , Aysegul Dundar

The inversion of real images into StyleGAN's latent space is a well-studied problem. Nevertheless, applying existing approaches to real-world scenarios remains an open challenge, due to an inherent trade-off between reconstruction and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Yuval Alaluf , Omer Tov , Ron Mokady , Rinon Gal , Amit H. Bermano

Our goal is to develop fine-grained real-image editing methods suitable for real-world applications. In this paper, we first summarize four requirements for these methods and propose a novel diffusion-based image editing framework with…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Naoki Matsunaga , Masato Ishii , Akio Hayakawa , Kenji Suzuki , Takuya Narihira

With the rise of large, publicly-available text-to-image diffusion models, text-guided real image editing has garnered much research attention recently. Existing methods tend to either rely on some form of per-instance or per-task…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Adham Elarabawy , Harish Kamath , Samuel Denton