English
Related papers

Related papers: Zero-shot Text-driven Physically Interpretable Fac…

200 papers

Implicit fields have recently shown increasing success in representing and learning 3D shapes accurately. Signed distance fields and occupancy fields are decades old and still the preferred representations, both with well-studied…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Edoardo Mello Rella , Ajad Chhatkuli , Ender Konukoglu , Luc Van Gool

Text-guided image editing has advanced rapidly with the rise of diffusion models. While flow-based inversion-free methods offer high efficiency by avoiding latent inversion, they often fail to effectively integrate source information,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Kaixiang Yang , Boyang Shen , Xin Li , Yuchen Dai , Yuxuan Luo , Yueran Ma , Wei Fang , Qiang Li , Zhiwei Wang

Recent large-scale text-driven synthesis models have attracted much attention thanks to their remarkable capabilities of generating highly diverse images that follow given text prompts. Such text-based synthesis methods are particularly…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Amir Hertz , Ron Mokady , Jay Tenenbaum , Kfir Aberman , Yael Pritch , Daniel Cohen-Or

Zero-shot, training-free, image-based text-to-video generation is an emerging area that aims to generate videos using existing image-based diffusion models. Current methods in this space require specific architectural changes to image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Diljeet Jagpal , Xi Chen , Vinay P. Namboodiri

The existing text-guided image synthesis methods can only produce limited quality results with at most \mbox{$\text{256}^2$} resolution and the textual instructions are constrained in a small Corpus. In this work, we propose a unified…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Weihao Xia , Yujiu Yang , Jing-Hao Xue , Baoyuan Wu

We propose Fast text2StyleGAN, a natural language interface that adapts pre-trained GANs for text-guided human face synthesis. Leveraging the recent advances in Contrastive Language-Image Pre-training (CLIP), no text data is required during…

Computer Vision and Pattern Recognition · Computer Science 2022-09-09 Xiaodan Du , Raymond A. Yeh , Nicholas Kolkin , Eli Shechtman , Greg Shakhnarovich

Prompt-driven image analysis converts a single natural-language instruction into multiple steps: locate, segment, edit, and describe. We present a practical case study of a unified pipeline that combines open-vocabulary detection,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Kaleem Ahmad

Image inversion is a fundamental task in generative models, aiming to map images back to their latent representations to enable downstream applications such as editing, restoration, and style transfer. This paper provides a comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Yinan Chen , Jiangning Zhang , Yali Bi , Xiaobin Hu , Teng Hu , Zhucun Xue , Ran Yi , Yong Liu , Ying Tai

Facial Beauty Prediction (FBP) is a challenging computer vision task due to its subjective nature and the subtle, holistic features that influence human perception. Prevailing methods, often based on deep convolutional networks or standard…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Djamel Eddine Boukhari , Ali chemsa

Existing text-to-image editing methods tend to excel either in rigid or non-rigid editing but encounter challenges when combining both, resulting in misaligned outputs with the provided text prompts. In addition, integrating reference…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Jiacheng Wang , Ping Liu , Wei Xu

Recent advances in diffusion models have enabled high-quality generation and manipulation of images guided by texts, as well as concept learning from images. However, naive applications of existing methods to editing tasks that require…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Xudong Liu , Zikun Chen , Ruowei Jiang , Ziyi Wu , Kejia Yin , Han Zhao , Parham Aarabi , Igor Gilitschenski

The remarkable success in text-to-image diffusion models has motivated extensive investigation of their potential for video applications. Zero-shot techniques aim to adapt image diffusion models for videos without requiring further model…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Shuai Yang , Junxin Lin , Yifan Zhou , Ziwei Liu , Chen Change Loy

Recent facial image synthesis methods have been mainly based on conditional generative models. Sketch-based conditions can effectively describe the geometry of faces, including the contours of facial components, hair structures, as well as…

Graphics · Computer Science 2021-07-20 Shu-Yu Chen , Feng-Lin Liu , Yu-Kun Lai , Paul L. Rosin , Chunpeng Li , Hongbo Fu , Lin Gao

Facial Image inpainting aim is to restore the missing or corrupted regions in face images while preserving identity, structural consistency and photorealistic image quality, a task specifically created for photo restoration. Though there…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Abhigyan Bhattacharya , Hiranmoy Roy , Debotosh Bhattacharjee

In image editing, it is essential to incorporate a context image to convey the user's precise requirements, such as subject appearance or image style. Existing training-based visual context-aware editing methods incur data collection effort…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Rui Song , Guo-Hua Wang , Qing-Guo Chen , Weihua Luo , Tongda Xu , Zhening Liu , Yan Wang , Zehong Lin , Jun Zhang

We present an invert-and-edit framework to automatically transform facial weight of an input face image to look thinner or heavier by leveraging semantic facial attributes encoded in the latent space of Generative Adversarial Networks…

Computer Vision and Pattern Recognition · Computer Science 2020-11-06 V N S Rama Krishna Pinnimty , Matt Zhao , Palakorn Achananuparp , Ee-Peng Lim

This paper presents a novel approach for text/speech-driven animation of a photo-realistic head model based on blend-shape geometry, dynamic textures, and neural rendering. Training a VAE for geometry and texture yields a parametric model…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Wolfgang Paier , Anna Hilsmann , Peter Eisert

Current talking face generation methods mainly focus on speech-lip synchronization. However, insufficient investigation on the facial talking style leads to a lifeless and monotonous avatar. Most previous works fail to imitate expressive…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Liyang Chen , Zhiyong Wu , Runnan Li , Weihong Bao , Jun Ling , Xu Tan , Sheng Zhao

Image editing has been a long-standing challenge in the research community with its far-reaching impact on numerous applications. Recently, text-driven methods started to deliver promising results in domains like human faces, but their…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Chaerin Kong , Seungyong Lee , Soohyeok Im , Wonsuk Yang

We present a framework for training GANs with explicit control over generated images. We are able to control the generated image by settings exact attributes such as age, pose, expression, etc. Most approaches for editing GAN-generated…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Alon Shoshan , Nadav Bhonker , Igor Kviatkovsky , Gerard Medioni