English
Related papers

Related papers: Fast Text-to-3D-Aware Face Generation and Manipula…

200 papers

We present an unsupervised approach for learning to estimate three dimensional (3D) facial structure from a single image while also predicting 3D viewpoint transformations that match a desired pose and facial geometry. We achieve this by…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Joel Ruben Antony Moniz , Christopher Beckham , Simon Rajotte , Sina Honari , Christopher Pal

Text-to-Face (TTF) synthesis is a challenging task with great potential for diverse computer vision applications. Compared to Text-to-Image (TTI) synthesis tasks, the textual description of faces can be much more complicated and detailed…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Tianren Wang , Teng Zhang , Brian Lovell

Generating face image with specific gaze information has attracted considerable attention. Existing approaches typically input gaze values directly for face generation, which is unnatural and requires annotated gaze datasets for training,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Hengfei Wang , Zhongqun Zhang , Yihua Cheng , Hyung Jin Chang

Emotionally talking head video generation aims to generate expressive portrait videos with accurate lip synchronization and emotional facial expressions. Current methods rely on simple emotional labels, leading to insufficient semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Yahui Li , Yinfeng Yu , Liejun Wang , Shengjie Shen

Many 3D generative models rely on variational autoencoders (VAEs) to learn compact shape representations. However, existing methods encode all shapes into a fixed-size token, disregarding the inherent variations in scale and complexity…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Kangle Deng , Hsueh-Ti Derek Liu , Yiheng Zhu , Xiaoxia Sun , Chong Shang , Kiran Bhat , Deva Ramanan , Jun-Yan Zhu , Maneesh Agrawala , Tinghui Zhou

Current controls over diffusion models (e.g., through text or ControlNet) for image generation fall short in recognizing abstract, continuous attributes like illumination direction or non-rigid shape change. In this paper, we present an…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Ta-Ying Cheng , Matheus Gadelha , Thibault Groueix , Matthew Fisher , Radomir Mech , Andrew Markham , Niki Trigoni

The ability to generate diverse 3D articulated head avatars is vital to a plethora of applications, including augmented reality, cinematography, and education. Recent work on text-guided 3D object generation has shown great promise in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Alexander W. Bergman , Wang Yifan , Gordon Wetzstein

Text-driven 3D scene generation is widely applicable to video gaming, film industry, and metaverse applications that have a large demand for 3D scenes. However, existing text-to-3D generation methods are limited to producing 3D objects with…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Jingbo Zhang , Xiaoyu Li , Ziyu Wan , Can Wang , Jing Liao

Text-to-3D is an emerging task that allows users to create 3D content with infinite possibilities. Existing works tackle the problem by optimizing a 3D representation with guidance from pre-trained diffusion models. An apparent drawback is…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Yiji Cheng , Fei Yin , Xiaoke Huang , Xintong Yu , Jiaxiang Liu , Shikun Feng , Yujiu Yang , Yansong Tang

We present Face0, a novel way to instantaneously condition a text-to-image generation model on a face, in sample time, without any optimization procedures such as fine-tuning or inversions. We augment a dataset of annotated images with…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Dani Valevski , Danny Wasserman , Yossi Matias , Yaniv Leviathan

This work presents 3DPE, a practical method that can efficiently edit a face image following given prompts, like reference images or text descriptions, in a 3D-aware manner. To this end, a lightweight module is distilled from a 3D portrait…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Qingyan Bai , Zifan Shi , Yinghao Xu , Hao Ouyang , Qiuyu Wang , Ceyuan Yang , Xuan Wang , Gordon Wetzstein , Yujun Shen , Qifeng Chen

While impressive progress has recently been made in image-oriented facial attribute translation, shape-oriented 3D facial attribute translation remains an unsolved issue. This is primarily limited by the lack of 3D generative models and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Zhenfeng Fan , Zhiheng Zhang , Shuang Yang , Chongyang Zhong , Min Cao , Shihong Xia

We propose ID-to-3D, a method to generate identity- and text-guided 3D human heads with disentangled expressions, starting from even a single casually captured in-the-wild image of a subject. The foundation of our approach is anchored in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Francesca Babiloni , Alexandros Lattas , Jiankang Deng , Stefanos Zafeiriou

In facial image generation, current text-to-image models often suffer from facial attribute leakage and insufficient physical consistency when responding to local semantic instructions. In this study, we propose Face-MakeUpV2, a facial…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Dawei Dai , Yinxiu Zhou , Chenghang Li , Guolai Jiang , Chengfang Zhang

Learned 3D representations of human faces are useful for computer vision problems such as 3D face tracking and reconstruction from images, as well as graphics applications such as character generation and animation. Traditional models learn…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Anurag Ranjan , Timo Bolkart , Soubhik Sanyal , Michael J. Black

Recent strides in Text-to-3D techniques have been propelled by distilling knowledge from powerful large text-to-image diffusion models (LDMs). Nonetheless, existing Text-to-3D approaches often grapple with challenges such as…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Yiwen Chen , Chi Zhang , Xiaofeng Yang , Zhongang Cai , Gang Yu , Lei Yang , Guosheng Lin

In recent years, deep convolutional neural networks (CNN) have significantly advanced face detection. In particular, lightweight CNNbased architectures have achieved great success due to their lowcomplexity structure facilitating real-time…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Guangtao Wang , Jun Li , Zhijian Wu , Jianhua Xu , Jifeng Shen , Wankou Yang

The current advances in generative AI for learning large neural network models with the capability to produce essays, images, music and even 3D assets from text prompts create opportunities for a manifold of disciplines. In the present…

Computation and Language · Computer Science 2023-07-06 Thiago Rios , Stefan Menzel , Bernhard Sendhoff

Identity preserving editing of faces is a generative task that enables modifying the illumination, adding/removing eyeglasses, face aging, editing hairstyles, modifying expression etc., while preserving the identity of the face. Recent…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Vishal Vinod

3D face editing is a significant task in multimedia, aimed at the manipulation of 3D face models across various control signals. The success of 3D-aware GAN provides expressive 3D models learned from 2D single-view images only, encouraging…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Zhuo Chen , Yichao Yan , Sehngqi Liu , Yuhao Cheng , Weiming Zhao , Lincheng Li , Mengxiao Bi , Xiaokang Yang