English
Related papers

Related papers: Towards High-Fidelity Text-Guided 3D Face Generati…

200 papers

Text-to-Face (TTF) synthesis is a challenging task with great potential for diverse computer vision applications. Compared to Text-to-Image (TTI) synthesis tasks, the textual description of faces can be much more complicated and detailed…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Tianren Wang , Teng Zhang , Brian Lovell

Automatic 3D facial texture generation has gained significant interest recently. Existing approaches may not support the traditional physically based rendering pipeline or rely on 3D data captured by Light Stage. Our key contribution is a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Chi Wang , Junming Huang , Rong Zhang , Qi Wang , Haotian Yang , Haibin Huang , Chongyang Ma , Weiwei Xu

The ability to generate diverse 3D articulated head avatars is vital to a plethora of applications, including augmented reality, cinematography, and education. Recent work on text-guided 3D object generation has shown great promise in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Alexander W. Bergman , Wang Yifan , Gordon Wetzstein

The existing text-guided image synthesis methods can only produce limited quality results with at most \mbox{$\text{256}^2$} resolution and the textual instructions are constrained in a small Corpus. In this work, we propose a unified…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Weihao Xia , Yujiu Yang , Jing-Hao Xue , Baoyuan Wu

The manipulation of latent space has recently become an interesting topic in the field of generative models. Recent research shows that latent directions can be used to manipulate images towards certain attributes. However, controlling the…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Zehranaz Canfes , M. Furkan Atasoy , Alara Dirik , Pinar Yanardag

In recent years, there has been significant progress in 2D generative face models fueled by applications such as animation, synthetic data generation, and digital avatars. However, due to the absence of 3D information, these 2D models often…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Aashish Rai , Hiresh Gupta , Ayush Pandey , Francisco Vicente Carrasco , Shingo Jason Takagi , Amaury Aubel , Daeil Kim , Aayush Prakash , Fernando de la Torre

Photo-realistic and controllable 3D avatars are crucial for various applications such as virtual and mixed reality (VR/MR), telepresence, gaming, and film production. Traditional methods for avatar creation often involve time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Keqiang Sun , Amin Jourabloo , Riddhish Bhalodia , Moustafa Meshry , Yu Rong , Zhengyu Yang , Thu Nguyen-Phuoc , Christian Haene , Jiu Xu , Sam Johnson , Hongsheng Li , Sofien Bouaziz

We present GuidedSceneGen, a text-to-3D generation framework that produces metrically accurate, globally consistent, and semantically interpretable indoor scenes. Unlike prior text-driven methods that often suffer from geometric drift or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Stefan Ainetter , Thomas Deixelberger , Edoardo A. Dominici , Philipp Drescher , Konstantinos Vardis , Markus Steinberger

We present Face0, a novel way to instantaneously condition a text-to-image generation model on a face, in sample time, without any optimization procedures such as fine-tuning or inversions. We augment a dataset of annotated images with…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Dani Valevski , Danny Wasserman , Yossi Matias , Yaniv Leviathan

Text-to-image diffusion models have achieved widespread popularity due to their unprecedented image generation capability. In particular, their ability to synthesize and modify human faces has spurred research into using generated face…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Harrison Rosenberg , Shimaa Ahmed , Guruprasad V Ramesh , Ramya Korlakai Vinayak , Kassem Fawaz

Synthesizing images from text descriptions has become an active research area with the advent of Generative Adversarial Networks. The main goal here is to generate photo-realistic images that are aligned with the input descriptions.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 D. M. A. Ayanthi , Sarasi Munasinghe

Over the past few years, single-view 3D face reconstruction methods can produce beautiful 3D models. Nevertheless,the input of these works is unobstructed faces.We describe a system designed to reconstruct convincing face texture in the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Dapeng Zhao , Yue Qi

Recent methods in text-to-3D leverage powerful pretrained diffusion models to optimize NeRF. Notably, these methods are able to produce high-quality 3D scenes without training on 3D data. Due to the open-ended nature of the task, most…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Yuze He , Yushi Bai , Matthieu Lin , Wang Zhao , Yubin Hu , Jenny Sheng , Ran Yi , Juanzi Li , Yong-Jin Liu

Text-guided domain adaptation and generation of 3D-aware portraits find many applications in various fields. However, due to the lack of training data and the challenges in handling the high variety of geometry and appearance, the existing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Biwen Lei , Kai Yu , Mengyang Feng , Miaomiao Cui , Xuansong Xie

We propose ClipFace, a novel self-supervised approach for text-guided editing of textured 3D morphable model of faces. Specifically, we employ user-friendly language prompts to enable control of the expressions as well as appearance of 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Shivangi Aneja , Justus Thies , Angela Dai , Matthias Nießner

3D content creation plays a vital role in various applications, such as gaming, robotics simulation, and virtual reality. However, the process is labor-intensive and time-consuming, requiring skilled designers to invest considerable effort…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Chenhan Jiang

3D-controllable portrait synthesis has significantly advanced, thanks to breakthroughs in generative adversarial networks (GANs). However, it is still challenging to manipulate existing face images with precise 3D control. While…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Yuchen Liu , Zhixin Shu , Yijun Li , Zhe Lin , Richard Zhang , S. Y. Kung

The generation of 3D scenes from user-specified conditions offers a promising avenue for alleviating the production burden in 3D applications. Previous studies required significant effort to realize the desired scene, owing to limited…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Takayuki Hara , Tatsuya Harada

Generative Networks have proved to be extremely effective in image restoration and reconstruction in the past few years. Generating faces from textual descriptions is one such application where the power of generative algorithms can be…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Sandeep Shinde , Tejas Pradhan , Aniket Ghorpade , Mihir Tale

Recent advances in diffusion models such as ControlNet have enabled geometrically controllable, high-fidelity text-to-image generation. However, none of them addresses the question of adding such controllability to text-to-3D generation. In…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Sungwon Hwang , Junha Hyung , Jaegul Choo