中文
相关论文

相关论文: Text2Control3D: Controllable 3D Avatar Generation …

200 篇论文

With the success of Neural Radiance Field (NeRF) in 3D-aware portrait editing, a variety of works have achieved promising results regarding both quality and 3D consistency. However, these methods heavily rely on per-prompt optimization when…

计算机视觉与模式识别 · 计算机科学 2024-02-05 Jianhui Li , Shilong Liu , Zidong Liu , Yikai Wang , Kaiwen Zheng , Jinghui Xu , Jianmin Li , Jun Zhu

Recent research has demonstrated that the combination of pretrained diffusion models with neural radiance fields (NeRFs) has emerged as a promising approach for text-to-3D generation. Simply coupling NeRF with diffusion models will result…

计算机视觉与模式识别 · 计算机科学 2023-06-19 Lu Yu , Wei Xiang , Kang Han

3D asset generation is getting massive amounts of attention, inspired by the recent success of text-guided 2D content creation. Existing text-to-3D methods use pretrained text-to-image diffusion models in an optimization problem or…

计算机视觉与模式识别 · 计算机科学 2024-07-30 Lukas Höllein , Aljaž Božič , Norman Müller , David Novotny , Hung-Yu Tseng , Christian Richardt , Michael Zollhöfer , Matthias Nießner

The manipulation of latent space has recently become an interesting topic in the field of generative models. Recent research shows that latent directions can be used to manipulate images towards certain attributes. However, controlling the…

计算机视觉与模式识别 · 计算机科学 2022-02-15 Zehranaz Canfes , M. Furkan Atasoy , Alara Dirik , Pinar Yanardag

Recent advances in Neural Radiance Fields (NeRFs) have made it possible to reconstruct and reanimate dynamic portrait scenes with control over head-pose, facial expressions and viewing direction. However, training such models assumes…

计算机视觉与模式识别 · 计算机科学 2023-09-22 ShahRukh Athar , Zhixin Shu , Zexiang Xu , Fujun Luan , Sai Bi , Kalyan Sunkavalli , Dimitris Samaras

Generating 3D human models directly from text helps reduce the cost and time of character modeling. However, achieving multi-attribute controllable and realistic 3D human avatar generation is still challenging due to feature coupling and…

计算机视觉与模式识别 · 计算机科学 2024-03-21 Chaoqun Gong , Yuqin Dai , Ronghui Li , Achun Bao , Jun Li , Jian Yang , Yachao Zhang , Xiu Li

Capturing and editing full head performances enables the creation of virtual characters with various applications such as extended reality and media production. The past few years witnessed a steep rise in the photorealism of human head…

3D generation has raised great attention in recent years. With the success of text-to-image diffusion models, the 2D-lifting technique becomes a promising route to controllable 3D generation. However, these methods tend to present…

计算机视觉与模式识别 · 计算机科学 2024-03-13 Tianyu Huang , Yihan Zeng , Zhilu Zhang , Wan Xu , Hang Xu , Songcen Xu , Rynson W. H. Lau , Wangmeng Zuo

Unsupervised generation of clothed virtual humans with various appearance and animatable poses is important for creating 3D human avatars and other AR/VR applications. Existing methods are either limited to rigid object modeling, or not…

计算机视觉与模式识别 · 计算机科学 2022-08-02 Jianfeng Zhang , Zihang Jiang , Dingdong Yang , Hongyi Xu , Yichun Shi , Guoxian Song , Zhongcong Xu , Xinchao Wang , Jiashi Feng

Text-guided domain adaptation and generation of 3D-aware portraits find many applications in various fields. However, due to the lack of training data and the challenges in handling the high variety of geometry and appearance, the existing…

计算机视觉与模式识别 · 计算机科学 2024-04-15 Biwen Lei , Kai Yu , Mengyang Feng , Miaomiao Cui , Xuansong Xie

3D modeling holds significant importance in the realms of AR/VR and gaming, allowing for both artistic creativity and practical applications. However, the process is often time-consuming and demands a high level of skill. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2024-02-28 Eddy Chu , Yiyang Chen , Chedy Raissi , Anand Bhojan

Text-to-3D generation has recently garnered significant attention, fueled by 2D diffusion models trained on billions of image-text pairs. Existing methods primarily rely on score distillation to leverage the 2D diffusion priors to supervise…

计算机视觉与模式识别 · 计算机科学 2023-07-27 Chaohui Yu , Qiang Zhou , Jingliang Li , Zhe Zhang , Zhibin Wang , Fan Wang

Existing text-based 3D generation methods generate attractive results but lack detailed geometry control. Sketches, known for their conciseness and expressiveness, have contributed to intuitive 3D modeling but are confined to producing…

图形学 · 计算机科学 2024-05-15 Feng-Lin Liu , Hongbo Fu , Yu-Kun Lai , Lin Gao

Text-to-image diffusion models generate impressive and realistic images, but do they learn to represent the 3D world from only 2D supervision? We demonstrate that yes, certain 3D scene representations are encoded in the text embedding space…

计算机视觉与模式识别 · 计算机科学 2024-07-29 James Burgess , Kuan-Chieh Wang , Serena Yeung-Levy

Recent advancements in text-to-image generation have enabled significant progress in zero-shot 3D shape generation. This is achieved by score distillation, a methodology that uses pre-trained text-to-image diffusion models to optimize the…

计算机视觉与模式识别 · 计算机科学 2023-05-29 Zhenzhen Weng , Zeyu Wang , Serena Yeung

Recent work on 3D-aware image synthesis has achieved compelling results using advances in neural rendering. However, 3D-aware synthesis of face dynamics hasn't received much attention. Here, we study how to explicitly control generative…

计算机视觉与模式识别 · 计算机科学 2022-10-13 Peiye Zhuang , Liqian Ma , Oluwasanmi Koyejo , Alexander G. Schwing

Conversation is an essential component of virtual avatar activities in the metaverse. With the development of natural language processing, textual and vocal conversation generation has achieved a significant breakthrough. However,…

计算机视觉与模式识别 · 计算机科学 2023-08-15 Yichao Yan , Zanwei Zhou , Zi Wang , Jingnan Gao , Xiaokang Yang

High-quality reconstruction of controllable 3D head avatars from 2D videos is highly desirable for virtual human applications in movies, games, and telepresence. Neural implicit fields provide a powerful representation to model 3D head…

计算机视觉与模式识别 · 计算机科学 2023-04-24 Chuhan Chen , Matthew O'Toole , Gaurav Bharaj , Pablo Garrido

Recent advances in diffusion models have made significant progress in digital human generation. However, most existing models still struggle to maintain 3D consistency, temporal coherence, and motion accuracy. A key reason for these…

图形学 · 计算机科学 2025-03-21 Xuan Gao , Jingtao Zhou , Dongyu Liu , Yuqi Zhou , Juyong Zhang

Recent talking avatar generation models have made strides in achieving realistic and accurate lip synchronization with the audio, but often fall short in controlling and conveying detailed expressions and emotions of the avatar, making the…

计算机视觉与模式识别 · 计算机科学 2024-05-27 Yuchi Wang , Junliang Guo , Jianhong Bai , Runyi Yu , Tianyu He , Xu Tan , Xu Sun , Jiang Bian