中文
相关论文

相关论文: Text2Control3D: Controllable 3D Avatar Generation …

200 篇论文

Volumetric neural rendering methods, such as neural radiance fields (NeRFs), have enabled photo-realistic novel view synthesis. However, in their standard form, NeRFs do not support the editing of objects, such as a human head, within a…

计算机视觉与模式识别 · 计算机科学 2022-06-15 ShahRukh Athar , Zexiang Xu , Kalyan Sunkavalli , Eli Shechtman , Zhixin Shu

Previous portrait image generation methods roughly fall into two categories: 2D GANs and 3D-aware GANs. 2D GANs can generate high fidelity portraits but with low view consistency. 3D-aware GAN methods can maintain view consistency but their…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Jingxiang Sun , Xuan Wang , Yong Zhang , Xiaoyu Li , Qi Zhang , Yebin Liu , Jue Wang

The advancement of text-driven 3D content editing has been blessed by the progress from 2D generative diffusion models. However, a major obstacle hindering the widespread adoption of 3D content editing is its time-intensive processing. This…

计算机视觉与模式识别 · 计算机科学 2023-12-29 Liangchen Song , Liangliang Cao , Jiatao Gu , Yifan Jiang , Junsong Yuan , Hao Tang

Controllable generation of 3D assets is important for many practical applications like content creation in movies, games and engineering, as well as in AR/VR. Recently, diffusion models have shown remarkable results in generation quality of…

计算机视觉与模式识别 · 计算机科学 2024-08-01 Philipp Schröppel , Christopher Wewer , Jan Eric Lenssen , Eddy Ilg , Thomas Brox

We introduce AvatarForge, a framework for generating animatable 3D human avatars from text or image inputs using AI-driven procedural generation. While diffusion-based methods have made strides in general 3D object generation, they struggle…

计算机视觉与模式识别 · 计算机科学 2025-03-12 Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang

Diffusion models have emerged as a powerful generative method, capable of producing stunning photo-realistic images from natural language descriptions. However, these models lack explicit control over the 3D structure in the generated…

计算机视觉与模式识别 · 计算机科学 2024-04-05 Wufei Ma , Qihao Liu , Jiahao Wang , Angtian Wang , Xiaoding Yuan , Yi Zhang , Zihao Xiao , Guofeng Zhang , Beijia Lu , Ruxiao Duan , Yongrui Qi , Adam Kortylewski , Yaoyao Liu , Alan Yuille

We propose ClipFace, a novel self-supervised approach for text-guided editing of textured 3D morphable model of faces. Specifically, we employ user-friendly language prompts to enable control of the expressions as well as appearance of 3D…

计算机视觉与模式识别 · 计算机科学 2023-04-25 Shivangi Aneja , Justus Thies , Angela Dai , Matthias Nießner

Digital human avatars aim to simulate the dynamic appearance of humans in virtual environments, enabling immersive experiences across gaming, film, virtual reality, and more. However, the conventional process for creating and animating…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Felix Taubner , Ruihang Zhang , Mathieu Tuli , Sherwin Bahmani , David B. Lindell

We present a unified and generalizable framework for synthesizing view-consistent and temporally coherent avatars from a single image, addressing the challenging task of single-image avatar generation. Existing diffusion-based methods often…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Yixing Lu , Junting Dong , Youngjoong Kwon , Qin Zhao , Bo Dai , Fernando De la Torre

Text-guided 3D face synthesis has achieved remarkable results by leveraging text-to-image (T2I) diffusion models. However, most existing works focus solely on the direct generation, ignoring the editing, restricting them from synthesizing…

计算机视觉与模式识别 · 计算机科学 2023-12-04 Yunjie Wu , Yapeng Meng , Zhipeng Hu , Lincheng Li , Haoqian Wu , Kun Zhou , Weiwei Xu , Xin Yu

Diffusion models have recently become the de-facto approach for generative modeling in the 2D domain. However, extending diffusion models to 3D is challenging due to the difficulties in acquiring 3D ground truth data for training. On the…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Jiatao Gu , Qingzhe Gao , Shuangfei Zhai , Baoquan Chen , Lingjie Liu , Josh Susskind

Generating high-fidelity 3D avatars from text or image prompts is highly sought after in virtual reality and human-computer interaction. However, existing text-driven methods often rely on iterative Score Distillation Sampling (SDS) or CLIP…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Hong Li , Yutang Feng , Minqi Meng , Yichen Yang , Xuhui Liu , Baochang Zhang

The creation of 3D human face avatars from a single unconstrained image is a fundamental task that underlies numerous real-world vision and graphics applications. Despite the significant progress made in generative models, existing methods…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Wenqing Wang , Haosen Yang , Josef Kittler , Xiatian Zhu

Similar to facial beautification in real life, 3D virtual avatars require personalized customization to enhance their visual appeal, yet this area remains insufficiently explored. Although current 3D Gaussian editing methods can be adapted…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Yiming Zhong , Xiaolin Zhang , Ligang Liu , Yao Zhao , Yunchao Wei

Traditional 3D morphable face models (3DMMs) provide fine-grained control over expression but cannot easily capture geometric and appearance details. Neural volumetric representations approach photorealism but are hard to animate and do not…

计算机视觉与模式识别 · 计算机科学 2022-11-07 Yufeng Zheng , Victoria Fernández Abrevaya , Marcel C. Bühler , Xu Chen , Michael J. Black , Otmar Hilliges

Recent breakthroughs in text-to-image synthesis have been driven by diffusion models trained on billions of image-text pairs. Adapting this approach to 3D synthesis would require large-scale datasets of labeled 3D data and efficient…

计算机视觉与模式识别 · 计算机科学 2022-09-30 Ben Poole , Ajay Jain , Jonathan T. Barron , Ben Mildenhall

We present READ Avatars, a 3D-based approach for generating 2D avatars that are driven by audio input with direct and granular control over the emotion. Previous methods are unable to achieve realistic animation due to the many-to-many…

计算机视觉与模式识别 · 计算机科学 2023-03-02 Jack Saunders , Vinay Namboodiri

Diffusion-based video generation techniques have significantly improved zero-shot talking-head avatar generation, enhancing the naturalness of both head motion and facial expressions. However, existing methods suffer from poor…

图形学 · 计算机科学 2025-04-24 Lingzhou Mu , Baiji Liu , Ruonan Zhang , Guiming Mo , Jiawei Jin , Kai Zhang , Haozhi Huang

Reconstructing personalized animatable head avatars has significant implications in the fields of AR/VR. Existing methods for achieving explicit face control of 3D Morphable Models (3DMM) typically rely on multi-view images or videos of a…

计算机视觉与模式识别 · 计算机科学 2023-11-14 Haoyu Ma , Tong Zhang , Shanlin Sun , Xiangyi Yan , Kun Han , Xiaohui Xie

Text-to-image diffusion models are gradually introduced into computer graphics, recently enabling the development of Text-to-3D pipelines in an open domain. However, for interactive editing purposes, local manipulations of content through a…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Aryan Mikaeili , Or Perel , Mehdi Safaee , Daniel Cohen-Or , Ali Mahdavi-Amiri