中文
相关论文

相关论文: Text and Image Guided 3D Avatar Generation and Man…

200 篇论文

Controllability, generalizability and efficiency are the major objectives of constructing face avatars represented by neural implicit field. However, existing methods have not managed to accommodate the three requirements simultaneously.…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Zhiyuan Ma , Xiangyu Zhu , Guojun Qi , Zhen Lei , Lei Zhang

Recent advancements in 3D Gaussian Splatting (3DGS) have unlocked significant potential for modeling 3D head avatars, providing greater flexibility than mesh-based methods and more efficient rendering compared to NeRF-based approaches.…

计算机视觉与模式识别 · 计算机科学 2024-11-07 Peizhi Yan , Rabab Ward , Qiang Tang , Shan Du

Face attribute editing aims to generate faces with one or multiple desired face attributes manipulated while other details are preserved. Unlike prior works such as GAN inversion, which has an expensive reverse mapping process, we propose a…

计算机视觉与模式识别 · 计算机科学 2021-02-24 Zhiliang Xu , Xiyu Yu , Zhibin Hong , Zhen Zhu , Junyu Han , Jingtuo Liu , Errui Ding , Xiang Bai

In this paper we present, to the best of our knowledge, the first method to learn a generative model of 3D shapes from natural images in a fully unsupervised way. For example, we do not use any ground truth 3D or 2D annotations, stereo…

计算机视觉与模式识别 · 计算机科学 2019-10-02 Attila Szabó , Givi Meishvili , Paolo Favaro

Controllable semantic image editing enables a user to change entire image attributes with a few clicks, e.g., gradually making a summer scene look like it was taken in winter. Classic approaches for this task use a Generative Adversarial…

计算机视觉与模式识别 · 计算机科学 2021-03-30 Peiye Zhuang , Oluwasanmi Koyejo , Alexander G. Schwing

We study the problem of 3D-aware full-body human generation, aiming at creating animatable human avatars with high-quality textures and geometries. Generally, two challenges remain in this field: i) existing methods struggle to generate…

计算机视觉与模式识别 · 计算机科学 2023-10-05 Xuanmeng Zhang , Jianfeng Zhang , Rohan Chacko , Hongyi Xu , Guoxian Song , Yi Yang , Jiashi Feng

Creating realistic 3D facial animation is crucial for various applications in the movie production and gaming industry, especially with the burgeoning demand in the metaverse. However, prevalent methods such as blendshape-based approaches…

计算机视觉与模式识别 · 计算机科学 2023-08-14 Haoyu Wang , Haozhe Wu , Junliang Xing , Jia Jia

Traditional 3D content creation tools empower users to bring their imagination to life by giving them direct control over a scene's geometry, appearance, motion, and camera path. Creating computer-generated videos, however, is a tedious…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Shengqu Cai , Duygu Ceylan , Matheus Gadelha , Chun-Hao Paul Huang , Tuanfeng Yang Wang , Gordon Wetzstein

Generative adversarial networks (GANs) can generate high-quality images from sampled latent codes. Recent works attempt to edit an image by manipulating its underlying latent code, but rarely go beyond the basic task of attribute…

计算机视觉与模式识别 · 计算机科学 2021-04-21 Minjun Li , Yanghua Jin , Huachun Zhu

We propose DiscoFaceGAN, an approach for face image generation of virtual people with disentangled, precisely-controllable latent representations for identity of non-existing people, expression, pose, and illumination. We embed 3D priors…

计算机视觉与模式识别 · 计算机科学 2020-09-07 Yu Deng , Jiaolong Yang , Dong Chen , Fang Wen , Xin Tong

We introduce SimAvatar, a framework designed to generate simulation-ready clothed 3D human avatars from a text prompt. Current text-driven human avatar generation methods either model hair, clothing, and the human body using a unified…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Xueting Li , Ye Yuan , Shalini De Mello , Gilles Daviet , Jonathan Leaf , Miles Macklin , Jan Kautz , Umar Iqbal

Modern 3D-GANs synthesize geometry and texture by training on large-scale datasets with a consistent structure. Training such models on stylized, artistic data, with often unknown, highly variable geometry, and camera information has not…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Rameen Abdal , Hsin-Ying Lee , Peihao Zhu , Menglei Chai , Aliaksandr Siarohin , Peter Wonka , Sergey Tulyakov

Unconstrained Image generation with high realism is now possible using recent Generative Adversarial Networks (GANs). However, it is quite challenging to generate images with a given set of attributes. Recent methods use style-based GAN…

计算机视觉与模式识别 · 计算机科学 2022-07-21 Rishubh Parihar , Ankit Dhiman , Tejan Karmali , R. Venkatesh Babu

Recent years have seen an explosion of work and interest in text-to-3D shape generation. Much of the progress is driven by advances in 3D representations, large-scale pretraining and representation learning for text and image data enabling…

计算机视觉与模式识别 · 计算机科学 2024-03-21 Han-Hung Lee , Manolis Savva , Angel X. Chang

Shape generation is the practice of producing 3D shapes as various representations for 3D content creation. Previous studies on 3D shape generation have focused on shape quality and structure, without or less considering the importance of…

计算机视觉与模式识别 · 计算机科学 2023-08-17 Ruowei Wang , Yu Liu , Pei Su , Jianwei Zhang , Qijun Zhao

We propose a method for synthesizing edited photo-realistic digital avatars with text instructions. Given a short monocular RGB video and text instructions, our method uses an image-conditioned diffusion model to edit one head image and…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Shaoxu Li

Recently, we have witnessed the explosive growth of various volumetric representations in modeling animatable head avatars. However, due to the diversity of frameworks, there is no practical method to support high-level applications like 3D…

计算机视觉与模式识别 · 计算机科学 2024-04-03 Chong Bao , Yinda Zhang , Yuan Li , Xiyu Zhang , Bangbang Yang , Hujun Bao , Marc Pollefeys , Guofeng Zhang , Zhaopeng Cui

In this paper, we investigate an open research task of generating controllable 3D textured shapes from the given textual descriptions. Previous works either require ground truth caption labeling or extensive optimization time. To resolve…

计算机视觉与模式识别 · 计算机科学 2023-03-24 Jiacheng Wei , Hao Wang , Jiashi Feng , Guosheng Lin , Kim-Hui Yap

This paper presents LatentPatch, a new method for generating realistic images from a small dataset of only a few images. We use a lightweight model with only a few thousand parameters. Unlike traditional few-shot generation methods that…

多媒体 · 计算机科学 2024-01-31 Benjamin Samuth , Julien Rabin , David Tschumperlé , Frédéric Jurie

We present an interactive approach to synthesizing realistic variations in facial hair in images, ranging from subtle edits to existing hair to the addition of complex and challenging hair in images of clean-shaven subjects. To circumvent…

计算机视觉与模式识别 · 计算机科学 2020-04-16 Kyle Olszewski , Duygu Ceylan , Jun Xing , Jose Echevarria , Zhili Chen , Weikai Chen , Hao Li