English
Related papers

Related papers: AvatarMMC: 3D Head Avatar Generation and Editing w…

200 papers

The field of image generation through generative modelling is abundantly discussed nowadays. It can be used for various applications, such as up-scaling existing images, creating non-existing objects, such as interior design scenes,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Giorgia Adorni , Felix Boelter , Stefano Carlo Lambertenghi

This paper introduces Multi-Garment Customized Model Generation, a unified framework based on Latent Diffusion Models (LDMs) aimed at addressing the unexplored task of synthesizing images with free combinations of multiple pieces of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Yichen Liu , Penghui Du , Yi Liu Quanwei Zhang

This paper proposes the decision tree latent controller generative adversarial network (DTLC-GAN), an extension of a GAN that can learn hierarchically interpretable representations without relying on detailed supervision. To impose a…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Takuhiro Kaneko , Kaoru Hiramatsu , Kunio Kashino

Attribute image manipulation has been a very active topic since the introduction of Generative Adversarial Networks (GANs). Exploring the disentangled attribute space within a transformation is a very challenging task due to the multiple…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Andrés Romero , Luc Van Gool , Radu Timofte

While high fidelity and efficiency are central to the creation of digital head avatars, recent methods relying on 2D or 3D generative models often experience limitations such as shape distortion, expression inaccuracy, and identity…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Xiaochen Zhao , Jingxiang Sun , Lizhen Wang , Jinli Suo , Yebin Liu

We present a unified and generalizable framework for synthesizing view-consistent and temporally coherent avatars from a single image, addressing the challenging task of single-image avatar generation. Existing diffusion-based methods often…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Yixing Lu , Junting Dong , Youngjoong Kwon , Qin Zhao , Bo Dai , Fernando De la Torre

This paper proposes a novel model for video generation and especially makes the attempt to deal with the problem of video generation from text descriptions, i.e., synthesizing realistic videos conditioned on given texts. Existing video…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Hongyuan Yu , Yan Huang , Lihong Pi , Liang Wang

Recent advances in generative adversarial networks (GANs) have demonstrated the capabilities of generating stunning photo-realistic portrait images. While some prior works have applied such image GANs to unconditional 2D portrait video…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Zhongcong Xu , Jianfeng Zhang , Jun Hao Liew , Wenqing Zhang , Song Bai , Jiashi Feng , Mike Zheng Shou

Current 3D GAN inversion methods for human heads typically use only one single frontal image to reconstruct the whole 3D head model. This leaves out meaningful information when multi-view data or dynamic videos are available. Our method…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Florian Barthel , Anna Hilsmann , Peter Eisert

Talking head video generation aims to produce a synthetic human face video that contains the identity and pose information respectively from a given source image and a driving video.Existing works for this task heavily rely on 2D…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Fa-Ting Hong , Longhao Zhang , Li Shen , Dan Xu

Medical image processing has been highlighted as an area where deep learning-based models have the greatest potential. However, in the medical field in particular, problems of data availability and privacy are hampering research progress…

Image and Video Processing · Electrical Eng. & Systems 2023-10-27 Christoph Angermann , Johannes Bereiter-Payr , Kerstin Stock , Markus Haltmeier , Gerald Degenhart

We present a novel approach for generating animatable 3D-aware art avatars from a single image, with controllable facial expressions, head poses, and shoulder movements. Unlike previous reenactment methods, our approach utilizes a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Shaoxu Li

Despite the remarkable process of talking-head-based avatar-creating solutions, directly generating anchor-style videos with full-body motions remains challenging. In this study, we propose Make-Your-Anchor, a novel system necessitating…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Ziyao Huang , Fan Tang , Yong Zhang , Xiaodong Cun , Juan Cao , Jintao Li , Tong-Yee Lee

Generative Adversarial Networks (GANs) have received a great deal of attention due in part to recent success in generating original, high-quality samples from visual domains. However, most current methods only allow for users to guide this…

Graphics · Computer Science 2019-04-05 Eric Heim

It is known that the inconsistent distribution and representation of different modalities, such as image and text, cause the heterogeneity gap that makes it challenging to correlate such heterogeneous data. Generative adversarial networks…

Multimedia · Computer Science 2018-04-27 Yuxin Peng , Jinwei Qi , Yuxin Yuan

We propose a unified game-theoretical framework to perform classification and conditional image generation given limited supervision. It is formulated as a three-player minimax game consisting of a generator, a classifier and a…

Machine Learning · Computer Science 2020-09-15 Chongxuan Li , Kun Xu , Jiashuo Liu , Jun Zhu , Bo Zhang

Generative models are undoubtedly a hot topic in Artificial Intelligence, among which the most common type is Generative Adversarial Networks (GANs). These architectures let one synthesise artificial datasets by implicitly modelling the…

Machine Learning · Computer Science 2020-07-07 Francisco J. Ibarrola , Nishant Ravikumar , Alejandro F. Frangi

Diffusion models have recently become the de-facto approach for generative modeling in the 2D domain. However, extending diffusion models to 3D is challenging due to the difficulties in acquiring 3D ground truth data for training. On the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Jiatao Gu , Qingzhe Gao , Shuangfei Zhai , Baoquan Chen , Lingjie Liu , Josh Susskind

Multi-view volumetric rendering techniques have recently shown great potential in modeling and synthesizing high-quality head avatars. A common approach to capture full head dynamic performances is to track the underlying geometry using a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Kartik Teotia , Mallikarjun B R , Xingang Pan , Hyeongwoo Kim , Pablo Garrido , Mohamed Elgharib , Christian Theobalt

We introduce SimAvatar, a framework designed to generate simulation-ready clothed 3D human avatars from a text prompt. Current text-driven human avatar generation methods either model hair, clothing, and the human body using a unified…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Xueting Li , Ye Yuan , Shalini De Mello , Gilles Daviet , Jonathan Leaf , Miles Macklin , Jan Kautz , Umar Iqbal