English
Related papers

Related papers: VIVE3D: Viewpoint-Independent Video Editing using …

200 papers

Drag-based editing has become popular in 2D content creation, driven by the capabilities of image generative models. However, extending this technique to 3D remains a challenge. Existing 3D drag-based editing methods, whether employing…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Honghua Chen , Yushi Lan , Yongwei Chen , Yifan Zhou , Xingang Pan

Digital humans and, especially, 3D facial avatars have raised a lot of attention in the past years, as they are the backbone of several applications like immersive telepresence in AR or VR. Despite the progress, facial avatars reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Berna Kabadayi , Wojciech Zielonka , Bharat Lal Bhatnagar , Gerard Pons-Moll , Justus Thies

Facial attribute editing plays a crucial role in synthesizing realistic faces with specific characteristics while maintaining realistic appearances. Despite advancements, challenges persist in achieving precise, 3D-aware attribute…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Yu-Kai Huang , Yutong Zheng , Yen-Shuo Su , Anudeepsekhar Bolimera , Han Zhang , Fangyi Chen , Marios Savvides

Modern 3D-GANs synthesize geometry and texture by training on large-scale datasets with a consistent structure. Training such models on stylized, artistic data, with often unknown, highly variable geometry, and camera information has not…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Rameen Abdal , Hsin-Ying Lee , Peihao Zhu , Menglei Chai , Aliaksandr Siarohin , Peter Wonka , Sergey Tulyakov

Many recent works have been proposed for face image editing by leveraging the latent space of pretrained GANs. However, few attempts have been made to directly apply them to videos, because 1) they do not guarantee temporal consistency, 2)…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Jiyang Yu , Jingen Liu , Jing Huang , Wei Zhang , Tao Mei

While high fidelity and efficiency are central to the creation of digital head avatars, recent methods relying on 2D or 3D generative models often experience limitations such as shape distortion, expression inaccuracy, and identity…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Xiaochen Zhao , Jingxiang Sun , Lizhen Wang , Jinli Suo , Yebin Liu

While 3D GANs have recently demonstrated the high-quality synthesis of multi-view consistent images and 3D shapes, they are mainly restricted to photo-realistic human portraits. This paper aims to extend 3D GANs to a different, but…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Wonjoon Jin , Nuri Ryu , Geonung Kim , Seung-Hwan Baek , Sunghyun Cho

The ability of Generative Adversarial Networks to encode rich semantics within their latent space has been widely adopted for facial image editing. However, replicating their success with videos has proven challenging. Sets of high-quality…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Rotem Tzaban , Ron Mokady , Rinon Gal , Amit H. Bermano , Daniel Cohen-Or

Animating human face images aims to synthesize a desired source identity in a natural-looking way mimicking a driving video's facial movements. In this context, Generative Adversarial Networks have demonstrated remarkable potential in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Alireza Javanmardi , Alain Pagani , Didier Stricker

We study the problem of synthesizing immersive 3D indoor scenes from one or more images. Our aim is to generate high-resolution images and videos from novel viewpoints, including viewpoints that extrapolate far beyond the input images while…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Jing Yu Koh , Harsh Agrawal , Dhruv Batra , Richard Tucker , Austin Waters , Honglak Lee , Yinfei Yang , Jason Baldridge , Peter Anderson

We present I2V3D, a novel framework for animating static images into dynamic videos with precise 3D control, leveraging the strengths of both 3D geometry guidance and advanced generative models. Our approach combines the precision of a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Zhiyuan Zhang , Dongdong Chen , Jing Liao

3D-aware image synthesis has attracted increasing interest as it models the 3D nature of our real world. However, performing realistic object-level editing of the generated images in the multi-object scenario still remains a challenge.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Qian Wang , Yiqun Wang , Michael Birsak , Peter Wonka

We address the challenging problem of generating facial attributes using a single image in an unconstrained pose. In contrast to prior works that largely consider generation on 2D near-frontal images, we propose a GAN-based framework to…

Computer Vision and Pattern Recognition · Computer Science 2019-07-25 Feng-Ju Chang , Xiang Yu , Ram Nevatia , Manmohan Chandraker

Recent research has witnessed advances in facial image editing tasks including face swapping and face reenactment. However, these methods are confined to dealing with one specific task at a time. In addition, for video facial editing,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-21 Meng Cao , Haozhi Huang , Hao Wang , Xuan Wang , Li Shen , Sheng Wang , Linchao Bao , Zhifeng Li , Jiebo Luo

We propose a framework, called LiftedGAN, that disentangles and lifts a pre-trained StyleGAN2 for 3D-aware face generation. Our model is "3D-aware" in the sense that it is able to (1) disentangle the latent space of StyleGAN2 into texture,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Yichun Shi , Divyansh Aggarwal , Anil K. Jain

The success of the GAN-NeRF structure has enabled face editing on NeRF to maintain 3D view consistency. However, achieving simultaneously multi-view consistency and temporal coherence while editing video sequences remains a formidable…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Hao Zhang , Yu-Wing Tai , Chi-Keung Tang

Despite the growing success of 3D-aware GANs, which can be trained on 2D images to generate high-quality 3D assets, they still rely on multi-view images with camera annotations to synthesize sufficient details from all viewing directions.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Jing Yang , Kyle Fogarty , Fangcheng Zhong , Cengiz Oztireli

Synthesis and reconstruction of 3D human head has gained increasing interests in computer vision and computer graphics recently. Existing state-of-the-art 3D generative adversarial networks (GANs) for 3D human head synthesis are either…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Sizhe An , Hongyi Xu , Yichun Shi , Guoxian Song , Umit Ogras , Linjie Luo

Recent attempts to solve the problem of head reenactment using a single reference image have shown promising results. However, most of them either perform poorly in terms of photo-realism, or fail to meet the identity preservation problem,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Michail Christos Doukas , Stefanos Zafeiriou , Viktoriia Sharmanska

3D-aware generative adversarial networks (GANs) synthesize high-fidelity and multi-view-consistent facial images using only collections of single-view 2D imagery. Towards fine-grained control over facial attributes, recent efforts…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Jingxiang Sun , Xuan Wang , Lizhen Wang , Xiaoyu Li , Yong Zhang , Hongwen Zhang , Yebin Liu