English
Related papers

Related papers: CGOF++: Controllable 3D Face Synthesis with Condit…

200 papers

We propose NeRF-Insert, a NeRF editing framework that allows users to make high-quality local edits with a flexible level of control. Unlike previous work that relied on image-to-image models, we cast scene editing as an in-painting…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Benet Oriol Sabat , Alessandro Achille , Matthew Trager , Stefano Soatto

Text-to-3D form plays a crucial role in creating editable 3D scenes for AR/VR. Recent advances have shown promise in merging neural radiance fields (NeRFs) with pre-trained diffusion models for text-to-3D object generation. However, one…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Haotian Bai , Yuanhuiyi Lyu , Lutao Jiang , Sijia Li , Haonan Lu , Xiaodong Lin , Lin Wang

The use of coarse-grained layouts for controllable synthesis of complex scene images via deep generative models has recently gained popularity. However, results of current approaches still fall short of their promise of high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Manuel Jahn , Robin Rombach , Björn Ommer

Tremendous progress in deep generative models has led to photorealistic image synthesis. While achieving compelling results, most approaches operate in the two-dimensional image domain, ignoring the three-dimensional nature of our world.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Michael Niemeyer , Andreas Geiger

Nerf-based Generative models have shown impressive capacity in generating high-quality images with consistent 3D geometry. Despite successful synthesis of fake identity images randomly sampled from latent space, adopting these models for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Yu Yin , Kamran Ghasedi , HsiangTao Wu , Jiaolong Yang , Xin Tong , Yun Fu

Pedestrian motion, due to its causal nature, is strongly influenced by domain gaps arising from discrepancies between training and testing data distributions. Focusing on 3D human pose estimation, this work presents a controllable human…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Xinhao Hu , Yiyi Zhang , Liqing Zhang , Jianfu Zhang

We introduce InseRF, a novel method for generative object insertion in the NeRF reconstructions of 3D scenes. Based on a user-provided textual description and a 2D bounding box in a reference viewpoint, InseRF generates new objects in 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Mohamad Shahbazi , Liesbeth Claessens , Michael Niemeyer , Edo Collins , Alessio Tonioni , Luc Van Gool , Federico Tombari

We propose NeRFiller, an approach that completes missing portions of a 3D capture via generative 3D inpainting using off-the-shelf 2D visual generative models. Often parts of a captured 3D scene or object are missing due to mesh…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Ethan Weber , Aleksander Hołyński , Varun Jampani , Saurabh Saxena , Noah Snavely , Abhishek Kar , Angjoo Kanazawa

In this paper, we propose an approach to obtain a personalized generative prior with explicit control over a set of attributes. We build upon MyStyle, a recently introduced method, that tunes the weights of a pre-trained StyleGAN face…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Libing Zeng , Lele Chen , Yi Xu , Nima Kalantari

We propose DiscoFaceGAN, an approach for face image generation of virtual people with disentangled, precisely-controllable latent representations for identity of non-existing people, expression, pose, and illumination. We embed 3D priors…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Yu Deng , Jiaolong Yang , Dong Chen , Fang Wen , Xin Tong

Semantic Image Synthesis (SIS) is among the most popular and effective techniques in the field of face generation and editing, thanks to its good generation quality and the versatility is brings along. Recent works attempted to go beyond…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Alex Ergasti , Claudio Ferrari , Tomaso Fontanini , Massimo Bertozzi , Andrea Prati

Recent advances in generative diffusion models have enabled the previously unfeasible capability of generating 3D assets from a single input image or a text prompt. In this work, we aim to enhance the quality and functionality of these…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Xiyi Chen , Marko Mihajlovic , Shaofei Wang , Sergey Prokudin , Siyu Tang

The ability to create high-quality 3D faces from a single image has become increasingly important with wide applications in video conferencing, AR/VR, and advanced video editing in movie industries. In this paper, we propose Face Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Hao Zhang , Yanbo Xu , Tianyuan Dai , Yu-Wing Tai , Chi-Keung Tang

Portrait editing is a popular subject in photo manipulation. The Generative Adversarial Network (GAN) advances the generating of realistic faces and allows more face editing. In this paper, we argue about three issues in existing…

Computer Vision and Pattern Recognition · Computer Science 2019-05-27 Shuyang Gu , Jianmin Bao , Hao Yang , Dong Chen , Fang Wen , Lu Yuan

Image blending aims to combine multiple images seamlessly. It remains challenging for existing 2D-based methods, especially when input images are misaligned due to differences in 3D camera poses and object shapes. To tackle these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Hyunsu Kim , Gayoung Lee , Yunjey Choi , Jin-Hwa Kim , Jun-Yan Zhu

The vanilla Generative Adversarial Networks (GAN) are commonly used to generate realistic images depicting aged and rejuvenated faces. However, the performance of such vanilla GANs in the age-oriented face synthesis task is often…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Haoyi Wang , Victor Sanchez , Chang-Tsun Li

We introduce the Multi-Instance Generation (MIG) task, which focuses on generating multiple instances within a single image, each accurately placed at predefined positions with attributes such as category, color, and shape, strictly…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Dewei Zhou , You Li , Fan Ma , Zongxin Yang , Yi Yang

Recent advances in neural scene representations have led to unprecedented quality in 3D reconstruction and view synthesis. Despite achieving high-quality results for common benchmarks with curated data, outputs often degrade for data that…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Michael Niemeyer , Fabian Manhardt , Marie-Julie Rakotosaona , Michael Oechsle , Christina Tsalicoglou , Keisuke Tateno , Jonathan T. Barron , Federico Tombari

Recent advances in deep learning have significantly increased the performance of face recognition systems. The performance and reliability of these models depend heavily on the amount and quality of the training data. However, the…

Computer Vision and Pattern Recognition · Computer Science 2018-02-19 Adam Kortylewski , Andreas Schneider , Thomas Gerig , Bernhard Egger , Andreas Morel-Forster , Thomas Vetter

3D-aware image generative modeling aims to generate 3D-consistent images with explicitly controllable camera poses. Recent works have shown promising results by training neural radiance field (NeRF) generators on unstructured 2D images, but…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Yu Deng , Jiaolong Yang , Jianfeng Xiang , Xin Tong