English
Related papers

Related papers: Generative Occupancy Fields for 3D Surface-Aware I…

200 papers

Neural Radiance Fields (NeRFs) have demonstrated the remarkable potential of neural networks to capture the intricacies of 3D objects. By encoding the shape and color information within neural network weights, NeRFs excel at producing…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Dawid Malarz , Weronika Smolak , Jacek Tabor , Sławomir Tadeja , Przemysław Spurek

Textures are a vital aspect of creating visually appealing and realistic 3D models. In this paper, we study the problem of generating high-fidelity texture given shapes of 3D assets, which has been relatively less explored compared with…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 An-Chieh Cheng , Xueting Li , Sifei Liu , Xiaolong Wang

Advanced techniques using Neural Radiance Fields (NeRF), Signed Distance Fields (SDF), and Occupancy Fields have recently emerged as solutions for 3D indoor scene reconstruction. We introduce a novel two-phase learning approach, H2O-SDF,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Minyoung Park , Mirae Do , YeonJae Shin , Jaeseok Yoo , Jongkwang Hong , Joongrock Kim , Chul Lee

Capitalizing on the recent advances in image generation models, existing controllable face image synthesis methods are able to generate high-fidelity images with some levels of controllability, e.g., controlling the shapes, expressions,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Keqiang Sun , Shangzhe Wu , Ning Zhang , Zhaoyang Huang , Quan Wang , Hongsheng Li

Image blending aims to combine multiple images seamlessly. It remains challenging for existing 2D-based methods, especially when input images are misaligned due to differences in 3D camera poses and object shapes. To tackle these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Hyunsu Kim , Gayoung Lee , Yunjey Choi , Jin-Hwa Kim , Jun-Yan Zhu

Deep generative models allow for photorealistic image synthesis at high resolutions. But for many applications, this is not enough: content creation also needs to be controllable. While several recent works investigate how to disentangle…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Michael Niemeyer , Andreas Geiger

The advancement of generative radiance fields has pushed the boundary of 3D-aware image synthesis. Motivated by the observation that a 3D object should look realistic from multiple viewpoints, these methods introduce a multi-view constraint…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Xingang Pan , Xudong Xu , Chen Change Loy , Christian Theobalt , Bo Dai

This paper introduces a novel paradigm for the generalizable neural radiance field (NeRF). Previous generic NeRF methods combine multiview stereo techniques with image-based neural rendering for generalization, yielding impressive results,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Jiaxu Wang , Ziyi Zhang , Renjing Xu

This paper introduces a novel continual learning framework for synthesising novel views of multiple scenes, learning multiple 3D scenes incrementally, and updating the network parameters only with the training data of the upcoming new…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Yuze Wang , Junyi Wang , Chen Wang , Wantong Duan , Yongtang Bao , Yue Qi

The advent of deep learning has led to significant progress in monocular human reconstruction. However, existing representations, such as parametric models, voxel grids, meshes and implicit neural representations, have difficulties…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Qiao Feng , Yebin Liu , Yu-Kun Lai , Jingyu Yang , Kun Li

Virtual environments (VEs) are pivotal for virtual, augmented, and mixed reality systems. Despite advances in 3D generation and reconstruction, the direct creation of 3D objects within an established 3D scene (represented as NeRF) for novel…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Peng Dai , Feitong Tan , Xin Yu , Yifan Peng , Yinda Zhang , Xiaojuan Qi

Neural radiance fields~(NeRF) have recently been applied to render large-scale scenes. However, their limited model capacity typically results in blurred rendering results. Existing large-scale NeRFs primarily address this limitation by…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Mingqi Shao , Feng Xiong , Hang Zhang , Shuang Yang , Mu Xu , Wei Bian , Xueqian Wang

Neural radiance fields, which represent a 3D scene as a color field and a density field, have demonstrated great progress in novel view synthesis yet are unfavorable for editing due to the implicitness. This work studies the task of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Ka Leong Cheng , Qiuyu Wang , Zifan Shi , Kecheng Zheng , Yinghao Xu , Hao Ouyang , Qifeng Chen , Yujun Shen

Recent works have shown that 3D-aware GANs trained on unstructured single image collections can generate multiview images of novel instances. The key underpinnings to achieve this are a 3D radiance field generator and a volume rendering…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Jianfeng Xiang , Jiaolong Yang , Yu Deng , Xin Tong

We present a method for learning a generative 3D model based on neural radiance fields, trained solely from data with only single views of each object. While generating realistic images is no longer a difficult task, producing the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Daniel Rebain , Mark Matthews , Kwang Moo Yi , Dmitry Lagun , Andrea Tagliasacchi

In this paper, we focus on 3D scene inpainting, where parts of an input image set, captured from different viewpoints, are masked out. The main challenge lies in generating plausible image completions that are geometrically consistent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Ahmad Salimi , Tristan Aumentado-Armstrong , Marcus A. Brubaker , Konstantinos G. Derpanis

Neural fields have emerged as a powerful framework for representing continuous multidimensional signals such as images and videos, 3D and 4D objects and scenes, and radiance fields. While efficient, achieving high-quality representation…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Abdelaziz Bouzidi , Hamid Laga , Hazem Wannous , Ferdous Sohel

In visual computing, 3D geometry is represented in many different forms including meshes, point clouds, voxel grids, level sets, and depth images. Each representation is suited for different tasks thus making the transformation of one…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Trevor Houchens , Cheng-You Lu , Shivam Duggal , Rao Fu , Srinath Sridhar

An open problem in mobile manipulation is how to represent objects and scenes in a unified manner so that robots can use both for navigation and manipulation. The latter requires capturing intricate geometry while understanding fine-grained…

Recent work on 3D-aware image synthesis has achieved compelling results using advances in neural rendering. However, 3D-aware synthesis of face dynamics hasn't received much attention. Here, we study how to explicitly control generative…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Peiye Zhuang , Liqian Ma , Oluwasanmi Koyejo , Alexander G. Schwing