English
Related papers

Related papers: A Shading-Guided Generative Implicit Model for Sha…

200 papers

3D-aware GANs aim to synthesize realistic 3D scenes such that they can be rendered in arbitrary perspectives to produce images. Although previous methods produce realistic images, they suffer from unstable training or degenerate solutions…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Minjung Shin , Yunji Seo , Jeongmin Bae , Young Sun Choi , Hyunsu Kim , Hyeran Byun , Youngjung Uh

We present a StyleGAN2-based deep learning approach for 3D shape generation, called SDF-StyleGAN, with the aim of reducing visual and geometric dissimilarity between generated shapes and a shape collection. We extend StyleGAN2 to 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-06-27 Xin-Yang Zheng , Yang Liu , Peng-Shuai Wang , Xin Tong

Despite the recent advancement of Generative Adversarial Networks (GANs) in learning 3D-aware image synthesis from 2D data, existing methods fail to model indoor scenes due to the large diversity of room layouts and the objects inside. We…

Computer Vision and Pattern Recognition · Computer Science 2022-02-21 Zifan Shi , Yujun Shen , Jiapeng Zhu , Dit-Yan Yeung , Qifeng Chen

We present a new pipeline for holistic 3D scene understanding from a single image, which could predict object shapes, object poses, and scene layout. As it is a highly ill-posed problem, existing methods usually suffer from inaccurate…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Cheng Zhang , Zhaopeng Cui , Yinda Zhang , Bing Zeng , Marc Pollefeys , Shuaicheng Liu

We present a method for relighting 3D reconstructions of large room-scale environments. Existing solutions for 3D scene relighting often require solving under-determined or ill-conditioned inverse rendering problems, and are as such unable…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Xiaoyan Xing , Philipp Henzler , Junhwa Hur , Runze Li , Jonathan T. Barron , Pratul P. Srinivasan , Dor Verbin

3D Gaussian Splatting (3DGS) has shown impressive results for the novel view synthesis task, where lighting is assumed to be fixed. However, creating relightable 3D assets, especially for objects with ill-defined shapes (fur, fabric, etc.),…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Jiahui Fan , Fujun Luan , Jian Yang , Miloš Hašan , Beibei Wang

We present a unified framework tackling two problems: class-specific 3D reconstruction from a single image, and generation of new 3D shape samples. These tasks have received considerable attention recently; however, most existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Paul Henderson , Vittorio Ferrari

With the advances in generative adversarial networks (GANs) and neural rendering, 3D relightable face generation has received significant attention. Among the existing methods, a particularly successful technique uses an implicit lighting…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Libing Zeng , Nima Khademi Kalantari

Recent advances in implicit neural representations and differentiable rendering make it possible to simultaneously recover the geometry and materials of an object from multi-view RGB images captured under unknown static illumination.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Yuanqing Zhang , Jiaming Sun , Xingyi He , Huan Fu , Rongfei Jia , Xiaowei Zhou

Recent work has shown the ability to learn generative models for 3D shapes from only unstructured 2D images. However, training such models requires differentiating through the rasterization step of the rendering process, therefore past work…

Computer Vision and Pattern Recognition · Computer Science 2020-03-02 Sebastian Lunz , Yingzhen Li , Andrew Fitzgibbon , Nate Kushman

Shape priors learned from data are commonly used to reconstruct 3D objects from partial or noisy data. Yet no such shape priors are available for indoor scenes, since typical 3D autoencoders cannot handle their scale, complexity, or…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Chiyu Max Jiang , Avneesh Sud , Ameesh Makadia , Jingwei Huang , Matthias Nießner , Thomas Funkhouser

We present an approach to infer the 3D shape, texture, and camera pose for an object from a single RGB image, using only category-level image collections with foreground masks as supervision. We represent the shape as an image-conditioned…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Shubham Tulsiani , Nilesh Kulkarni , Abhinav Gupta

We propose a data-driven 3D shape design method that can learn a generative model from a corpus of existing designs, and use this model to produce a wide range of new designs. The approach learns an encoding of the samples in the training…

We propose a 3D Gaussian splatting-based framework for outdoor relighting that leverages intrinsic image decomposition to precisely integrate sunlight, sky radiance, and indirect lighting from unconstrained photo collections. Unlike prior…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Haiyang Bai , Jiaqi Zhu , Songru Jiang , Wei Huang , Tao Lu , Yuanqi Li , Jie Guo , Runze Fu , Yanwen Guo , Lijun Chen

Recent conditional image synthesis approaches provide high-quality synthesized images. However, it is still challenging to accurately adjust image contents such as the positions and orientations of objects, and synthesized images often have…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Jaebong Jeong , Janghun Jo , Jingdong Wang , Sunghyun Cho , Jaesik Park

This paper presents a new text-guided technique for generating 3D shapes. The technique leverages a hybrid 3D shape representation, namely EXIM, combining the strengths of explicit and implicit representations. Specifically, the explicit…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Zhengzhe Liu , Jingyu Hu , Ka-Hei Hui , Xiaojuan Qi , Daniel Cohen-Or , Chi-Wing Fu

Unsupervised learning of 3D human faces from unstructured 2D image data is an active research area. While recent works have achieved an impressive level of photorealism, they commonly lack control of lighting, which prevents the generated…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Boyang Deng , Yifan Wang , Gordon Wetzstein

We introduce a high resolution, 3D-consistent image and shape generation technique which we call StyleSDF. Our method is trained on single-view RGB data only, and stands on the shoulders of StyleGAN2 for image generation, while solving two…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Roy Or-El , Xuan Luo , Mengyi Shan , Eli Shechtman , Jeong Joon Park , Ira Kemelmacher-Shlizerman

Recent advances in deep learning have significantly transformed the field of 3D shape generation, enabling the synthesis of complex, diverse, and semantically meaningful 3D objects. This survey provides a comprehensive overview of the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Nicolas Caytuiro , Ivan Sipiran

Image blending aims to combine multiple images seamlessly. It remains challenging for existing 2D-based methods, especially when input images are misaligned due to differences in 3D camera poses and object shapes. To tackle these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Hyunsu Kim , Gayoung Lee , Yunjey Choi , Jin-Hwa Kim , Jun-Yan Zhu