English
Related papers

Related papers: StyleSDF: High-Resolution 3D-Consistent Image and …

200 papers

Over the years, 2D GANs have achieved great successes in photorealistic portrait generation. However, they lack 3D understanding in the generation process, thus they suffer from multi-view inconsistency problem. To alleviate the issue, many…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Jeong-gi Kwak , Yuanming Li , Dongsik Yoon , Donghyeon Kim , David Han , Hanseok Ko

A main challenge in mechanical design is to efficiently explore the design space while satisfying engineering constraints. This work explores the use of 3D generative models to explore the design space in the context of vehicle development,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Hayata Morita , Kohei Shintani , Chenyang Yuan , Frank Permenter

Recently, 3D Gaussian Splatting (3DGS) has excelled in novel view synthesis (NVS) with its real-time rendering capabilities and superior quality. However, it encounters challenges for high-resolution novel view synthesis (HRNVS) due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Shiyun Xie , Zhiru Wang , Yinghao Zhu , Xu Wang , Chengwei Pan , Xiwang Dong

Generating a street-level 3D scene from a single satellite image is a crucial yet challenging task. Current methods present a stark trade-off: geometry-colorization models achieve high geometric fidelity but are typically building-focused…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Ming Qian , Zimin Xia , Changkun Liu , Shuailei Ma , Wen Wang , Zeran Ke , Bin Tan , Hang Zhang , Gui-Song Xia

The advancement of generative radiance fields has pushed the boundary of 3D-aware image synthesis. Motivated by the observation that a 3D object should look realistic from multiple viewpoints, these methods introduce a multi-view constraint…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Xingang Pan , Xudong Xu , Chen Change Loy , Christian Theobalt , Bo Dai

Presenting a 3D scene from multiview images remains a core and long-standing challenge in computer vision and computer graphics. Two main requirements lie in rendering and reconstruction. Notably, SOTA rendering quality is usually achieved…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Mulin Yu , Tao Lu , Linning Xu , Lihan Jiang , Yuanbo Xiangli , Bo Dai

Generative AI has emerged as a transformative paradigm in engineering design, enabling automated synthesis and reconstruction of complex 3D geometries while preserving feasibility and performance relevance. This paper introduces a…

Machine Learning · Computer Science 2026-01-21 Ashish S. Nair , Sandipp Krishnan Ravi , Itzel Salgado , Changjie Sun , Sayan Ghosh , Liping Wang

Efficiently generating a freestyle 3D portrait with high quality and 3D-consistency is a promising yet challenging task. The portrait styles generated by most existing methods are usually restricted by their 3D generators, which are learned…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Tianxiang Ma , Kang Zhao , Jianxin Sun , Yingya Zhang , Jing Dong

Probabilistic diffusion models have achieved state-of-the-art results for image synthesis, inpainting, and text-to-image tasks. However, they are still in the early stages of generating complex 3D shapes. This work proposes Diffusion-SDF, a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Gene Chou , Yuval Bahat , Felix Heide

Current image-to-3D approaches suffer from high computational costs and lack scalability for high-resolution outputs. In contrast, we introduce a novel framework to directly generate explicit surface geometry and texture using multi-view 2D…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Haoyu Wu , Meher Gitika Karumuri , Chuhang Zou , Seungbae Bang , Yuelong Li , Dimitris Samaras , Sunil Hadap

Previous portrait image generation methods roughly fall into two categories: 2D GANs and 3D-aware GANs. 2D GANs can generate high fidelity portraits but with low view consistency. 3D-aware GAN methods can maintain view consistency but their…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Jingxiang Sun , Xuan Wang , Yong Zhang , Xiaoyu Li , Qi Zhang , Yebin Liu , Jue Wang

Neural signed distance functions (SDFs) are emerging as an effective representation for 3D shapes. State-of-the-art methods typically encode the SDF with a large, fixed-size neural network to approximate complex shapes with implicit…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Towaki Takikawa , Joey Litalien , Kangxue Yin , Karsten Kreis , Charles Loop , Derek Nowrouzezahrai , Alec Jacobson , Morgan McGuire , Sanja Fidler

3D-consistent image generation from a single 2D semantic label is an important and challenging research topic in computer graphics and computer vision. Although some related works have made great progress in this field, most of the existing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Bo Li , Yi-ke Li , Zhi-fen He , Bin Liu , Yun-Kun Lai

In this paper, we present an implicit surface reconstruction method with 3D Gaussian Splatting (3DGS), namely 3DGSR, that allows for accurate 3D reconstruction with intricate details while inheriting the high efficiency and rendering…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Xiaoyang Lyu , Yang-Tian Sun , Yi-Hua Huang , Xiuzhe Wu , Ziyi Yang , Yilun Chen , Jiangmiao Pang , Xiaojuan Qi

With the growing demand for high-fidelity 3D models from 2D images, existing methods still face significant challenges in accurately reproducing fine-grained geometric details due to limitations in domain gaps and inherent ambiguities in…

Graphics · Computer Science 2025-04-01 Chongjie Ye , Yushuang Wu , Ziteng Lu , Jiahao Chang , Xiaoyang Guo , Jiaqing Zhou , Hao Zhao , Xiaoguang Han

Embodied intelligence requires precise reconstruction and rendering to simulate large-scale real-world data. Although 3D Gaussian Splatting (3DGS) has recently demonstrated high-quality results with real-time performance, it still faces…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Haodong Xiang , Xinghui Li , Kai Cheng , Xiansong Lai , Wanting Zhang , Zhichao Liao , Long Zeng , Xueping Liu

View synthesis aims to produce unseen views from a set of views captured by two or more cameras at different positions. This task is non-trivial since it is hard to conduct pixel-level matching among different views. To address this issue,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Zhuoman Liu , Wei Jia , Ming Yang , Peiyao Luo , Yong Guo , Mingkui Tan

Generative Neural Radiance Field (GNeRF) models, which extract implicit 3D representations from 2D images, have recently been shown to produce realistic images representing rigid/semi-rigid objects, such as human faces or cars. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Jichao Zhang , Enver Sangineto , Hao Tang , Aliaksandr Siarohin , Zhun Zhong , Nicu Sebe , Wei Wang

We present SPSG, a novel approach to generate high-quality, colored 3D models of scenes from RGB-D scan observations by learning to infer unobserved scene geometry and color in a self-supervised fashion. Our self-supervised approach learns…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Angela Dai , Yawar Siddiqui , Justus Thies , Julien Valentin , Matthias Nießner

Current diffusion or flow-based generative models for 3D shapes divide to two: distilling pre-trained 2D image diffusion models, and training directly on 3D shapes. When training a diffusion or flow models on 3D shapes a crucial design…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Lior Yariv , Omri Puny , Natalia Neverova , Oran Gafni , Yaron Lipman