English
Related papers

Related papers: StyleSDF: High-Resolution 3D-Consistent Image and …

200 papers

In this paper, we address the critical bottleneck in robotics caused by the scarcity of diverse 3D data by presenting a novel two-stage approach for generating high-quality 3D models from a single image. This method is motivated by the need…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Nan Huang , Ting Zhang , Yuhui Yuan , Dong Chen , Shanghang Zhang

This study addresses the challenge of online 3D model generation for neural rendering using an RGB image stream. Previous research has tackled this issue by incorporating Neural Radiance Fields (NeRF) or 3D Gaussian Splatting (3DGS) as…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Byeonggwon Lee , Junkyu Park , Khang Truong Giang , Sungho Jo , Soohwan Song

Recent research has shown that controllable image generation based on pre-trained GANs can benefit a wide range of computer vision tasks. However, less attention has been devoted to 3D vision tasks. In light of this, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Feng Liu , Xiaoming Liu

Generating high-resolution 3D shapes using volumetric representations such as Signed Distance Functions (SDFs) presents substantial computational and memory challenges. We introduce Direct3D-S2, a scalable 3D generation framework based on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Shuang Wu , Youtian Lin , Feihu Zhang , Yifei Zeng , Yikang Yang , Yajie Bao , Jiachen Qian , Siyu Zhu , Xun Cao , Philip Torr , Yao Yao

Recent advancements in diffusion techniques have propelled image and video generation to unprecedented levels of quality, significantly accelerating the deployment and application of generative AI. However, 3D shape generation technology…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Yangguang Li , Zi-Xin Zou , Zexiang Liu , Dehu Wang , Yuan Liang , Zhipeng Yu , Xingchao Liu , Yuan-Chen Guo , Ding Liang , Wanli Ouyang , Yan-Pei Cao

The generative priors of pre-trained latent diffusion models (DMs) have demonstrated great potential to enhance the visual quality of image super-resolution (SR) results. However, the noise sampling process in DMs introduces randomness in…

Image and Video Processing · Electrical Eng. & Systems 2024-09-26 Lingchen Sun , Rongyuan Wu , Jie Liang , Zhengqiang Zhang , Hongwei Yong , Lei Zhang

In this work, we present a new method for 3D face reconstruction from sparse-view RGB images. Unlike previous methods which are built upon 3D morphable models (3DMMs) with limited details, we leverage an implicit representation to encode…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Moran Li , Haibin Huang , Yi Zheng , Mengtian Li , Nong Sang , Chongyang Ma

In aerodynamic shape optimization, the convergence and computational cost are greatly affected by the representation capacity and compactness of the design space. Previous research has demonstrated that using a deep generative model to…

Machine Learning · Computer Science 2021-01-11 Wei Chen , Arun Ramamurthy

Learning-based image matching critically depends on large-scale, diverse, and geometrically accurate training data. 3D Gaussian Splatting (3DGS) enables photorealistic novel-view synthesis and thus is attractive for data generation.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Juncheng Chen , Chao Xu , Yanjun Cao

StyleGAN has achieved great progress in 2D face reconstruction and semantic editing via image inversion and latent editing. While studies over extending 2D StyleGAN to 3D faces have emerged, a corresponding generic 3D GAN inversion…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Yushi Lan , Xuyi Meng , Shuai Yang , Chen Change Loy , Bo Dai

Reconstructing detailed 3D scenes from single-view images remains a challenging task due to limitations in existing approaches, which primarily focus on geometric shape recovery, overlooking object appearances and fine shape details. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Yixin Chen , Junfeng Ni , Nan Jiang , Yaowei Zhang , Yixin Zhu , Siyuan Huang

In this paper, we present an approach for combining non-rigid structure-from-motion (NRSfM) with deep generative models,and propose an efficient framework for discovering trajectories in the latent space of 2D GANs corresponding to changes…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 René Haas , Stella Graßhof , Sami S. Brandt

As XR technology continues to advance rapidly, 3D generation and editing are increasingly crucial. Among these, stylization plays a key role in enhancing the appearance of 3D models. By utilizing stylization, users can achieve consistent…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Dingxi Zhang , Yu-Jie Yuan , Zhuoxun Chen , Fang-Lue Zhang , Zhenliang He , Shiguang Shan , Lin Gao

Recent advances in generative adversarial networks (GANs) have opened up the possibility of generating high-resolution photo-realistic images that were impossible to produce previously. The ability of GANs to sample from high-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Arthur Conmy , Subhadip Mukherjee , Carola-Bibiane Schönlieb

While recent Gaussian-based SLAM methods achieve photorealistic reconstruction from RGB-D data, their computational performance remains a critical bottleneck. State-of-the-art techniques operate at less than 20 fps, significantly lagging…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Zhexi Peng , Kun Zhou , Tianjia Shao

Creating realistic 3D objects and clothed avatars from a single RGB image is an attractive yet challenging problem. Due to its ill-posed nature, recent works leverage powerful prior from 2D diffusion models pretrained on large datasets.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Yuxuan Xue , Xianghui Xie , Riccardo Marin , Gerard Pons-Moll

The availability of rich 3D datasets corresponding to the geometrical complexity of the built environments is considered an ongoing challenge for 3D deep learning methodologies. To address this challenge, we introduce GenScan, a generative…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Mohammad Keshavarzi , Oladapo Afolabi , Luisa Caldas , Allen Y. Yang , Avideh Zakhor

We introduce 3inGAN, an unconditional 3D generative model trained from 2D images of a single self-similar 3D scene. Such a model can be used to produce 3D "remixes" of a given scene, by mapping spatial latent codes into a 3D volumetric…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Animesh Karnewar , Oliver Wang , Tobias Ritschel , Niloy Mitra

The facial sketch synthesis (FSS) model, capable of generating sketch portraits from given facial photographs, holds profound implications across multiple domains, encompassing cross-modal face recognition, entertainment, art, media, among…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Bowen Sun , Guo Lu , Shibao Zheng

We present a method of generating high resolution 3D shapes from natural language descriptions. To achieve this goal, we propose two steps that generating low resolution shapes which roughly reflect texts and generating high resolution…

Graphics · Computer Science 2019-01-23 Kentaro Fukamizu , Masaaki Kondo , Ryuichi Sakamoto