English
Related papers

Related papers: Deep Hybrid Self-Prior for Full 3D Mesh Generation

200 papers

Decompositional reconstruction of 3D scenes, with complete shapes and detailed texture of all objects within, is intriguing for downstream applications but remains challenging, particularly with sparse views as input. Recent approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Junfeng Ni , Yu Liu , Ruijie Lu , Zirui Zhou , Song-Chun Zhu , Yixin Chen , Siyuan Huang

We propose a novel method to reconstruct the 3D shapes of transparent objects using hand-held captured images under natural light conditions. It combines the advantage of explicit mesh and multi-layer perceptron (MLP) network, a hybrid…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Jiamin Xu , Zihan Zhu , Hujun Bao , Weiwei Xu

Learning a good image prior is a long-term goal for image restoration and manipulation. While existing methods like deep image prior (DIP) capture low-level image statistics, there are still gaps toward an image prior that captures rich…

Image and Video Processing · Electrical Eng. & Systems 2020-07-21 Xingang Pan , Xiaohang Zhan , Bo Dai , Dahua Lin , Chen Change Loy , Ping Luo

Existing methods for single-view 3D object reconstruction directly learn to transform image features into 3D representations. However, these methods are vulnerable to images containing noisy backgrounds and heavy occlusions because the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Shuo Yang , Min Xu , Haozhe Xie , Stuart Perry , Jiahao Xia

Conventional production workflow of high-precision mesh assets necessitates a cumbersome and laborious process of manual sculpting by specialized 3D artists/modelers. The recent years have witnessed remarkable advances in AI-empowered 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Qijian Zhang , Xiaozheng Jian , Xuan Zhang , Wenping Wang , Junhui Hou

We study the problem of shape generation in 3D mesh representation from a small number of color images with or without camera poses. While many previous works learn to hallucinate the shape directly from priors, we adopt to further improve…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Chao Wen , Yinda Zhang , Chenjie Cao , Zhuwen Li , Xiangyang Xue , Yanwei Fu

Recovering textured 3D models of non-rigid human body shapes is challenging due to self-occlusions caused by complex body poses and shapes, clothing obstructions, lack of surface texture, background clutter, sparse set of cameras with…

Computer Vision and Pattern Recognition · Computer Science 2018-09-19 Abbhinav Venkat , Sai Sagar Jinka , Avinash Sharma

3D textured shape recovery from partial scans is crucial for many real-world applications. Existing approaches have demonstrated the efficacy of implicit function representation, but they suffer from partial inputs with severe occlusions…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Lei Li , Zhizheng Liu , Weining Ren , Liudi Yang , Fangjinhua Wang , Marc Pollefeys , Songyou Peng

High-fidelity 3D scene reconstruction from monocular videos continues to be challenging, especially for complete and fine-grained geometry reconstruction. The previous 3D reconstruction approaches with neural implicit representations have…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Zi-Xin Zou , Shi-Sheng Huang , Yan-Pei Cao , Tai-Jiang Mu , Ying Shan , Hongbo Fu

We present a super-resolution method capable of creating a high-resolution texture map for a virtual 3D object from a set of lower-resolution images of that object. Our architecture unifies the concepts of (i) multi-view super-resolution…

Computer Vision and Pattern Recognition · Computer Science 2020-01-15 Audrey Richard , Ian Cherabier , Martin R. Oswald , Vagia Tsiminaki , Marc Pollefeys , Konrad Schindler

Reconstructing high-fidelity 3D facial texture from a single image is a quite challenging task due to the lack of complete face information and the domain gap between the 3D face and 2D image. Further, obtaining re-renderable 3D faces has…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Mingxin Yang , Jianwei Guo , Zhanglin Cheng , Xiaopeng Zhang , Dong-Ming Yan

We propose an analysis-by-synthesis method for fast multi-view 3D reconstruction of opaque objects with arbitrary materials and illumination. State-of-the-art methods use both neural surface representations and neural rendering. While…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Markus Worchel , Rodrigo Diaz , Weiwen Hu , Oliver Schreer , Ingo Feldmann , Peter Eisert

Recently, great progress has been made in 3D deep learning with the emergence of deep neural networks specifically designed for 3D point clouds. These networks are often trained from scratch or from pre-trained models learned purely from…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Bach Tran , Binh-Son Hua , Anh Tuan Tran , Minh Hoai

We present a system for learning full-body neural avatars, i.e. deep networks that produce full-body renderings of a person for varying body pose and camera position. Our system takes the middle path between the classical graphics pipeline…

The best way to combine the results of deep learning with standard 3D reconstruction pipelines remains an open problem. While systems that pass the output of traditional multi-view stereo approaches to a network for regularisation or…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Tristan Laidlow , Jan Czarnowski , Andrea Nicastro , Ronald Clark , Stefan Leutenegger

While recent generative models for 2D images achieve impressive visual results, they clearly lack the ability to perform 3D reasoning. This heavily restricts the degree of control over generated objects as well as the possible applications…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Dario Pavllo , Graham Spinks , Thomas Hofmann , Marie-Francine Moens , Aurelien Lucchi

Recent techniques on implicit geometry representation learning and neural rendering have shown promising results for 3D clothed human reconstruction from sparse video inputs. However, it is still challenging to reconstruct detailed surface…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Hao Wang , Qingshan Xu , Hongyuan Chen , Rui Ma

Conventional methods of 3D object generative modeling learn volumetric predictions using deep networks with 3D convolutional operations, which are direct analogies to classical 2D ones. However, these methods are computationally wasteful in…

Computer Vision and Pattern Recognition · Computer Science 2017-06-22 Chen-Hsuan Lin , Chen Kong , Simon Lucey

State-of-the-art face super-resolution methods employ deep convolutional neural networks to learn a mapping between low- and high- resolution facial patterns by exploring local appearance knowledge. However, most of these methods do not…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Xiaobin Hu , Wenqi Ren , John LaMaster , Xiaochun Cao , Xiaoming Li , Zechao Li , Bjoern Menze , Wei Liu

The reconstruction of indoor scenes from multi-view RGB images is challenging due to the coexistence of flat and texture-less regions alongside delicate and fine-grained regions. Recent methods leverage neural radiance fields aided by…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Sheng Ye , Yubin Hu , Matthieu Lin , Yu-Hui Wen , Wang Zhao , Yong-Jin Liu , Wenping Wang