English
Related papers

Related papers: Implicit Neural Representations for Generative Mod…

200 papers

We propose a new representation for encoding 3D shapes as neural fields. The representation is designed to be compatible with the transformer architecture and to benefit both shape reconstruction and shape generation. Existing works on…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Biao Zhang , Matthias Nießner , Peter Wonka

We introduce a new generative approach for synthesizing 3D geometry and images from single-view collections. Most existing approaches predict volumetric density to render multi-view consistent images. By employing volumetric rendering using…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Salvatore Esposito , Qingshan Xu , Kacper Kania , Charlie Hewitt , Octave Mariotti , Lohit Petikam , Julien Valentin , Arno Onken , Oisin Mac Aodha

Computer graphics, 3D computer vision and robotics communities have produced multiple approaches to representing 3D geometry for rendering and reconstruction. These provide trade-offs across fidelity, efficiency and compression…

Computer Vision and Pattern Recognition · Computer Science 2019-01-17 Jeong Joon Park , Peter Florence , Julian Straub , Richard Newcombe , Steven Lovegrove

We introduce DMTet, a deep 3D conditional generative model that can synthesize high-resolution 3D shapes using simple user guides such as coarse voxels. It marries the merits of implicit and explicit 3D representations by leveraging a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Tianchang Shen , Jun Gao , Kangxue Yin , Ming-Yu Liu , Sanja Fidler

Previous approaches to generate shapes in a 3D setting train a GAN on the latent space of an autoencoder (AE). Even though this produces convincing results, it has two major shortcomings. As the GAN is limited to reproduce the dataset the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Moritz Ibing , Isaak Lim , Leif Kobbelt

In this work, we present a new method for 3D face reconstruction from sparse-view RGB images. Unlike previous methods which are built upon 3D morphable models (3DMMs) with limited details, we leverage an implicit representation to encode…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Moran Li , Haibin Huang , Yi Zheng , Mengtian Li , Nong Sang , Chongyang Ma

Deep implicit surfaces excel at modeling generic shapes but do not always capture the regularities present in manufactured objects, which is something simple geometric primitives are particularly good at. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-09-09 Subeesh Vasu , Nicolas Talabot , Artem Lukoianov , Pierre Baqué , Jonathan Donier , Pascal Fua

Differentiable rendering is an essential operation in modern vision, allowing inverse graphics approaches to 3D understanding to be utilized in modern machine learning frameworks. Explicit shape representations (voxels, point clouds, or…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Tristan Aumentado-Armstrong , Stavros Tsogkas , Sven Dickinson , Allan Jepson

This paper presents a new approach for 3D shape generation, inversion, and manipulation, through a direct generative modeling on a continuous implicit representation in wavelet domain. Specifically, we propose a compact wavelet…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Jingyu Hu , Ka-Hei Hui , Zhengzhe Liu , Ruihui Li , Chi-Wing Fu

Deep Implicit Functions (DIFs) have gained popularity in 3D computer vision due to their compactness and continuous representation capabilities. However, addressing dense correspondences and semantic relationships across DIF-encoded shapes…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Kun Han , Shanlin Sun , Xiaohui Xie

We present Gradient-SDF, a novel representation for 3D geometry that combines the advantages of implict and explicit representations. By storing at every voxel both the signed distance field as well as its gradient vector field, we enhance…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Christiane Sommer , Lu Sang , David Schubert , Daniel Cremers

Implicit fields have recently shown increasing success in representing and learning 3D shapes accurately. Signed distance fields and occupancy fields are decades old and still the preferred representations, both with well-studied…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Edoardo Mello Rella , Ajad Chhatkuli , Ender Konukoglu , Luc Van Gool

Generative Neural Radiance Field (GNeRF) models, which extract implicit 3D representations from 2D images, have recently been shown to produce realistic images representing rigid/semi-rigid objects, such as human faces or cars. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Jichao Zhang , Enver Sangineto , Hao Tang , Aliaksandr Siarohin , Zhun Zhong , Nicu Sebe , Wei Wang

Deep neural networks (DNNs) are widely applied for nowadays 3D surface reconstruction tasks and such methods can be further divided into two categories, which respectively warp templates explicitly by moving vertices or represent 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Xianghui Yang , Guosheng Lin , Zhenghao Chen , Luping Zhou

Various SDF-based neural implicit surface reconstruction methods have been proposed recently, and have demonstrated remarkable modeling capabilities. However, due to the global nature and limited representation ability of a single network,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Leyuan Yang , Bailin Deng , Juyong Zhang

Deep generative models have shown success in generating 3D shapes with different representations. In this work, we propose Neural Volumetric Mesh Generator(NVMG) which can generate novel and high-quality volumetric meshes. Unlike the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Yan Zheng , Lemeng Wu , Xingchao Liu , Zhen Chen , Qiang Liu , Qixing Huang

Deep Implicit Functions (DIFs) represent 3D geometry with continuous signed distance functions learned through deep neural nets. Recently DIFs-based methods have been proposed to handle shape reconstruction and dense point correspondences…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Shanlin Sun , Kun Han , Deying Kong , Hao Tang , Xiangyi Yan , Xiaohui Xie

Neural implicit representations are widely used for 3D shape modeling due to their smoothness and compactness, but traditional MLP-based methods struggle with sharp features, such as edges and corners in CAD models, and require long…

Graphics · Computer Science 2025-03-18 Guying Lin , Lei Yang , Congyi Zhang , Hao Pan , Yuhan Ping , Guodong Wei , Taku Komura , John Keyser , Wenping Wang

Deep implicit functions (DIFs), as a kind of 3D shape representation, are becoming more and more popular in the 3D vision community due to their compactness and strong representation power. However, unlike polygon mesh-based templates, it…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Zerong Zheng , Tao Yu , Qionghai Dai , Yebin Liu

The neural implicit representation has shown its effectiveness in novel view synthesis and high-quality 3D reconstruction from multi-view images. However, most approaches focus on holistic scene representation yet ignore individual objects…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Qianyi Wu , Xian Liu , Yuedong Chen , Kejie Li , Chuanxia Zheng , Jianfei Cai , Jianmin Zheng