English
Related papers

Related papers: Occupancy Networks: Learning 3D Reconstruction in …

200 papers

Multi-view implicit scene reconstruction methods have become increasingly popular due to their ability to represent complex scene details. Recent efforts have been devoted to improving the representation of input information and to reducing…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Edward J. Smith , Michal Drozdzal , Derek Nowrouzezahrai , David Meger , Adriana Romero-Soriano

Neural implicit representations have emerged as a powerful paradigm for 3D reconstruction. However, despite their success, existing methods fail to capture fine geometric details and thin structures, especially in scenarios where only…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Aarya Patel , Hamid Laga , Ojaswa Sharma

Neural signed distance functions (SDFs) are emerging as an effective representation for 3D shapes. State-of-the-art methods typically encode the SDF with a large, fixed-size neural network to approximate complex shapes with implicit…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Towaki Takikawa , Joey Litalien , Kangxue Yin , Karsten Kreis , Charles Loop , Derek Nowrouzezahrai , Alec Jacobson , Morgan McGuire , Sanja Fidler

We present a new approach to 3D object representation where a neural network encodes the geometry of an object directly into the weights and biases of a second 'mapping' network. This mapping network can be used to reconstruct an object by…

Machine Learning · Computer Science 2020-04-07 Eric Mitchell , Selim Engin , Volkan Isler , Daniel D Lee

3D shape models are naturally parameterized using vertices and faces, \ie, composed of polygons forming a surface. However, current 3D learning paradigms for predictive and generative tasks using convolutional neural networks focus on a…

Computer Vision and Pattern Recognition · Computer Science 2017-03-14 Ayan Sinha , Asim Unmesh , Qixing Huang , Karthik Ramani

Inspired by the recent success of methods that employ shape priors to achieve robust 3D reconstructions, we propose a novel recurrent neural network architecture that we call the 3D Recurrent Reconstruction Neural Network (3D-R2N2). The…

Computer Vision and Pattern Recognition · Computer Science 2016-04-05 Christopher B. Choy , Danfei Xu , JunYoung Gwak , Kevin Chen , Silvio Savarese

Determining the occupancy status of locations in the environment is a fundamental task for safety-critical robotic applications. Traditional occupancy grid mapping methods subdivide the environment into a grid of voxels, each associated…

Robotics · Computer Science 2026-03-24 Benxu Tang , Yunfan Ren , Yixi Cai , Fanze Kong , Wenyi Liu , Fangcheng Zhu , Longji Yin , Liuyu Shi , Fu Zhang

We propose a novel neural architecture for representing 3D surfaces, which harnesses two complementary shape representations: (i) an explicit representation via an atlas, i.e., embeddings of 2D domains into 3D; (ii) an implicit-function…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Omid Poursaeed , Matthew Fisher , Noam Aigerman , Vladimir G. Kim

Manipulating elasto-plastic objects remains a significant challenge due to severe self-occlusion, difficulties of representation, and complicated dynamics. This work proposes a novel framework for elasto-plastic object manipulation with a…

Robotics · Computer Science 2025-05-26 Zhen Zhang , Xiangyu Chu , Yunxi Tang , Lulu Zhao , Jing Huang , Zhongliang Jiang , K. W. Samuel Au

Human driver can easily describe the complex traffic scene by visual system. Such an ability of precise perception is essential for driver's planning. To achieve this, a geometry-aware representation that quantizes the physical 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Chonghao Sima , Wenwen Tong , Tai Wang , Li Chen , Silei Wu , Hanming Deng , Yi Gu , Lewei Lu , Ping Luo , Dahua Lin , Hongyang Li

We are witnessing an explosion of neural implicit representations in computer vision and graphics. Their applicability has recently expanded beyond tasks such as shape generation and image-based rendering to the fundamental problem of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Jiaming Sun , Xi Chen , Qianqian Wang , Zhengqi Li , Hadar Averbuch-Elor , Xiaowei Zhou , Noah Snavely

As part of human core knowledge, the representation of objects is the building block of mental representation that supports high-level concepts and symbolic reasoning. While humans develop the ability of perceiving objects situated in 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 John Day , Tushar Arora , Jirui Liu , Li Erran Li , Ming Bo Cai

A neural implicit outputs a number indicating whether the given query point in space is inside, outside, or on a surface. Many prior works have focused on _latent-encoded_ neural implicits, where a latent vector encoding of a specific shape…

Graphics · Computer Science 2021-01-19 Thomas Davies , Derek Nowrouzezahrai , Alec Jacobson

Various SDF-based neural implicit surface reconstruction methods have been proposed recently, and have demonstrated remarkable modeling capabilities. However, due to the global nature and limited representation ability of a single network,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Leyuan Yang , Bailin Deng , Juyong Zhang

Using neural networks to represent 3D objects has become popular. However, many previous works employ neural networks with fixed architecture and size to represent different 3D objects, which lead to excessive network parameters for simple…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Yongdong Huang , Yuanzhan Li , Xulong Cao , Siyu Zhang , Shen Cai , Ting Lu , Jie Wang , Yuqi Liu

Existing 3D surface representation approaches are unable to accurately classify pixels and their orientation lying on the boundary of an object. Thus resulting in coarse representations which usually require post-processing steps to extract…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Mateusz Michalkiewicz , Jhony K. Pontes , Dominic Jack , Mahsa Baktashmotlagh , Anders Eriksson

In this paper we provide an overview of a new framework for robot perception, real-world modelling, and navigation that uses a stochastic tesselated representation of spatial information called the Occupancy Grid. The Occupancy Grid is a…

Robotics · Computer Science 2013-04-05 A. Elfes

Learning-based 3D reconstruction methods have shown impressive results. However, most methods require 3D supervision which is often hard to obtain for real-world datasets. Recently, several works have proposed differentiable rendering…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Michael Niemeyer , Lars Mescheder , Michael Oechsle , Andreas Geiger

Neuroscientists postulate 3D representations in the brain in a variety of different coordinate frames (e.g. 'head-centred', 'hand-centred' and 'world-based'). Recent advances in reinforcement learning demonstrate a quite different approach…

Neurons and Cognition · Quantitative Biology 2020-07-10 Alex Muryy , N. Siddharth , Nantas Nardelli , Philip H. S. Torr , Andrew Glennerster

We present a novel 3D mapping method leveraging the recent progress in neural implicit representation for 3D reconstruction. Most existing state-of-the-art neural implicit representation methods are limited to object-level reconstructions…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Stefan Lionar , Lukas Schmid , Cesar Cadena , Roland Siegwart , Andrei Cramariuc