English
Related papers

Related papers: Neural Fields as Learnable Kernels for 3D Reconstr…

200 papers

From a single image, humans are able to perceive the full 3D shape of an object by exploiting learned shape priors from everyday life. Contemporary single-image 3D reconstruction algorithms aim to solve this task in a similar fashion, but…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Xiuming Zhang , Zhoutong Zhang , Chengkai Zhang , Joshua B. Tenenbaum , William T. Freeman , Jiajun Wu

Reliably reconstructing physical fields from sparse sensor data is a challenge that frequently arises in many scientific domains. In practice, the process generating the data often is not understood to sufficient accuracy. Therefore, there…

Machine Learning · Computer Science 2024-01-23 Xihaier Luo , Wei Xu , Yihui Ren , Shinjae Yoo , Balu Nadiga

We introduce a novel neural network architecture for encoding and synthesis of 3D shapes, particularly their structures. Our key insight is that 3D shapes are effectively characterized by their hierarchical organization of parts, which…

Graphics · Computer Science 2017-05-16 Jun Li , Kai Xu , Siddhartha Chaudhuri , Ersin Yumer , Hao Zhang , Leonidas Guibas

Deep learning approaches to 3D shape segmentation are typically formulated as a multi-class labeling problem. Existing models are trained for a fixed set of labels, which greatly limits their flexibility and adaptivity. We opt for top-down…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Fenggen Yu , Kun Liu , Yan Zhang , Chenyang Zhu , Kai Xu

Computed tomography (CT) is an effective medical imaging modality, widely used in the field of clinical medicine for the diagnosis of various pathologies. Advances in Multidetector CT imaging technology have enabled additional…

Image and Video Processing · Electrical Eng. & Systems 2022-04-11 Abril Corona-Figueroa , Jonathan Frawley , Sam Bond-Taylor , Sarath Bethapudi , Hubert P. H. Shum , Chris G. Willcocks

We present a novel approach for completing and reconstructing 3D shapes from incomplete scanned data by using deep neural networks. Rather than being trained on supervised completion tasks and applied on a testing shape, the network is…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Lei Chu , Hao Pan , Wenping Wang

In this paper, we study the problem of 3D scene geometry decomposition and manipulation from 2D views. By leveraging the recent implicit neural representation techniques, particularly the appealing neural radiance fields, we introduce an…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Bing Wang , Lu Chen , Bo Yang

Neural Radiance Fields (NeRF) have been widely adopted for reconstructing high quality 3D point clouds from 2D RGB images. However, the segmentation of these reconstructed 3D scenes is more essential for downstream tasks such as object…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Jiangsan Zhao , Jakob Geipel , Krzysztof Kusnierek , Xuean Cui

Robots operating in the real world must plan through environments that deform, yield, and reconfigure under contact, requiring interaction-aware 3D representations that extend beyond static geometric occupancy. To address this, we introduce…

Robotics · Computer Science 2026-02-16 Pavan Mantripragada , Siddhanth Deshmukh , Eadom Dessalene , Manas Desai , Yiannis Aloimonos

NeRFs have achieved incredible success in novel view synthesis. However, the accuracy of the implicit geometry is unsatisfactory because the passive static environmental illumination has low spatial frequency and cannot provide enough…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Jianyu Tao , Changping Hu , Edward Yang , Jing Xu , Rui Chen

3D object reconstruction is a fundamental task of many robotics and AI problems. With the aid of deep convolutional neural networks (CNNs), 3D object reconstruction has witnessed a significant progress in recent years. However, possibly due…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Hanqing Wang , Jiaolong Yang , Wei Liang , Xin Tong

Effectively parsing the facade is essential to 3D building reconstruction, which is an important computer vision problem with a large amount of applications in high precision map for navigation, computer aided design, and city generation…

Computer Vision and Pattern Recognition · Computer Science 2021-06-03 Hantang Liu , Wentong Li , Jianke Zhu

Normal estimation for unstructured point clouds is an important task in 3D computer vision. Current methods achieve encouraging results by mapping local patches to normal vectors or learning local surface fitting using neural networks.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Shujuan Li , Junsheng Zhou , Baorui Ma , Yu-Shen Liu , Zhizhong Han

In this paper, we introduce a new image representation based on a multilayer kernel machine. Unlike traditional kernel methods where data representation is decoupled from the prediction task, we learn how to shape the kernel with…

Machine Learning · Statistics 2016-10-26 Julien Mairal

This paper addresses the challenge of reconstructing an animatable human model from a multi-view video. Some recent works have proposed to decompose a non-rigidly deforming scene into a canonical neural radiance field and a set of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-08 Sida Peng , Junting Dong , Qianqian Wang , Shangzhan Zhang , Qing Shuai , Xiaowei Zhou , Hujun Bao

Kernel methods have great promise for learning rich statistical representations of large modern datasets. However, compared to neural networks, kernel methods have been perceived as lacking in scalability and flexibility. We introduce a…

Machine Learning · Computer Science 2014-12-22 Zichao Yang , Alexander J. Smola , Le Song , Andrew Gordon Wilson

Establishing correspondence between shapes is a fundamental problem in geometry processing, arising in a wide variety of applications. The problem is especially difficult in the setting of non-isometric deformations, as well as in the…

Computer Vision and Pattern Recognition · Computer Science 2016-05-23 Davide Boscaini , Jonathan Masci , Emanuele Rodolà , Michael M. Bronstein

This paper proposes a method to reconstruct the neural radiance field with equirectangular omnidirectional images. Implicit neural scene representation with a radiance field can reconstruct the 3D shape of a scene continuously within a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Qiaoge Li , Itsuki Ueda , Chun Xie , Hidehiko Shishido , Itaru Kitahara

Recent advances in 3D deep learning have shown that it is possible to train highly effective deep models for 3D shape generation, directly from 2D images. This is particularly interesting since the availability of 3D models is still limited…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Shichen Liu , Shunsuke Saito , Weikai Chen , Hao Li

A biological neural network in the cortex forms a neural field. Neurons in the field have their own receptive fields, and connection weights between two neurons are random but highly correlated when they are in close proximity in receptive…

Machine Learning · Computer Science 2023-01-10 Kaito Watanabe , Kotaro Sakamoto , Ryo Karakida , Sho Sonoda , Shun-ichi Amari