English
Related papers

Related papers: Reg-NF: Efficient Registration of Implicit Surface…

200 papers

Neural Radiance Fields (NeRFs) have revolutionized scene novel view synthesis, offering visually realistic, precise, and robust implicit reconstructions. While recent approaches enable NeRF editing, such as object removal, 3D shape…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Robin Courant , Xi Wang , Marc Christie , Vicky Kalogeiton

Inferring a meaningful geometric scene representation from a single image is a fundamental problem in computer vision. Approaches based on traditional depth map prediction can only reason about areas that are visible in the image.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Felix Wimbauer , Nan Yang , Christian Rupprecht , Daniel Cremers

Neural radiance fields (NeRFs) produce state-of-the-art view synthesis results. However, they are slow to render, requiring hundreds of network evaluations per pixel to approximate a volume rendering integral. Baking NeRFs into explicit…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Benjamin Attal , Jia-Bin Huang , Michael Zollhoefer , Johannes Kopf , Changil Kim

The recent research explosion around implicit neural representations, such as NeRF, shows that there is immense potential for implicitly storing high-quality scene and lighting information in compact neural networks. However, one major…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Thomas Neff , Pascal Stadlbauer , Mathias Parger , Andreas Kurz , Joerg H. Mueller , Chakravarty R. Alla Chaitanya , Anton Kaplanyan , Markus Steinberger

We present a novel method for reconstructing a 3D implicit surface from a large-scale, sparse, and noisy point cloud. Our approach builds upon the recently introduced Neural Kernel Fields (NKF) representation. It enjoys similar…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Jiahui Huang , Zan Gojcic , Matan Atzmon , Or Litany , Sanja Fidler , Francis Williams

Recently, neural radiance fields (NeRF) have gained significant attention in the field of visual localization. However, existing NeRF-based approaches either lack geometric constraints or require extensive storage for feature matching,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Hongjia Zhai , Boming Zhao , Hai Li , Xiaokun Pan , Yijia He , Zhaopeng Cui , Hujun Bao , Guofeng Zhang

We present Gradient-SDF, a novel representation for 3D geometry that combines the advantages of implict and explicit representations. By storing at every voxel both the signed distance field as well as its gradient vector field, we enhance…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Christiane Sommer , Lu Sang , David Schubert , Daniel Cremers

Comprehensive 3D scene understanding, both geometrically and semantically, is important for real-world applications such as robot perception. Most of the existing work has focused on developing data-driven discriminative models for scene…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Mingtong Zhang , Shuhong Zheng , Zhipeng Bao , Martial Hebert , Yu-Xiong Wang

Neural fields have emerged as a new paradigm for representing signals, thanks to their ability to do it compactly while being easy to optimize. In most applications, however, neural fields are treated like black boxes, which precludes many…

Computer Vision and Pattern Recognition · Computer Science 2023-02-10 Guandao Yang , Sagie Benaim , Varun Jampani , Kyle Genova , Jonathan T. Barron , Thomas Funkhouser , Bharath Hariharan , Serge Belongie

Dynamic neural radiance fields (dynamic NeRFs) have demonstrated impressive results in novel view synthesis on 3D dynamic scenes. However, they often require complete video sequences for training followed by novel view synthesis, which is…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Zhiwen Yan , Chen Li , Gim Hee Lee

We propose INFAMOUS-NeRF, an implicit morphable face model that introduces hypernetworks to NeRF to improve the representation power in the presence of many training subjects. At the same time, INFAMOUS-NeRF resolves the classic…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Andrew Hou , Feng Liu , Zhiyuan Ren , Michel Sarkis , Ning Bi , Yiying Tong , Xiaoming Liu

We propose a novel explicit dense 3D reconstruction approach that processes a set of images of a scene with sensor poses and calibrations and estimates a photo-real digital model. One of the key innovations is that the underlying volumetric…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Samir Aroudj , Steven Lovegrove , Eddy Ilg , Tanner Schmidt , Michael Goesele , Richard Newcombe

Implicit representations such as Neural Radiance Fields (NeRF) have been shown to be very effective at novel view synthesis. However, these models typically require manual and careful human data collection for training. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Pierre Marza , Laetitia Matignon , Olivier Simonin , Dhruv Batra , Christian Wolf , Devendra Singh Chaplot

Image registration techniques usually assume that the images to be registered are of a certain type (e.g. single- vs. multi-modal, 2D vs. 3D, rigid vs. deformable) and there lacks a general method that can work for data under all…

Image and Video Processing · Electrical Eng. & Systems 2025-01-28 Quang Luong Nhat Nguyen , Ruiming Cao , Laura Waller

Neural radiance fields~(NeRF) have recently been applied to render large-scale scenes. However, their limited model capacity typically results in blurred rendering results. Existing large-scale NeRFs primarily address this limitation by…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Mingqi Shao , Feng Xiong , Hang Zhang , Shuang Yang , Mu Xu , Wei Bian , Xueqian Wang

We present NeSF, a method for producing 3D semantic fields from posed RGB images alone. In place of classical 3D representations, our method builds on recent work in implicit neural scene representations wherein 3D structure is captured by…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Suhani Vora , Noha Radwan , Klaus Greff , Henning Meyer , Kyle Genova , Mehdi S. M. Sajjadi , Etienne Pot , Andrea Tagliasacchi , Daniel Duckworth

Neural Fields (NFs) have gained momentum as a tool for compressing various data modalities - e.g. images and videos. This work leverages previous advances and proposes a novel NF-based compression algorithm for 3D data. We derive two…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Janis Postels , Yannick Strümpler , Klara Reichard , Luc Van Gool , Federico Tombari

Neural Radiance Fields (NeRF) achieve impressive view synthesis results for a variety of capture settings, including 360 capture of bounded scenes and forward-facing capture of bounded and unbounded scenes. NeRF fits multi-layer perceptrons…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Kai Zhang , Gernot Riegler , Noah Snavely , Vladlen Koltun

Over the past two decades, mobile imaging has experienced a profound transformation, with cell phones rapidly eclipsing all other forms of digital photography in popularity. Today's cell phones are equipped with a diverse range of imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Ilya Chugunov

We present a novel type of neural fields that uses general radial bases for signal representation. State-of-the-art neural fields typically rely on grid-based representations for storing local neural features and N-dimensional linear…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Zhang Chen , Zhong Li , Liangchen Song , Lele Chen , Jingyi Yu , Junsong Yuan , Yi Xu