English
Related papers

Related papers: How to Train Neural Field Representations: A Compr…

200 papers

Photo-realistic free-viewpoint rendering of real-world scenes using classical computer graphics techniques is challenging, because it requires the difficult step of capturing detailed appearance and geometry models. Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Lingjie Liu , Jiatao Gu , Kyaw Zaw Lin , Tat-Seng Chua , Christian Theobalt

Deep neural networks can be effective means to automatically classify aerial images but is easy to overfit to the training data. It is critical for trained neural networks to be robust to variations that exist between training and test…

Computer Vision and Pattern Recognition · Computer Science 2019-09-25 Jiayun Wang , Patrick Virtue , Stella X. Yu

Neural Radiance Fields (NeRF) have demonstrated impressive performance in novel view synthesis. However, NeRF and most of its variants still rely on traditional complex pipelines to provide extrinsic and intrinsic camera parameters, such as…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Qingsong Yan , Qiang Wang , Kaiyong Zhao , Jie Chen , Bo Li , Xiaowen Chu , Fei Deng

Neural Fields have emerged as a transformative approach for 3D scene representation in computer vision and robotics, enabling accurate inference of geometry, 3D semantics, and dynamics from posed 2D data. Leveraging differentiable…

We propose an application of online hard sample mining for efficient training of Neural Radiance Fields (NeRF). NeRF models produce state-of-the-art quality for many 3D reconstruction and rendering tasks but require substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Juuso Korhonen , Goutham Rangu , Hamed R. Tavakoli , Juho Kannala

Neural representations are popular for representing shapes, as they can be learned form sensor data and used for data cleanup, model completion, shape editing, and shape synthesis. Current neural representations can be categorized as either…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Connor Z. Lin , Niloy J. Mitra , Gordon Wetzstein , Leonidas Guibas , Paul Guerrero

Existing pipelines of semantic correspondence commonly include extracting high-level semantic features for the invariance against intra-class variations and background clutters. This architecture, however, inevitably results in a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Sunghwan Hong , Jisu Nam , Seokju Cho , Susung Hong , Sangryul Jeon , Dongbo Min , Seungryong Kim

Neural Radiance Fields (NeRFs) are a very recent and very popular approach for the problems of novel view synthesis and 3D reconstruction. A popular scene representation used by NeRFs is to combine a uniform, voxel-based subdivision of the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jonas Kulhanek , Torsten Sattler

Recently, Neural Radiance Fields (NeRF) have emerged as a potent method for synthesizing novel views from a dense set of images. Despite its impressive performance, NeRF is plagued by its necessity for numerous calibrated views and its…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Jiayang Bai , Letian Huang , Wen Gong , Jie Guo , Yanwen Guo

Normal estimation for unstructured point clouds is an important task in 3D computer vision. Current methods achieve encouraging results by mapping local patches to normal vectors or learning local surface fitting using neural networks.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Shujuan Li , Junsheng Zhou , Baorui Ma , Yu-Shen Liu , Zhizhong Han

Neural Representations have recently been shown to effectively reconstruct a wide range of signals from 3D meshes and shapes to images and videos. We show that, when adapted correctly, neural representations can be used to directly…

Machine Learning · Computer Science 2023-04-24 Maor Ashkenazi , Zohar Rimon , Ron Vainshtein , Shir Levi , Elad Richardson , Pinchas Mintz , Eran Treister

Most NeRF-based models are designed for learning the entire scene, and complex scenes can lead to longer learning times and poorer rendering effects. This paper utilizes scene semantic priors to make improvements in fast training, allowing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Yuesong Li , Feng Pan , Helong Yan , Xiuli Xin , Xiaoxue Feng

This paper introduces a novel continual learning framework for synthesising novel views of multiple scenes, learning multiple 3D scenes incrementally, and updating the network parameters only with the training data of the upcoming new…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Yuze Wang , Junyi Wang , Chen Wang , Wantong Duan , Yongtang Bao , Yue Qi

Neural fields have emerged as a new paradigm for representing signals, thanks to their ability to do it compactly while being easy to optimize. In most applications, however, neural fields are treated like black boxes, which precludes many…

Computer Vision and Pattern Recognition · Computer Science 2023-02-10 Guandao Yang , Sagie Benaim , Varun Jampani , Kyle Genova , Jonathan T. Barron , Thomas Funkhouser , Bharath Hariharan , Serge Belongie

Obtaining personalized 3D animatable avatars from a monocular camera has several real world applications in gaming, virtual try-on, animation, and VR/XR, etc. However, it is very challenging to model dynamic and fine-grained clothing…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Yuxuan Xue , Bharat Lal Bhatnagar , Riccardo Marin , Nikolaos Sarafianos , Yuanlu Xu , Gerard Pons-Moll , Tony Tung

Neural radiance fields (NeRF) bring a new wave for 3D interactive experiences. However, as an important part of the immersive experiences, the defocus effects have not been fully explored within NeRF. Some recent NeRF-based methods generate…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Yinhuai Wang , Shuzhou Yang , Yujie Hu , Jian Zhang

Reinforcement learning systems require good representations to work well. For decades practical success in reinforcement learning was limited to small domains. Deep reinforcement learning systems, on the other hand, are scalable, not…

Machine Learning · Computer Science 2020-03-18 Sina Ghiassian , Banafsheh Rafiee , Yat Long Lo , Adam White

Neural radiance field (NeRF) has shown remarkable performance in generating photo-realistic novel views. Among recent NeRF related research, the approaches that involve the utilization of explicit structures like grids to manage features…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Yongjae Lee , Li Yang , Deliang Fan

Deformable image registration is a fundamental task in medical image processing. Traditional optimization-based methods often struggle with accuracy in dealing with complex deformation. Recently, learning-based methods have achieved good…

Image and Video Processing · Electrical Eng. & Systems 2025-03-04 Lei Zhou , Nimu Yuan , Katjana Ehrlich , Jinyi Qi

Purely MLP-based neural radiance fields (NeRF-based methods) often suffer from underfitting with blurred renderings on large-scale scenes due to limited model capacity. Recent approaches propose to geographically divide the scene and adopt…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Linning Xu , Yuanbo Xiangli , Sida Peng , Xingang Pan , Nanxuan Zhao , Christian Theobalt , Bo Dai , Dahua Lin