English
Related papers

Related papers: LookCloser: Frequency-aware Radiance Field for Tin…

200 papers

In this work, we introduce SCALAR-NeRF, a novel framework tailored for scalable large-scale neural scene reconstruction. We structure the neural representation as an encoder-decoder architecture, where the encoder processes 3D point…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Yu Chen , Gim Hee Lee

Comprehensive 3D scene understanding, both geometrically and semantically, is important for real-world applications such as robot perception. Most of the existing work has focused on developing data-driven discriminative models for scene…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Mingtong Zhang , Shuhong Zheng , Zhipeng Bao , Martial Hebert , Yu-Xiong Wang

Human visual sensitivity to spatial details declines towards the periphery. Novel image synthesis techniques, so-called foveated rendering, exploit this observation and reduce the spatial resolution of synthesized images for the periphery,…

Graphics · Computer Science 2022-04-12 Taimoor Tariq , Cara Tursun , Piotr Didyk

Neural Radiance Fields (NeRF) is a technique for high quality novel view synthesis from a collection of posed input images. Like most view synthesis methods, NeRF uses tonemapped low dynamic range (LDR) as input; these images have been…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Ben Mildenhall , Peter Hedman , Ricardo Martin-Brualla , Pratul Srinivasan , Jonathan T. Barron

We introduce ViewNeRF, a Neural Radiance Field-based viewpoint estimation method that learns to predict category-level viewpoints directly from images during training. While NeRF is usually trained with ground-truth camera poses, multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Octave Mariotti , Oisin Mac Aodha , Hakan Bilen

Neural Radiance Fields (NeRFs) have proven to be powerful 3D representations, capable of high quality novel view synthesis of complex scenes. While NeRFs have been applied to graphics, vision, and robotics, problems with slow rendering…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Tristan Aumentado-Armstrong , Ashkan Mirzaei , Marcus A. Brubaker , Jonathan Kelly , Alex Levinshtein , Konstantinos G. Derpanis , Igor Gilitschenski

We present a method for composing photorealistic scenes from captured images of objects. Our work builds upon neural radiance fields (NeRFs), which implicitly model the volumetric density and directionally-emitted radiance of a scene. While…

Computer Vision and Pattern Recognition · Computer Science 2020-12-16 Michelle Guo , Alireza Fathi , Jiajun Wu , Thomas Funkhouser

Existing inverse rendering combined with neural rendering methods can only perform editable novel view synthesis on object-specific scenes, while we present intrinsic neural radiance fields, dubbed IntrinsicNeRF, which introduce intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Weicai Ye , Shuo Chen , Chong Bao , Hujun Bao , Marc Pollefeys , Zhaopeng Cui , Guofeng Zhang

Neural Radiance Fields (NeRF) is a revolutionary approach for rendering scenes by sampling a single ray per pixel and it has demonstrated impressive capabilities in novel-view synthesis from static scene images. However, in practice, we…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yifan Yang , Shuhai Zhang , Zixiong Huang , Yubing Zhang , Mingkui Tan

Learning accurate scene reconstruction without pose priors in neural radiance fields is challenging due to inherent geometric ambiguity. Recent development either relies on correspondence priors for regularization or uses off-the-shelf flow…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Xunzhi Zheng , Dan Xu

Neural Radiance Field (NeRF) technology has made significant strides in creating novel viewpoints. However, its effectiveness is hampered when working with sparsely available views, often leading to performance dips due to overfitting.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Yuru Xiao , Xianming Liu , Deming Zhai , Kui Jiang , Junjun Jiang , Xiangyang Ji

We represent the ResNeRF, a novel geometry-guided two-stage framework for indoor scene novel view synthesis. Be aware of that a good geometry would greatly boost the performance of novel view synthesis, and to avoid the geometry ambiguity…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Yuting Xiao , Yiqun Zhao , Yanyu Xu , Shenghua Gao

Virtual Reality (VR) is becoming ubiquitous with the rise of consumer displays and commercial VR platforms. Such displays require low latency and high quality rendering of synthetic imagery with reduced compute overheads. Recent advances in…

Graphics · Computer Science 2022-07-25 Nianchen Deng , Zhenyi He , Jiannan Ye , Budmonde Duinkharjav , Praneeth Chakravarthula , Xubo Yang , Qi Sun

We introduce NeRFCom, a novel communication system designed for end-to-end 3D scene transmission. Compared to traditional systems relying on handcrafted NeRF semantic feature decomposition for compression and well-adaptive channel coding…

Signal Processing · Electrical Eng. & Systems 2025-02-28 Weijie Yue , Zhongwei Si , Bolin Wu , Sixian Wang , Xiaoqi Qin , Kai Niu , Jincheng Dai , Ping Zhang

This research addresses the challenge of developing a universal deepfake detector that can effectively identify unseen deepfake images despite limited training data. Existing frequency-based paradigms have relied on frequency-level…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Chuangchuang Tan , Yao Zhao , Shikui Wei , Guanghua Gu , Ping Liu , Yunchao Wei

Neural radiance fields (NeRF) bring a new wave for 3D interactive experiences. However, as an important part of the immersive experiences, the defocus effects have not been fully explored within NeRF. Some recent NeRF-based methods generate…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Yinhuai Wang , Shuzhou Yang , Yujie Hu , Jian Zhang

NeRF provides unparalleled fidelity of novel view synthesis: rendering a 3D scene from an arbitrary viewpoint. NeRF requires training on a large number of views that fully cover a scene, which limits its applicability. While these issues…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Pol Moreno , Adam R. Kosiorek , Heiko Strathmann , Daniel Zoran , Rosalia G. Schneider , Björn Winckler , Larisa Markeeva , Théophane Weber , Danilo J. Rezende

Neural radiance fields (NeRFs) show potential for transforming images captured worldwide into immersive 3D visual experiences. However, most of this captured visual data remains siloed in our camera rolls as these images contain personal…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Zaid Tasneem , Akshat Dave , Abhishek Singh , Kushagra Tiwary , Praneeth Vepakomma , Ashok Veeraraghavan , Ramesh Raskar

We present a new generalizable NeRF method that is able to directly generalize to new unseen scenarios and perform novel view synthesis with as few as two source views. The key to our approach lies in the explicitly modeled correspondence…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Yuedong Chen , Haofei Xu , Qianyi Wu , Chuanxia Zheng , Tat-Jen Cham , Jianfei Cai

First-Person-View (FPV) holds immense potential for revolutionizing the trajectory of Unmanned Aerial Vehicles (UAVs), offering an exhilarating avenue for navigating complex building structures. Yet, traditional Neural Radiance Field (NeRF)…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Liqi Yan , Qifan Wang , Junhan Zhao , Qiang Guan , Zheng Tang , Jianhui Zhang , Dongfang Liu