English
Related papers

Related papers: GSN: Generalisable Segmentation in Neural Radiance…

200 papers

Neural Radiance Fields (NeRF) has emerged as a compelling framework for scene representation and 3D recovery. To improve its performance on real-world data, depth regularizations have proven to be the most effective ones. However, depth…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Aoxiang Fan , Corentin Dumery , Nicolas Talabot , Pascal Fua

In recent studies, the generalization of neural radiance fields for novel view synthesis task has been widely explored. However, existing methods are limited to objects and indoor scenes. In this work, we extend the generalization task to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Liang Song , Guangming Wang , Jiuming Liu , Zhenyang Fu , Yanzi Miao , Hesheng

In view synthesis, a neural radiance field approximates underlying density and radiance fields based on a sparse set of scene pictures. To generate a pixel of a novel view, it marches a ray through the pixel and computes a weighted sum of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Nikita Morozov , Denis Rakitin , Oleg Desheulin , Dmitry Vetrov , Kirill Struminsky

Dynamic scene representation and reconstruction have undergone transformative advances in recent years, catalyzed by breakthroughs in neural radiance fields and 3D Gaussian splatting techniques. While initially developed for static…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Jinlong Fan , Xuepu Zeng , Jing Zhang , Mingming Gong , Yuxiang Yang , Dacheng Tao

3D Gaussian Splatting (3DGS) has demonstrated impressive novel view synthesis performance. While conventional methods require per-scene optimization, more recently several feed-forward methods have been proposed to generate pixel-aligned…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Shengjun Zhang , Xin Fei , Fangfu Liu , Haixu Song , Yueqi Duan

Neural Radiance Fields (NeRF) have garnered considerable attention as a paradigm for novel view synthesis by learning scene representations from discrete observations. Nevertheless, NeRF exhibit pronounced performance degradation when…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Zelin Gao , Weichen Dai , Yu Zhang

Implicit neural representations, represented by Neural Radiance Fields (NeRF), have dominated research in 3D computer vision by virtue of high-quality visual results and data-driven benefits. However, their realistic applications are…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yaokun Li , Chao Gou , Guang Tan

This paper addresses semantic image segmentation by incorporating rich information into Markov Random Field (MRF), including high-order relations and mixture of label contexts. Unlike previous works that optimized MRFs using iterative…

Computer Vision and Pattern Recognition · Computer Science 2015-09-25 Ziwei Liu , Xiaoxiao Li , Ping Luo , Chen Change Loy , Xiaoou Tang

Neural Radiance Field (NeRF)-based segmentation methods focus on object semantics and rely solely on RGB data, lacking intrinsic material properties. This limitation restricts accurate material perception, which is crucial for robotics,…

Image and Video Processing · Electrical Eng. & Systems 2025-08-07 Fabian Perez , Sara Rojas , Carlos Hinojosa , Hoover Rueda-Chacón , Bernard Ghanem

Under good conditions, Neural Radiance Fields (NeRFs) have shown impressive results on novel view synthesis tasks. NeRFs learn a scene's color and density fields by minimizing the photometric discrepancy between training views and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Jamie Wynn , Daniyar Turmukhambetov

In recent advancements in novel view synthesis, generalizable Neural Radiance Fields (NeRF) based methods applied to human subjects have shown remarkable results in generating novel views from few images. However, this generalization…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Arnab Dey , Di Yang , Antitza Dantcheva , Jean Martinet

General scene understanding for robotics requires flexible semantic representation, so that novel objects and structures which may not have been known at training time can be identified, segmented and grouped. We present an algorithm which…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Kirill Mazur , Edgar Sucar , Andrew J. Davison

Most Neural Radiance Fields (NeRFs) exhibit limited generalization capabilities, which restrict their applicability in representing multiple scenes using a single model. To address this problem, existing generalizable NeRF methods simply…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Ganlin Yang , Guoqiang Wei , Zhizheng Zhang , Yan Lu , Dong Liu

In this paper, we propose SpectralNeRF, an end-to-end Neural Radiance Field (NeRF)-based architecture for high-quality physically based rendering from a novel spectral perspective. We modify the classical spectral rendering into two main…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Ru Li , Jia Liu , Guanghui Liu , Shengping Zhang , Bing Zeng , Shuaicheng Liu

This work targets at using a general deep learning framework to synthesize free-viewpoint images of arbitrary human performers, only requiring a sparse number of camera views as inputs and skirting per-case fine-tuning. The large variation…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Wei Cheng , Su Xu , Jingtan Piao , Chen Qian , Wayne Wu , Kwan-Yee Lin , Hongsheng Li

Neural Radiance Fields (NeRFs) are emerging as a ubiquitous scene representation that allows for novel view synthesis. Increasingly, NeRFs will be shareable with other people. Before sharing a NeRF, though, it might be desirable to remove…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Silvan Weder , Guillermo Garcia-Hernando , Aron Monszpart , Marc Pollefeys , Gabriel Brostow , Michael Firman , Sara Vicente

The Gaussian-radial-basis function neural network (GRBFNN) has been a popular choice for interpolation and classification. However, it is computationally intensive when the dimension of the input vector is high. To address this issue, we…

Machine Learning · Computer Science 2023-08-15 Siyuan Xing , Jianqiao Sun

Neural Radiance Fields (NeRFs) aim to synthesize novel views of objects and scenes, given the object-centric camera views with large overlaps. However, we conjugate that this paradigm does not fit the nature of the street views that are…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Ziyang Xie , Junge Zhang , Wenye Li , Feihu Zhang , Li Zhang

Explicit neural representations such as 3D Gaussian Splatting (3DGS) enable high-fidelity and real-time novel view synthesis, yet optimize for alpha-composited optical appearance rather than ray-intersectable geometry. In contrast,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Niklas Vaara , Lam Huynh , Pekka Sangi , Miguel Bordallo López , Janne Heikkilä

Predicting scene dynamics from visual observations is challenging. Existing methods capture dynamics only within observed boundaries failing to extrapolate far beyond the training sequence. Node-RF (Neural ODE-based NeRF) overcomes this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Hiran Sarkar , Liming Kuang , Yordanka Velikova , Benjamin Busam