English
Related papers

Related papers: From NeRFs to Gaussian Splats, and Back

200 papers

Utilizing multi-view inputs to synthesize novel-view images, Neural Radiance Fields (NeRF) have emerged as a popular research topic in 3D vision. In this work, we introduce a Generalizable Semantic Neural Radiance Field (GSNeRF), which…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Zi-Ting Chou , Sheng-Yu Huang , I-Jieh Liu , Yu-Chiang Frank Wang

X-ray is widely applied for transmission imaging due to its stronger penetration than natural light. When rendering novel view X-ray projections, existing methods mainly based on NeRF suffer from long training time and slow inference speed.…

Image and Video Processing · Electrical Eng. & Systems 2024-10-29 Yuanhao Cai , Yixun Liang , Jiahao Wang , Angtian Wang , Yulun Zhang , Xiaokang Yang , Zongwei Zhou , Alan Yuille

The 3D Gaussian splatting method has drawn a lot of attention, thanks to its high performance in training and high quality of the rendered image. However, it uses anisotropic Gaussian kernels to represent the scene. Although such…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Yuanhao Gong , Lantao Yu , Guanghui Yue

Gaussian Markov random fields (GMRFs) are useful in a broad range of applications. In this paper we tackle the problem of learning a sparse GMRF in a high-dimensional space. Our approach uses the l1-norm as a regularization on the inverse…

Machine Learning · Computer Science 2012-06-18 John Duchi , Stephen Gould , Daphne Koller

Neural radiance fields, or NeRF, represent a breakthrough in the field of novel view synthesis and 3D modeling of complex scenes from multi-view image collections. Numerous recent works have shown the importance of making NeRF models more…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Thibaud Ehret , Roger Marí , Gabriele Facciolo

We tackle the ill-posed inverse rendering problem in 3D reconstruction with a Neural Radiance Field (NeRF) approach informed by Physics-Based Rendering (PBR) theory, named PBR-NeRF. Our method addresses a key limitation in most NeRF and 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Sean Wu , Shamik Basu , Tim Broedermann , Luc Van Gool , Christos Sakaridis

Novel view synthesis from unconstrained in-the-wild image collections remains a significant yet challenging task due to photometric variations and transient occluders that complicate accurate scene reconstruction. Previous methods have…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Congrong Xu , Justin Kerr , Angjoo Kanazawa

The 3D Gaussian splatting methods are getting popular. However, they work directly on the signal, leading to a dense representation of the signal. Even with some techniques such as pruning or distillation, the results are still dense. In…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Yuanhao Gong

Scene view synthesis, which generates novel views from limited perspectives, is increasingly vital for applications like virtual reality, augmented reality, and robotics. Unlike object-based tasks, such as generating 360{\deg} views of a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Xiaofeng Jin , Yan Fang , Matteo Frosi , Jianfei Ge , Jiangjian Xiao , Matteo Matteucci

Recent advancements in 3D Gaussian Splatting (3DGS) and Neural Radiance Fields (NeRF) have achieved impressive results in real-time 3D reconstruction and novel view synthesis. However, these methods struggle in large-scale, unconstrained…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Niluthpol Chowdhury Mithun , Tuan Pham , Qiao Wang , Ben Southall , Kshitij Minhas , Bogdan Matei , Stephan Mandt , Supun Samarasekera , Rakesh Kumar

We leverage repetitive elements in 3D scenes to improve novel view synthesis. Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have greatly improved novel view synthesis but renderings of unseen and occluded parts remain…

View synthesis using Neural Radiance Fields (NeRF) and Gaussian Splatting (GS) has demonstrated impressive fidelity in rendering real-world scenarios. However, practical methods for accurate and efficient epistemic Uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Chuanhao Sun , Thanos Triantafyllou , Anthos Makris , Maja Drmač , Kai Xu , Luo Mai , Mahesh K. Marina

One of the key advantages of 3D rendering is its ability to simulate intricate scenes accurately. One of the most widely used methods for this purpose is Gaussian Splatting, a novel approach that is known for its rapid training and…

Graphics · Computer Science 2024-05-31 Artur Kasymov , Bartosz Czekaj , Marcin Mazur , Jacek Tabor , Przemysław Spurek

Gaussian Splatting has rapidly emerged as a transformative technique for real-time 3D scene representation, offering a highly efficient and expressive alternative to Neural Radiance Fields (NeRF). Its ability to render complex scenes with…

Graphics · Computer Science 2025-08-20 Mahmoud Chick Zaouali , Todd Charter , Yehor Karpichev , Brandon Haworth , Homayoun Najjaran

Robots benefit from high-fidelity reconstructions of their environment, which should be geometrically accurate and photorealistic to support downstream tasks. While this can be achieved by building distance fields from range sensors and…

Robotics · Computer Science 2025-09-10 Yue Pan , Xingguang Zhong , Liren Jin , Louis Wiesmann , Marija Popović , Jens Behley , Cyrill Stachniss

Neural fields have emerged as a powerful framework for representing continuous multidimensional signals such as images and videos, 3D and 4D objects and scenes, and radiance fields. While efficient, achieving high-quality representation…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Abdelaziz Bouzidi , Hamid Laga , Hazem Wannous , Ferdous Sohel

Modeling the wireless radiance field (WRF) is fundamental to modern communication systems, enabling key tasks such as localization, sensing, and channel estimation. Traditional approaches, which rely on empirical formulas or physical…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Mufan Liu , Cixiao Zhang , Qi Yang , Yujie Cao , Yiling Xu , Yin Xu , Shu Sun , Mingzeng Dai , Yunfeng Guan

Wireless channel modeling is a key building block for next-generation wireless systems. Predicting the channel state information (CSI) across different transmitter locations can substantially reduce the pilot and feedback overhead of…

Signal Processing · Electrical Eng. & Systems 2026-05-18 Chenghong Bian , Meng Hua , Deniz Gunduz

We leverage increasingly popular three-dimensional neural representations in order to construct a unified and consistent explanation of a collection of uncalibrated images of the human face. Our approach utilizes Gaussian Splatting, since…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Haodi He , Jihun Yu , Ronald Fedkiw

In this paper, we aim at synthesizing a free-viewpoint video of an arbitrary human performance using sparse multi-view cameras. Recently, several works have addressed this problem by learning person-specific neural radiance fields (NeRF) to…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Youngjoong Kwon , Dahun Kim , Duygu Ceylan , Henry Fuchs