中文
相关论文

相关论文: LANe: Lighting-Aware Neural Fields for Composition…

200 篇论文

Light field images capture multi-view scene information and play a crucial role in 3D scene reconstruction. However, their high-dimensional nature results in enormous data volumes, posing a significant challenge for efficient compression in…

图像与视频处理 · 电气工程与系统科学 2025-10-20 Gai Zhang , Xinfeng Zhang , Lv Tang , Hongyu An , Li Zhang , Qingming Huang

This project presents an exploration into 3D scene reconstruction of synthetic and real-world scenes using Neural Radiance Field (NeRF) approaches. We primarily take advantage of the reduction in training and rendering time of neural…

计算机视觉与模式识别 · 计算机科学 2022-10-25 Benedict Quartey , Tuluhan Akbulut , Wasiwasi Mgonzo , Zheng Xin Yong

We present Knowledge NeRF to synthesize novel views for dynamic scenes. Reconstructing dynamic 3D scenes from few sparse views and rendering them from arbitrary perspectives is a challenging problem with applications in various domains.…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Wenxiao Cai , Xinyue Lei , Xinyu He , Junming Leo Chen , Yangang Wang

We introduce Neural Point Light Fields that represent scenes implicitly with a light field living on a sparse point cloud. Combining differentiable volume rendering with learned implicit density representations has made it possible to…

计算机视觉与模式识别 · 计算机科学 2022-06-08 Julian Ost , Issam Laradji , Alejandro Newell , Yuval Bahat , Felix Heide

Automatically generating high-quality real world 3D scenes is of enormous interest for applications such as virtual reality and robotics simulation. Towards this goal, we introduce NeuralField-LDM, a generative model capable of synthesizing…

计算机视觉与模式识别 · 计算机科学 2023-04-20 Seung Wook Kim , Bradley Brown , Kangxue Yin , Karsten Kreis , Katja Schwarz , Daiqing Li , Robin Rombach , Antonio Torralba , Sanja Fidler

Neural Radiance Fields (NeRF) have recently gained a surge of interest within the computer vision community for its power to synthesize photorealistic novel views of real-world scenes. One limitation of NeRF, however, is its requirement of…

计算机视觉与模式识别 · 计算机科学 2021-08-20 Chen-Hsuan Lin , Wei-Chiu Ma , Antonio Torralba , Simon Lucey

Recent advances in neural radiance fields (NeRFs) achieve state-of-the-art novel view synthesis and facilitate dense estimation of scene properties. However, NeRFs often fail for large, unbounded scenes that are captured under very sparse…

Neural Radiance Field (NeRF) approaches learn the underlying 3D representation of a scene and generate photo-realistic novel views with high fidelity. However, most proposed settings concentrate on modelling a single object or a single…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Ankit Dhiman , Srinath R , Harsh Rangwani , Rishubh Parihar , Lokesh R Boregowda , Srinath Sridhar , R Venkatesh Babu

Neural Radiance Fields (NeRFs) have been remarkably successful at synthesizing novel views of 3D scenes by optimizing a volumetric scene function. This scene function models how optical rays bring color information from a 3D object to the…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Chaitanya Amballa , Sattwik Basu , Yu-Lin Wei , Zhijian Yang , Mehmet Ergezer , Romit Roy Choudhury

This review thoroughly examines the role of semantically-aware Neural Radiance Fields (NeRFs) in visual scene understanding, covering an analysis of over 250 scholarly papers. It explores how NeRFs adeptly infer 3D representations for both…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Thang-Anh-Quan Nguyen , Amine Bourki , Mátyás Macudzinski , Anthony Brunel , Mohammed Bennamoun

Sound plays a major role in human perception. Along with vision, it provides essential information for understanding our surroundings. Despite advances in neural implicit representations, learning acoustics that align with visual scenes…

声音 · 计算机科学 2025-10-03 Amandine Brunetto , Sascha Hornauer , Fabien Moutarde

We present a neural rendering framework for simultaneous view synthesis and appearance editing of a scene from multi-view images captured under known environment illumination. Existing approaches either achieve view synthesis alone or view…

计算机视觉与模式识别 · 计算机科学 2021-10-18 Pulkit Gera , Aakash KT , Dhawal Sirikonda , Parikshit Sakurikar , P. J. Narayanan

We present a novel differentiable rendering framework for joint geometry, material, and lighting estimation from multi-view images. In contrast to previous methods which assume a simplified environment map or co-located flashlights, in this…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Jingyang Zhang , Yao Yao , Shiwei Li , Jingbo Liu , Tian Fang , David McKinnon , Yanghai Tsin , Long Quan

Recent advances in generative visual models and neural radiance fields have greatly boosted 3D-aware image synthesis and stylization tasks. However, previous NeRF-based work is limited to single scene stylization, training a model to…

计算机视觉与模式识别 · 计算机科学 2024-04-29 Zichen Tang , Hongyu Yang

3D-aware generative models have demonstrated their superb performance to generate 3D neural radiance fields (NeRF) from a collection of monocular 2D images even for topology-varying object categories. However, these methods still lack the…

计算机视觉与模式识别 · 计算机科学 2022-09-12 Ziyu Wang , Yu Deng , Jiaolong Yang , Jingyi Yu , Xin Tong

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

计算机视觉与模式识别 · 计算机科学 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

In this work, we present a novel learning-based approach to synthesize new views of a light field image. In particular, given the four corner views of a light field, the presented method estimates any in-between view. We use three…

计算机视觉与模式识别 · 计算机科学 2021-02-19 Julia Navarro , Neus Sabater

Neural fields (NeRF) have emerged as a promising approach for representing continuous 3D scenes. Nevertheless, the lack of semantic encoding in NeRFs poses a significant challenge for scene decomposition. To address this challenge, we…

计算机视觉与模式识别 · 计算机科学 2024-05-09 Ning Wang , Lefei Zhang , Angel X Chang

We propose DistillNeRF, a self-supervised learning framework addressing the challenge of understanding 3D environments from limited 2D observations in outdoor autonomous driving scenes. Our method is a generalizable feedforward model that…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Letian Wang , Seung Wook Kim , Jiawei Yang , Cunjun Yu , Boris Ivanovic , Steven L. Waslander , Yue Wang , Sanja Fidler , Marco Pavone , Peter Karkus

We present a differentiable rendering framework for material and lighting estimation from multi-view images and a reconstructed geometry. In the framework, we represent scene lightings as the Neural Incident Light Field (NeILF) and material…

计算机视觉与模式识别 · 计算机科学 2022-03-21 Yao Yao , Jingyang Zhang , Jingbo Liu , Yihang Qu , Tian Fang , David McKinnon , Yanghai Tsin , Long Quan