中文
相关论文

相关论文: Open-NeRF: Towards Open Vocabulary NeRF Decomposit…

200 篇论文

Given that a conventional laparoscope only provides a two-dimensional (2-D) view, the detection and diagnosis of medical ailments can be challenging. To overcome the visual constraints associated with laparoscopy, the use of laparoscopic…

计算机视觉与模式识别 · 计算机科学 2023-10-19 Khoa Tuan Nguyen , Francesca Tozzi , Nikdokht Rashidian , Wouter Willaert , Joris Vankerschaver , Wesley De Neve

The emergence of Neural Radiance Fields (NeRF) has greatly impacted 3D scene modeling and novel-view synthesis. As a kind of visual media for 3D scene representation, compression with high rate-distortion performance is an eternal target.…

计算机视觉与模式识别 · 计算机科学 2024-04-04 Sicheng Li , Hao Li , Yiyi Liao , Lu Yu

In recent years, Neural Radiance Fields (NeRF) has made remarkable progress in the field of computer vision and graphics, providing strong technical support for solving key tasks including 3D scene understanding, new perspective synthesis,…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Mingyuan Yao , Yukang Huo , Yang Ran , Qingbin Tian , Ruifeng Wang , Haihua Wang

Neural Radiance Field(NeRF) is an novel implicit method to achieve the 3D reconstruction and representation with a high resolution. After the first research of NeRF is proposed, NeRF has gained a robust developing power and is booming in…

计算机视觉与模式识别 · 计算机科学 2024-05-15 Jinwei Lin

Recent advancements in vision-language foundation models have significantly enhanced open-vocabulary 3D scene understanding. However, the generalizability of existing methods is constrained due to their framework designs and their reliance…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Yunsong Wang , Hanlin Chen , Gim Hee Lee

Neural Radiance Fields (NeRF) has recently gained popularity for its impressive novel view synthesis ability. This paper studies the problem of hallucinated NeRF: i.e., recovering a realistic NeRF at a different time of day from a group of…

计算机视觉与模式识别 · 计算机科学 2022-05-31 Xingyu Chen , Qi Zhang , Xiaoyu Li , Yue Chen , Ying Feng , Xuan Wang , Jue Wang

Image translation and manipulation have gain increasing attention along with the rapid development of deep generative models. Although existing approaches have brought impressive results, they mainly operated in 2D space. In light of recent…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Yuedong Chen , Qianyi Wu , Chuanxia Zheng , Tat-Jen Cham , Jianfei Cai

Neural radiance fields (NeRF) have revolutionized the field of image-based view synthesis. However, NeRF uses straight rays and fails to deal with complicated light path changes caused by refraction and reflection. This prevents NeRF from…

计算机视觉与模式识别 · 计算机科学 2023-09-25 Xiaoxue Chen , Junchen Liu , Hao Zhao , Guyue Zhou , Ya-Qin Zhang

Considering the problem of novel view synthesis (NVS) from only a set of 2D images, we simplify the training process of Neural Radiance Field (NeRF) on forward-facing scenes by removing the requirement of known or pre-computed camera…

计算机视觉与模式识别 · 计算机科学 2022-04-07 Zirui Wang , Shangzhe Wu , Weidi Xie , Min Chen , Victor Adrian Prisacariu

Talking head synthesis is to synthesize a lip-synchronized talking head video using audio. Recently, the capability of NeRF to enhance the realism and texture details of synthesized talking heads has attracted the attention of researchers.…

图形学 · 计算机科学 2025-02-21 Xiaoxing Liu , Zhilei Liu , Chongke Bi

Though Neural Radiance Field (NeRF) demonstrates compelling novel view synthesis results, it is still unintuitive to edit a pre-trained NeRF because the neural network's parameters and the scene geometry/appearance are often not explicitly…

计算机视觉与模式识别 · 计算机科学 2022-06-13 Hao-Kang Liu , I-Chao Shen , Bing-Yu Chen

3D reconstruction technology generates three-dimensional representations of real-world objects, scenes, or environments using sensor data such as 2D images, with extensive applications in robotics, autonomous vehicles, and virtual reality…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Hong Zhang , Fei Guo , Zihan Xie , Dizhao Yao

With Neural Radiance Fields (NeRFs) arising as a powerful 3D representation, research has investigated its various downstream tasks, including inpainting NeRFs with 2D images. Despite successful efforts addressing the view consistency and…

图像与视频处理 · 电气工程与系统科学 2025-04-04 Jingyu Shi , Achleshwar Luthra , Jiazhi Li , Xiang Gao , Xiyun Song , Zongfang Lin , David Gu , Heather Yu

Neural Radiance Fields (NeRFs) encode the radiance in a scene parameterized by the scene's plenoptic function. This is achieved by using an MLP together with a mapping to a higher-dimensional space, and has been proven to capture scenes…

计算机视觉与模式识别 · 计算机科学 2022-12-08 Siddhant Ranade , Christoph Lassner , Kai Li , Christian Haene , Shen-Chi Chen , Jean-Charles Bazin , Sofien Bouaziz

Understanding 3D scenes is a crucial challenge in computer vision research with applications spanning multiple domains. Recent advancements in distilling 2D vision-language foundation models into neural fields, like NeRF and 3DGS, enable…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Zihan Gao , Lingling Li , Licheng Jiao , Fang Liu , Xu Liu , Wenping Ma , Yuwei Guo , Shuyuan Yang

We present a new method for estimating the Neural Reflectance Field (NReF) of an object from a set of posed multi-view images under unknown lighting. NReF represents 3D geometry and appearance of objects in a disentangled manner, and are…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Xiu Li , Xiao Li , Yan Lu

Neural Radiance Field (NeRF) is a framework that represents a 3D scene in the weights of a fully connected neural network, known as the Multi-Layer Perception(MLP). The method was introduced for the task of novel view synthesis and is able…

计算机视觉与模式识别 · 计算机科学 2023-05-02 Mohamed Debbagh

Thin, reflective objects such as forks and whisks are common in our daily lives, but they are particularly challenging for robot perception because it is hard to reconstruct them using commodity RGB-D cameras or multi-view stereo…

机器人学 · 计算机科学 2022-04-28 Lin Yen-Chen , Pete Florence , Jonathan T. Barron , Tsung-Yi Lin , Alberto Rodriguez , Phillip Isola

Decomposing a scene into its shape, reflectance, and illumination is a challenging but important problem in computer vision and graphics. This problem is inherently more challenging when the illumination is not a single light source under…

计算机视觉与模式识别 · 计算机科学 2021-08-27 Mark Boss , Raphael Braun , Varun Jampani , Jonathan T. Barron , Ce Liu , Hendrik P. A. Lensch

We present a learning-based method for synthesizing novel views of complex scenes using only unstructured collections of in-the-wild photographs. We build on Neural Radiance Fields (NeRF), which uses the weights of a multilayer perceptron…

计算机视觉与模式识别 · 计算机科学 2021-01-07 Ricardo Martin-Brualla , Noha Radwan , Mehdi S. M. Sajjadi , Jonathan T. Barron , Alexey Dosovitskiy , Daniel Duckworth