中文
相关论文

相关论文: D$^2$NeRF: Self-Supervised Decoupling of Dynamic a…

200 篇论文

Neural Radiances Fields (NeRF) and their extensions have shown great success in representing 3D scenes and synthesizing novel-view images. However, most NeRF methods take in low-dynamic-range (LDR) images, which may lose details, especially…

计算机视觉与模式识别 · 计算机科学 2024-01-12 Guanjun Wu , Taoran Yi , Jiemin Fang , Wenyu Liu , Xinggang Wang

Existing methods for the 4D reconstruction of general, non-rigidly deforming objects focus on novel-view synthesis and neglect correspondences. However, time consistency enables advanced downstream tasks like 3D editing, motion analysis, or…

计算机视觉与模式识别 · 计算机科学 2023-08-17 Edith Tretschk , Vladislav Golyanik , Michael Zollhoefer , Aljaz Bozic , Christoph Lassner , Christian Theobalt

We present radiance field propagation (RFP), a novel approach to segmenting objects in 3D during reconstruction given only unlabeled multi-view images of a scene. RFP is derived from emerging neural radiance field-based techniques, which…

计算机视觉与模式识别 · 计算机科学 2022-10-20 Xinhang Liu , Jiaben Chen , Huai Yu , Yu-Wing Tai , Chi-Keung Tang

We introduce the Satellite Neural Radiance Field (Sat-NeRF), a new end-to-end model for learning multi-view satellite photogrammetry in the wild. Sat-NeRF combines some of the latest trends in neural rendering with native satellite camera…

计算机视觉与模式识别 · 计算机科学 2022-04-22 Roger Marí , Gabriele Facciolo , Thibaud Ehret

We address the problem of synthesizing novel views from a monocular video depicting a complex dynamic scene. State-of-the-art methods based on temporally varying Neural Radiance Fields (aka dynamic NeRFs) have shown impressive results on…

计算机视觉与模式识别 · 计算机科学 2023-04-25 Zhengqi Li , Qianqian Wang , Forrester Cole , Richard Tucker , Noah Snavely

Decomposing a scene into its shape, reflectance, and illumination is a challenging but important problem in computer vision and graphics. This problem is inherently more challenging when the illumination is not a single light source under…

计算机视觉与模式识别 · 计算机科学 2021-08-27 Mark Boss , Raphael Braun , Varun Jampani , Jonathan T. Barron , Ce Liu , Hendrik P. A. Lensch

Recent advances in Neural Radiance Fields (NeRF) boast impressive performances for generative tasks such as novel view synthesis and 3D reconstruction. Methods based on neural radiance fields are able to represent the 3D world implicitly by…

计算机视觉与模式识别 · 计算机科学 2022-11-23 Jesus Zarzar , Sara Rojas , Silvio Giancola , Bernard Ghanem

Dynamic neural radiance fields (dynamic NeRFs) have demonstrated impressive results in novel view synthesis on 3D dynamic scenes. However, they often require complete video sequences for training followed by novel view synthesis, which is…

计算机视觉与模式识别 · 计算机科学 2023-05-25 Zhiwen Yan , Chen Li , Gim Hee Lee

Neural radiance field (NeRF) enables the synthesis of cutting-edge realistic novel view images of a 3D scene. It includes density and color fields to model the shape and radiance of a scene, respectively. Supervised by the photometric loss…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Qihang Fang , Yafei Song , Keqiang Li , Liefeng Bo

Novel view synthesis from a single image requires inferring occluded regions of objects and scenes whilst simultaneously maintaining semantic and physical consistency with the input. Existing approaches condition neural radiance fields…

计算机视觉与模式识别 · 计算机科学 2023-02-21 Jiatao Gu , Alex Trevithick , Kai-En Lin , Josh Susskind , Christian Theobalt , Lingjie Liu , Ravi Ramamoorthi

Adopting Neural Radiance Fields (NeRF) to long-duration dynamic sequences has been challenging. Existing methods struggle to balance between quality and storage size and encounter difficulties with complex scene changes such as topological…

计算机视觉与模式识别 · 计算机科学 2023-12-12 Minye Wu , Tinne Tuytelaars

We introduce HOSNeRF, a novel 360{\deg} free-viewpoint rendering method that reconstructs neural radiance fields for dynamic human-object-scene from a single monocular in-the-wild video. Our method enables pausing the video at any frame and…

计算机视觉与模式识别 · 计算机科学 2023-04-25 Jia-Wei Liu , Yan-Pei Cao , Tianyuan Yang , Eric Zhongcong Xu , Jussi Keppo , Ying Shan , Xiaohu Qie , Mike Zheng Shou

We cast multiview reconstruction from unknown pose as a generative modeling problem. From a collection of unannotated 2D images of a scene, our approach simultaneously learns both a network to predict camera pose from 2D image input, as…

计算机视觉与模式识别 · 计算机科学 2024-06-12 Xin Yuan , Rana Hanocka , Michael Maire

Neural Radiance Fields (NeRFs) are emerging as a ubiquitous scene representation that allows for novel view synthesis. Increasingly, NeRFs will be shareable with other people. Before sharing a NeRF, though, it might be desirable to remove…

计算机视觉与模式识别 · 计算机科学 2022-12-23 Silvan Weder , Guillermo Garcia-Hernando , Aron Monszpart , Marc Pollefeys , Gabriel Brostow , Michael Firman , Sara Vicente

Recent works use the Neural radiance field (NeRF) to perform multi-view 3D reconstruction, providing a significant leap in rendering photorealistic scenes. However, despite its efficacy, NeRF exhibits limited capability of learning…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Congyue Deng , Jiawei Yang , Leonidas Guibas , Yue Wang

Visual understanding of the world goes beyond the semantics and flat structure of individual images. In this work, we aim to capture both the 3D structure and dynamics of real-world scenes from monocular real-world videos. Our Dynamic Scene…

计算机视觉与模式识别 · 计算机科学 2024-03-18 Maximilian Seitzer , Sjoerd van Steenkiste , Thomas Kipf , Klaus Greff , Mehdi S. M. Sajjadi

Dynamic imaging involves the reconstruction of a spatio-temporal object at all times using its undersampled measurements. In particular, in dynamic computed tomography (dCT), only a single projection at one view angle is available at a…

图像与视频处理 · 电气工程与系统科学 2025-03-14 Berk Iskender , Sushan Nakarmi , Nitin Daphalapurkar , Marc L. Klasky , Yoram Bresler

We present MovingParts, a NeRF-based method for dynamic scene reconstruction and part discovery. We consider motion as an important cue for identifying parts, that all particles on the same part share the common motion pattern. From the…

计算机视觉与模式识别 · 计算机科学 2023-04-10 Kaizhi Yang , Xiaoshuai Zhang , Zhiao Huang , Xuejin Chen , Zexiang Xu , Hao Su

Neural Radiance Fields (NeRF) is a revolutionary approach for rendering scenes by sampling a single ray per pixel and it has demonstrated impressive capabilities in novel-view synthesis from static scene images. However, in practice, we…

计算机视觉与模式识别 · 计算机科学 2023-08-16 Yifan Yang , Shuhai Zhang , Zixiong Huang , Yubing Zhang , Mingkui Tan

We present STaR, a novel method that performs Self-supervised Tracking and Reconstruction of dynamic scenes with rigid motion from multi-view RGB videos without any manual annotation. Recent work has shown that neural networks are…

计算机视觉与模式识别 · 计算机科学 2021-01-06 Wentao Yuan , Zhaoyang Lv , Tanner Schmidt , Steven Lovegrove