中文
相关论文

相关论文: D-TensoRF: Tensorial Radiance Fields for Dynamic S…

200 篇论文

We propose a novel visual re-localization method based on direct matching between the implicit 3D descriptors and the 2D image with transformer. A conditional neural radiance field(NeRF) is chosen as the 3D scene representation in our…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Jianlin Liu , Qiang Nie , Yong Liu , Chengjie Wang

Neural Radiance Fields (NeRFs) are a powerful representation for modeling a 3D scene as a continuous function. Though NeRF is able to render complex 3D scenes with view-dependent effects, few efforts have been devoted to exploring its…

计算机视觉与模式识别 · 计算机科学 2022-11-18 Yifan Jiang , Peter Hedman , Ben Mildenhall , Dejia Xu , Jonathan T. Barron , Zhangyang Wang , Tianfan Xue

Neural radiance fields (NeRFs) have become a ubiquitous tool for modeling scene appearance and geometry from multiview imagery. Recent work has also begun to explore how to use additional supervision from lidar or depth sensor measurements…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Anagh Malik , Parsa Mirdehghan , Sotiris Nousias , Kiriakos N. Kutulakos , David B. Lindell

Neural radiance fields (NeRFs) have emerged as a prominent pre-training paradigm for vision-centric autonomous driving, which enhances 3D geometry and appearance understanding in a fully self-supervised manner. To apply NeRF-based…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Hyeonjun Jeong , Juyeb Shin , Dongsuk Kum

While NeRF has shown great success for neural reconstruction and rendering, its limited MLP capacity and long per-scene optimization times make it challenging to model large-scale indoor scenes. In contrast, classical 3D reconstruction…

计算机视觉与模式识别 · 计算机科学 2022-03-23 Xiaoshuai Zhang , Sai Bi , Kalyan Sunkavalli , Hao Su , Zexiang Xu

Neural rendering combines ideas from classical computer graphics and machine learning to synthesize images from real-world observations. NeRF, short for Neural Radiance Fields, is a recent innovation that uses AI algorithms to create 3D…

计算机视觉与模式识别 · 计算机科学 2024-03-20 AKM Shahariar Azad Rabby , Chengcui Zhang

Neural Radiance Field (NeRF) has gained considerable attention recently for 3D scene reconstruction and novel view synthesis due to its remarkable synthesis quality. However, image blurriness caused by defocus or motion, which often occurs…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Li Ma , Xiaoyu Li , Jing Liao , Qi Zhang , Xuan Wang , Jue Wang , Pedro V. Sander

Extensions of Neural Radiance Fields (NeRFs) to model dynamic scenes have enabled their near photo-realistic, free-viewpoint rendering. Although these methods have shown some potential in creating immersive experiences, two drawbacks limit…

计算机视觉与模式识别 · 计算机科学 2024-06-07 Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang , Pedro Miraldo , Suhas Lohit , Moitreya Chatterjee

Neural Radiance Fields (NeRFs) have remodeled 3D scene representation since release. NeRFs can effectively reconstruct complex 3D scenes from 2D images, advancing different fields and applications such as scene understanding, 3D content…

计算机视觉与模式识别 · 计算机科学 2025-12-10 Wenhui Xiao , Remi Chierchia , Rodrigo Santa Cruz , Xuesong Li , David Ahmedt-Aristizabal , Olivier Salvado , Clinton Fookes , Leo Lebrat

We present the first method capable of photorealistically reconstructing deformable scenes using photos/videos captured casually from mobile phones. Our approach augments neural radiance fields (NeRF) by optimizing an additional continuous…

计算机视觉与模式识别 · 计算机科学 2021-09-13 Keunhong Park , Utkarsh Sinha , Jonathan T. Barron , Sofien Bouaziz , Dan B Goldman , Steven M. Seitz , Ricardo Martin-Brualla

Neural implicit representation of visual scenes has attracted a lot of attention in recent research of computer vision and graphics. Most prior methods focus on how to reconstruct 3D scene representation from a set of images. In this work,…

计算机视觉与模式识别 · 计算机科学 2024-09-12 Wenpu Li , Pian Wan , Peng Wang , Jinghang Li , Yi Zhou , Peidong Liu

In recent years, Neural Radiance Fields (NeRFs) have demonstrated significant potential in encoding highly-detailed 3D geometry and environmental appearance, positioning themselves as a promising alternative to traditional explicit…

计算机视觉与模式识别 · 计算机科学 2024-03-18 Tianxiang Ye , Qi Wu , Junyuan Deng , Guoqing Liu , Liu Liu , Songpengcheng Xia , Liang Pang , Wenxian Yu , Ling Pei

We propose TensoIR, a novel inverse rendering approach based on tensor factorization and neural fields. Unlike previous works that use purely MLP-based neural fields, thus suffering from low capacity and high computation costs, we extend…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Haian Jin , Isabella Liu , Peijia Xu , Xiaoshuai Zhang , Songfang Han , Sai Bi , Xiaowei Zhou , Zexiang Xu , Hao Su

Despite advancements in Neural Implicit models for 3D surface reconstruction, handling dynamic environments with interactions between arbitrary rigid, non-rigid, or deformable entities remains challenging. The generic reconstruction methods…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Sandika Biswas , Qianyi Wu , Biplab Banerjee , Hamid Rezatofighi

We present a method that achieves state-of-the-art results for synthesizing novel views of complex scenes by optimizing an underlying continuous volumetric scene function using a sparse set of input views. Our algorithm represents a scene…

计算机视觉与模式识别 · 计算机科学 2020-08-05 Ben Mildenhall , Pratul P. Srinivasan , Matthew Tancik , Jonathan T. Barron , Ravi Ramamoorthi , Ren Ng

We propose Strivec, a novel neural representation that models a 3D scene as a radiance field with sparsely distributed and compactly factorized local tensor feature grids. Our approach leverages tensor decomposition, following the recent…

计算机视觉与模式识别 · 计算机科学 2023-08-25 Quankai Gao , Qiangeng Xu , Hao Su , Ulrich Neumann , Zexiang Xu

Under good conditions, Neural Radiance Fields (NeRFs) have shown impressive results on novel view synthesis tasks. NeRFs learn a scene's color and density fields by minimizing the photometric discrepancy between training views and…

计算机视觉与模式识别 · 计算机科学 2023-11-09 Jamie Wynn , Daniyar Turmukhambetov

Existing methods for the 4D reconstruction of general, non-rigidly deforming objects focus on novel-view synthesis and neglect correspondences. However, time consistency enables advanced downstream tasks like 3D editing, motion analysis, or…

计算机视觉与模式识别 · 计算机科学 2023-08-17 Edith Tretschk , Vladislav Golyanik , Michael Zollhoefer , Aljaz Bozic , Christoph Lassner , Christian Theobalt

Recent approaches to render photorealistic views from a limited set of photographs have pushed the boundaries of our interactions with pictures of static scenes. The ability to recreate moments, that is, time-varying sequences, is perhaps…

计算机视觉与模式识别 · 计算机科学 2021-05-14 Chaoyang Wang , Ben Eckart , Simon Lucey , Orazio Gallo

Given a monocular video, segmenting and decoupling dynamic objects while recovering the static environment is a widely studied problem in machine intelligence. Existing solutions usually approach this problem in the image domain, limiting…

计算机视觉与模式识别 · 计算机科学 2022-11-08 Tianhao Wu , Fangcheng Zhong , Andrea Tagliasacchi , Forrester Cole , Cengiz Oztireli