中文
相关论文

相关论文: Neural Scene Flow Fields for Space-Time View Synth…

200 篇论文

We present an algorithm for generating novel views at arbitrary viewpoints and any input time step given a monocular video of a dynamic scene. Our work builds upon recent advances in neural implicit representation and uses continuous and…

计算机视觉与模式识别 · 计算机科学 2021-05-14 Chen Gao , Ayush Saraf , Johannes Kopf , Jia-Bin Huang

We introduce a novel method for dynamic free-view synthesis of an ambient scenes from a monocular capture bringing a immersive quality to the viewing experience. Our method builds upon the recent advancements in 3D Gaussian Splatting (3DGS)…

计算机视觉与模式识别 · 计算机科学 2024-06-14 Meng-Li Shih , Jia-Bin Huang , Changil Kim , Rajvi Shah , Johannes Kopf , Chen Gao

In this work, we pioneer Semantic Flow, a neural semantic representation of dynamic scenes from monocular videos. In contrast to previous NeRF methods that reconstruct dynamic scenes from the colors and volume densities of individual…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Fengrui Tian , Yueqi Duan , Angtian Wang , Jianfei Guo , Shaoyi Du

Dynamic novel view synthesis aims to capture the temporal evolution of visual content within videos. Existing methods struggle to distinguishing between motion and structure, particularly in scenarios where camera poses are either unknown…

计算机视觉与模式识别 · 计算机科学 2024-01-12 Chaoyang Wang , Peiye Zhuang , Aliaksandr Siarohin , Junli Cao , Guocheng Qian , Hsin-Ying Lee , Sergey Tulyakov

Novel view synthesis from an in-the-wild video is difficult due to challenges like scene dynamics and lack of parallax. While existing methods have shown promising results with implicit neural radiance fields, they are slow to train and…

计算机视觉与模式识别 · 计算机科学 2024-07-22 Yao-Chih Lee , Zhoutong Zhang , Kevin Blackburn-Matzen , Simon Niklaus , Jianming Zhang , Jia-Bin Huang , Feng Liu

Rendering scenes observed in a monocular video from novel viewpoints is a challenging problem. For static scenes the community has studied both scene-specific optimization techniques, which optimize on every test scene, and generalized…

计算机视觉与模式识别 · 计算机科学 2024-02-21 Xiaoming Zhao , Alex Colburn , Fangchang Ma , Miguel Angel Bautista , Joshua M. Susskind , Alexander G. Schwing

We present a method that achieves state-of-the-art results for synthesizing novel views of complex scenes by optimizing an underlying continuous volumetric scene function using a sparse set of input views. Our algorithm represents a scene…

计算机视觉与模式识别 · 计算机科学 2020-08-05 Ben Mildenhall , Pratul P. Srinivasan , Matthew Tancik , Jonathan T. Barron , Ravi Ramamoorthi , Ren Ng

Synthesizing novel views of dynamic humans from stationary monocular cameras is a specialized but desirable setup. This is particularly attractive as it does not require static scenes, controlled environments, or specialized capture…

计算机视觉与模式识别 · 计算机科学 2022-02-08 Xuelin Chen , Weiyu Li , Daniel Cohen-Or , Niloy J. Mitra , Baoquan Chen

We present Non-Rigid Neural Radiance Fields (NR-NeRF), a reconstruction and novel view synthesis approach for general non-rigid dynamic scenes. Our approach takes RGB images of a dynamic scene as input (e.g., from a monocular video…

计算机视觉与模式识别 · 计算机科学 2021-08-24 Edgar Tretschk , Ayush Tewari , Vladislav Golyanik , Michael Zollhöfer , Christoph Lassner , Christian Theobalt

The challenge of dynamic view synthesis from dynamic monocular videos, i.e., synthesizing novel views for free viewpoints given a monocular video of a dynamic scene captured by a moving camera, mainly lies in accurately modeling the…

计算机视觉与模式识别 · 计算机科学 2024-08-22 Meng You , Junhui Hou

Dynamic reconstruction and spatiotemporal novel-view synthesis of non-rigidly deforming scenes recently gained increased attention. While existing work achieves impressive quality and performance on multi-view or teleporting camera setups,…

计算机视觉与模式识别 · 计算机科学 2025-03-03 Moritz Kappel , Florian Hahlbohm , Timon Scholz , Susana Castillo , Christian Theobalt , Martin Eisemann , Vladislav Golyanik , Marcus Magnor

We address the problem of novel view synthesis: given an input image, synthesizing new images of the same object or scene observed from arbitrary viewpoints. We approach this as a learning task but, critically, instead of learning to…

计算机视觉与模式识别 · 计算机科学 2017-02-14 Tinghui Zhou , Shubham Tulsiani , Weilun Sun , Jitendra Malik , Alexei A. Efros

This paper presents a new method to synthesize an image from arbitrary views and times given a collection of images of a dynamic scene. A key challenge for the novel view synthesis arises from dynamic scene reconstruction where epipolar…

计算机视觉与模式识别 · 计算机科学 2020-04-06 Jae Shin Yoon , Kihwan Kim , Orazio Gallo , Hyun Soo Park , Jan Kautz

We present a method, Neural Radiance Flow (NeRFlow),to learn a 4D spatial-temporal representation of a dynamic scene from a set of RGB images. Key to our approach is the use of a neural implicit representation that learns to capture the 3D…

计算机视觉与模式识别 · 计算机科学 2021-09-07 Yilun Du , Yinan Zhang , Hong-Xing Yu , Joshua B. Tenenbaum , Jiajun Wu

Accurate reconstruction of complex dynamic scenes from just a single viewpoint continues to be a challenging task in computer vision. Current dynamic novel view synthesis methods typically require videos from many different camera…

计算机视觉与模式识别 · 计算机科学 2024-07-08 Basile Van Hoorick , Rundi Wu , Ege Ozguroglu , Kyle Sargent , Ruoshi Liu , Pavel Tokmakov , Achal Dave , Changxi Zheng , Carl Vondrick

This paper addresses the challenge of novel-view synthesis and motion reconstruction of dynamic scenes from monocular video, which is critical for many robotic applications. Although Neural Radiance Fields (NeRF) and 3D Gaussian Splatting…

机器人学 · 计算机科学 2025-08-12 Xuesong Li , Lars Petersson , Vivien Rolland

This paper proposes a neural radiance field (NeRF) approach for novel view synthesis of dynamic scenes using forward warping. Existing methods often adopt a static NeRF to represent the canonical space, and render dynamic images at other…

计算机视觉与模式识别 · 计算机科学 2023-10-02 Xiang Guo , Jiadai Sun , Yuchao Dai , Guanying Chen , Xiaoqing Ye , Xiao Tan , Errui Ding , Yumeng Zhang , Jingdong Wang

We propose a novel approach for 3D video synthesis that is able to represent multi-view video recordings of a dynamic real-world scene in a compact, yet expressive representation that enables high-quality view synthesis and motion…

We present a novel framework for dynamic radiance field prediction given monocular video streams. Unlike previous methods that primarily focus on predicting future frames, our method goes a step further by generating explicit 3D…

计算机视觉与模式识别 · 计算机科学 2025-01-29 Di Qi , Tong Yang , Beining Wang , Xiangyu Zhang , Wenqiang Zhang

We introduce FlowIBR, a novel approach for efficient monocular novel view synthesis of dynamic scenes. Existing techniques already show impressive rendering quality but tend to focus on optimization within a single scene without leveraging…

计算机视觉与模式识别 · 计算机科学 2024-04-16 Marcel Büsching , Josef Bengtson , David Nilsson , Mårten Björkman
‹ 上一页 1 2 3 10 下一页 ›