中文
相关论文

相关论文: DynIBaR: Neural Dynamic Image-Based Rendering

200 篇论文

Neural Radiance Fields (NeRF) is a technique for high quality novel view synthesis from a collection of posed input images. Like most view synthesis methods, NeRF uses tonemapped low dynamic range (LDR) as input; these images have been…

计算机视觉与模式识别 · 计算机科学 2021-11-29 Ben Mildenhall , Peter Hedman , Ricardo Martin-Brualla , Pratul Srinivasan , Jonathan T. Barron

Volumetric reconstruction of dynamic scenes is an important problem in computer vision. It is especially challenging in poor lighting and with fast motion. This is partly due to limitations of RGB cameras: To capture frames under low…

计算机视觉与模式识别 · 计算机科学 2025-07-18 Viktor Rudnev , Gereon Fox , Mohamed Elgharib , Christian Theobalt , Vladislav Golyanik

Novel view synthesis is a long-standing problem that revolves around rendering frames of scenes from novel camera viewpoints. Volumetric approaches provide a solution for modeling occlusions through the explicit 3D representation of the…

计算机视觉与模式识别 · 计算机科学 2023-03-06 Youssef Abdelkareem , Shady Shehata , Fakhri Karray

We introduce a free-viewpoint rendering method -- HumanNeRF -- that works on a given monocular video of a human performing complex body motions, e.g. a video from YouTube. Our method enables pausing the video at any frame and rendering the…

计算机视觉与模式识别 · 计算机科学 2022-06-16 Chung-Yi Weng , Brian Curless , Pratul P. Srinivasan , Jonathan T. Barron , Ira Kemelmacher-Shlizerman

In recent years, novel view synthesis has gained popularity in generating high-fidelity images. While demonstrating superior performance in the task of synthesizing novel views, the majority of these methods are still based on the…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Xiaoyan Yang , Dingbo Lu , Yang Li , Chenhui Li , Changbo Wang

Neural Radiance Fields (NeRFs) have shown great potential in modeling 3D scenes. Dynamic NeRFs extend this model by capturing time-varying elements, typically using deformation fields. The existing dynamic NeRFs employ a similar Eulerian…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Ancheng Lin , Yusheng Xiang , Jun Li , Mukesh Prasad

We introduce DyNFL, a novel neural field-based approach for high-fidelity re-simulation of LiDAR scans in dynamic driving scenes. DyNFL processes LiDAR measurements from dynamic environments, accompanied by bounding boxes of moving objects,…

计算机视觉与模式识别 · 计算机科学 2024-04-04 Hanfeng Wu , Xingxing Zuo , Stefan Leutenegger , Or Litany , Konrad Schindler , Shengyu Huang

Accurately and efficiently modeling dynamic scenes and motions is considered so challenging a task due to temporal dynamics and motion complexity. To address these challenges, we propose DynMF, a compact and efficient representation that…

计算机视觉与模式识别 · 计算机科学 2024-12-06 Agelos Kratimenos , Jiahui Lei , Kostas Daniilidis

We present a learning-based method for synthesizing novel views of complex scenes using only unstructured collections of in-the-wild photographs. We build on Neural Radiance Fields (NeRF), which uses the weights of a multilayer perceptron…

计算机视觉与模式识别 · 计算机科学 2021-01-07 Ricardo Martin-Brualla , Noha Radwan , Mehdi S. M. Sajjadi , Jonathan T. Barron , Alexey Dosovitskiy , Daniel Duckworth

With dense inputs, Neural Radiance Fields (NeRF) is able to render photo-realistic novel views under static conditions. Although the synthesis quality is excellent, existing NeRF-based methods fail to obtain moderate three-dimensional (3D)…

计算机视觉与模式识别 · 计算机科学 2024-02-21 Shu Chen , Junyao Li , Yang Zhang , Beiji Zou

Dynamic scene reconstruction for autonomous driving enables vehicles to perceive and interpret complex scene changes more precisely. Dynamic Neural Radiance Fields (NeRFs) have recently shown promising capability in scene modeling. However,…

计算机视觉与模式识别 · 计算机科学 2025-05-15 Yue Wen , Liang Song , Yijia Liu , Siting Zhu , Yanzi Miao , Lijun Han , Hesheng Wang

We introduce a new task, novel view synthesis for LiDAR sensors. While traditional model-based LiDAR simulators with style-transfer neural networks can be applied to render novel views, they fall short of producing accurate and realistic…

计算机视觉与模式识别 · 计算机科学 2023-07-17 Tang Tao , Longfei Gao , Guangrun Wang , Yixing Lao , Peng Chen , Hengshuang Zhao , Dayang Hao , Xiaodan Liang , Mathieu Salzmann , Kaicheng Yu

We present a novel method for performing flexible, 3D-aware image content manipulation while enabling high-quality novel view synthesis. While NeRF-based approaches are effective for novel view synthesis, such models memorize the radiance…

计算机视觉与模式识别 · 计算机科学 2022-04-25 Verica Lazova , Vladimir Guzov , Kyle Olszewski , Sergey Tulyakov , Gerard Pons-Moll

We present TimeNeRF, a generalizable neural rendering approach for rendering novel views at arbitrary viewpoints and at arbitrary times, even with few input views. For real-world applications, it is expensive to collect multiple views and…

计算机视觉与模式识别 · 计算机科学 2025-07-21 Hsiang-Hui Hung , Huu-Phu Do , Yung-Hui Li , Ching-Chun Huang

Recent approaches to render photorealistic views from a limited set of photographs have pushed the boundaries of our interactions with pictures of static scenes. The ability to recreate moments, that is, time-varying sequences, is perhaps…

计算机视觉与模式识别 · 计算机科学 2021-05-14 Chaoyang Wang , Ben Eckart , Simon Lucey , Orazio Gallo

Synthesizing novel views from monocular videos of dynamic scenes remains a challenging problem. Scene-specific methods that optimize 4D representations with explicit motion priors often break down in highly dynamic regions where multi-view…

This paper introduces a novel representation of volumetric videos for real-time view synthesis of dynamic scenes. Recent advances in neural scene representations demonstrate their remarkable capability to model and render complex static…

计算机视觉与模式识别 · 计算机科学 2023-04-14 Sida Peng , Yunzhi Yan , Qing Shuai , Hujun Bao , Xiaowei Zhou

Neural Radiance Fields (NeRF) have been proposed for photorealistic novel view rendering. However, it requires many different views of one scene for training. Moreover, it has poor generalizations to new scenes and requires retraining or…

计算机视觉与模式识别 · 计算机科学 2023-05-12 Yurui Chen , Chun Gu , Feihu Zhang , Li Zhang

The reconstruction and novel view synthesis of dynamic scenes recently gained increased attention. As reconstruction from large-scale multi-view data involves immense memory and computational requirements, recent benchmark datasets provide…

计算机视觉与模式识别 · 计算机科学 2023-11-14 Moritz Kappel , Vladislav Golyanik , Susana Castillo , Christian Theobalt , Marcus Magnor

Asynchronously operating event cameras find many applications due to their high dynamic range, vanishingly low motion blur, low latency and low data bandwidth. The field saw remarkable progress during the last few years, and existing…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Viktor Rudnev , Mohamed Elgharib , Christian Theobalt , Vladislav Golyanik