English
Related papers

Related papers: Temporal-MPI: Enabling Multi-Plane Images for Dyna…

200 papers

With the rapid development of stereoscopic display technologies, especially glasses-free 3D screens, and virtual reality devices, stereoscopic conversion has become an important task to address the lack of high-quality stereoscopic image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Shanding Diao , Yang Zhao , Yuan Chen , Zhao Zhang , Wei Jia , Ronggang Wang

In this paper we address the problem of view synthesis from large baseline light fields, by turning a sparse set of input views into a Multi-plane Image (MPI). Because available datasets are scarce, we propose a lightweight network that…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Tomás Völker , Guillaume Boisson , Bertrand Chupeau

We present a new method for lightweight novel-view synthesis that generalizes to an arbitrary forward-facing scene. Recent approaches are computationally expensive, require per-scene optimization, or produce a memory-expensive…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Pavel Solovev , Taras Khakhulin , Denis Korzhenkov

Structure from motion (SfM) enables us to reconstruct a scene via casual capture from cameras at different viewpoints, and novel view synthesis (NVS) allows us to render a captured scene from a new viewpoint. Both are hard with casual…

A recent strand of work in view synthesis uses deep learning to generate multiplane images (a camera-centric, layered 3D representation) given two or more input images at known viewpoints. We apply this representation to single-view view…

Computer Vision and Pattern Recognition · Computer Science 2020-04-24 Richard Tucker , Noah Snavely

We study the problem of novel view synthesis from sparse source observations of a scene comprised of 3D objects. We propose a simple yet effective approach that is neither continuous nor implicit, challenging recent trends on view…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Pengsheng Guo , Miguel Angel Bautista , Alex Colburn , Liang Yang , Daniel Ulbricht , Joshua M. Susskind , Qi Shan

Reconstructing general dynamic scenes is important for many computer vision and graphics applications. Recent works represent the dynamic scene with neural radiance fields for photorealistic view synthesis, while their surface geometry is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Decai Chen , Haofei Lu , Ingo Feldmann , Oliver Schreer , Peter Eisert

We introduce a novel method for dynamic free-view synthesis of an ambient scenes from a monocular capture bringing a immersive quality to the viewing experience. Our method builds upon the recent advancements in 3D Gaussian Splatting (3DGS)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Meng-Li Shih , Jia-Bin Huang , Changil Kim , Rajvi Shah , Johannes Kopf , Chen Gao

The reconstruction and novel view synthesis of dynamic scenes recently gained increased attention. As reconstruction from large-scale multi-view data involves immense memory and computational requirements, recent benchmark datasets provide…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Moritz Kappel , Vladislav Golyanik , Susana Castillo , Christian Theobalt , Marcus Magnor

Due to the complex and highly dynamic motions in the real world, synthesizing dynamic videos from multi-view inputs for arbitrary viewpoints is challenging. Previous works based on neural radiance field or 3D Gaussian splatting are limited…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Jiahao Wu , Rui Peng , Jianbo Jiao , Jiayu Yang , Luyang Tang , Kaiqiang Xiong , Jie Liang , Jinbo Yan , Runling Liu , Ronggang Wang

We explore novel-view synthesis for dynamic scenes from monocular videos. Prior approaches rely on costly test-time optimization of 4D representations or do not preserve scene geometry when trained in a feed-forward manner. Our approach is…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Kaihua Chen , Tarasha Khurana , Deva Ramanan

High-quality global illumination (GI) in real-time rendering is commonly achieved using precomputed lighting techniques, with lightmap as the standard choice. To support GI for static objects in dynamic lighting environments, multiple…

Graphics · Computer Science 2026-05-13 Jianhui Wu , Jian Zhou , Zhi Zhou , Zhangjin Huang , Chao Li

Semantic scene segmentation has primarily been addressed by forming representations of single images both with supervised and unsupervised methods. The problem of semantic segmentation in dynamic scenes has begun to recently receive…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Li Ding , Jack Terwilliger , Rini Sherony , Bryan Reimer , Lex Fridman

The task of video inpainting detection is to expose the pixel-level inpainted regions within a video sequence. Existing methods usually focus on leveraging spatial and temporal inconsistencies. However, these methods typically employ fixed…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Ying Zhang , Yuezun Li , Bo Peng , Jiaran Zhou , Huiyu Zhou , Junyu Dong

Dynamic novel view synthesis aims to capture the temporal evolution of visual content within videos. Existing methods struggle to distinguishing between motion and structure, particularly in scenarios where camera poses are either unknown…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Chaoyang Wang , Peiye Zhuang , Aliaksandr Siarohin , Junli Cao , Guocheng Qian , Hsin-Ying Lee , Sergey Tulyakov

We present an algorithm for generating novel views at arbitrary viewpoints and any input time step given a monocular video of a dynamic scene. Our work builds upon recent advances in neural implicit representation and uses continuous and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Chen Gao , Ayush Saraf , Johannes Kopf , Jia-Bin Huang

Novel view synthesis for dynamic scenes is one of the spotlights in computer vision. The key to efficient dynamic view synthesis is to find a compact representation to store the information across time. Though existing methods achieve fast…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Zhenhuan Liu , Shuai Liu , Jie Yang , Wei Liu

In this work, we aim to reconstruct a time-varying 3D model, capable of rendering photo-realistic renderings with independent control of viewpoint, illumination, and time, from Internet photos of large-scale landmarks. The core challenges…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Haotong Lin , Qianqian Wang , Ruojin Cai , Sida Peng , Hadar Averbuch-Elor , Xiaowei Zhou , Noah Snavely

Generating static novel views from an already captured image is a hard task in computer vision and graphics, in particular when the single input image has dynamic parts such as persons or moving objects. In this paper, we tackle this…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Gustavo Sutter P. Carvalho , Diogo C. Luvizon , Antonio Joia Neto , Andre G. C. Pacheco , Otavio A. B. Penatti

We introduce an improved solution to the neural image-based rendering problem in computer vision. Given a set of images taken from a freely moving camera at train time, the proposed approach could synthesize a realistic image of the scene…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Nishant Jain , Suryansh Kumar , Luc Van Gool