English
Related papers

Related papers: Local Light Field Fusion: Practical View Synthesis…

200 papers

Classical light field rendering for novel view synthesis can accurately reproduce view-dependent effects such as reflection, refraction, and translucency, but requires a dense view sampling of the scene. Methods based on geometric…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Mohammed Suhail , Carlos Esteves , Leonid Sigal , Ameesh Makadia

The view synthesis problem--generating novel views of a scene from known imagery--has garnered recent attention due in part to compelling applications in virtual and augmented reality. In this paper, we explore an intriguing scenario for…

Computer Vision and Pattern Recognition · Computer Science 2018-05-25 Tinghui Zhou , Richard Tucker , John Flynn , Graham Fyffe , Noah Snavely

We explore the problem of view synthesis from a narrow baseline pair of images, and focus on generating high-quality view extrapolations with plausible disocclusions. Our method builds upon prior work in predicting a multiplane image (MPI),…

Computer Vision and Pattern Recognition · Computer Science 2019-05-02 Pratul P. Srinivasan , Richard Tucker , Jonathan T. Barron , Ravi Ramamoorthi , Ren Ng , Noah Snavely

We introduce a method for novel view synthesis given only a single wide-baseline stereo image pair. In this challenging regime, 3D scene points are regularly observed only once, requiring prior-based reconstruction of scene geometry and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yilun Du , Cameron Smith , Ayush Tewari , Vincent Sitzmann

Rendering scenes with a high-quality human face from arbitrary viewpoints is a practical and useful technique for many real-world applications. Recently, Neural Radiance Fields (NeRF), a rendering technique that uses neural networks to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Satoshi Tsutsui , Weijia Mao , Sijing Lin , Yunyi Zhu , Murong Ma , Mike Zheng Shou

We present an approach to infer a layer-structured 3D representation of a scene from a single input image. This allows us to infer not only the depth of the visible pixels, but also to capture the texture and depth for content in the scene…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Shubham Tulsiani , Richard Tucker , Noah Snavely

This paper deals with the challenging task of synthesizing novel views for in-the-wild photographs. Existing methods have shown promising results leveraging monocular depth estimation and color inpainting with layered depth representations.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Yuxuan Han , Ruicheng Wang , Jiaolong Yang

This paper presents a Progressively-connected Light Field network (ProLiF), for the novel view synthesis of complex forward-facing scenes. ProLiF encodes a 4D light field, which allows rendering a large batch of rays in one training step…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Peng Wang , Yuan Liu , Guying Lin , Jiatao Gu , Lingjie Liu , Taku Komura , Wenping Wang

The task of generating novel views of real scenes is increasingly important nowadays when AI models become able to create realistic new worlds. In many practical applications, it is important for novel view synthesis methods to stay…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Alexandra Budisteanu , Dragos Costea , Alina Marcu , Marius Leordeanu

Image view synthesis has seen great success in reconstructing photorealistic visuals, thanks to deep learning and various novel representations. The next key step in immersive virtual experiences is view synthesis of dynamic scenes.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Kai-En Lin , Guowei Yang , Lei Xiao , Feng Liu , Ravi Ramamoorthi

High angular resolution is advantageous for practical applications of light fields. In order to enhance the angular resolution of light fields, view synthesis methods can be utilized to generate dense intermediate views from sparse light…

Image and Video Processing · Electrical Eng. & Systems 2020-08-13 Yang Chen , Martin Alain , Aljosa Smolic

We propose a new method for realistic real-time novel-view synthesis (NVS) of large scenes. Existing neural rendering methods generate realistic results, but primarily work for small scale scenes (<50 square meters) and have difficulty at…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Jeffrey Yunfan Liu , Yun Chen , Ze Yang , Jingkang Wang , Sivabalan Manivasagam , Raquel Urtasun

Recent advancements in view synthesis have significantly enhanced immersive experiences across various computer graphics and multimedia applications, including telepresence and entertainment. By enabling the generation of new perspectives…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Manu Gond , Emin Zerman , Sebastian Knorr , Mårten Sjöström

We present a method to perform novel view and time synthesis of dynamic scenes, requiring only a monocular video with known camera poses as input. To do this, we introduce Neural Scene Flow Fields, a new representation that models the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Zhengqi Li , Simon Niklaus , Noah Snavely , Oliver Wang

Recent advancements in differentiable rendering and 3D reasoning have driven exciting results in novel view synthesis from a single image. Despite realistic results, methods are limited to relatively small view change. In order to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Chris Rockwell , David F. Fouhey , Justin Johnson

This paper presents a flexible representation of neural radiance fields based on multi-plane images (MPI), for high-quality view synthesis of complex scenes. MPI with Normalized Device Coordinate (NDC) parameterization is widely used in…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Yuze He , Peng Wang , Yubin Hu , Wang Zhao , Ran Yi , Yong-Jin Liu , Wenping Wang

Challenging to capture, and challenging to display on a cellphone screen, the panorama paradoxically remains both a staple and underused feature of modern mobile camera applications. In this work we address both of these challenges with a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Ilya Chugunov , Amogh Joshi , Kiran Murthy , Francois Bleibel , Felix Heide

We introduce a novel method for dynamic free-view synthesis of an ambient scenes from a monocular capture bringing a immersive quality to the viewing experience. Our method builds upon the recent advancements in 3D Gaussian Splatting (3DGS)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Meng-Li Shih , Jia-Bin Huang , Changil Kim , Rajvi Shah , Johannes Kopf , Chen Gao

We present a portable multiscopic camera system with a dedicated model for novel view and time synthesis in dynamic scenes. Our goal is to render high-quality images for a dynamic scene from any viewpoint at any time using our portable…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Tianjia Zhang , Yuen-Fui Lau , Qifeng Chen

We introduce a novel geometry-guided online video view synthesis method with enhanced view and temporal consistency. Traditional approaches achieve high-quality synthesis from dense multi-view camera setups but require significant…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Hyunho Ha , Lei Xiao , Christian Richardt , Thu Nguyen-Phuoc , Changil Kim , Min H. Kim , Douglas Lanman , Numair Khan