English
Related papers

Related papers: MMPI: a Flexible Radiance Field Representation by …

200 papers

Novel view synthesis is a long-standing problem that revolves around rendering frames of scenes from novel camera viewpoints. Volumetric approaches provide a solution for modeling occlusions through the explicit 3D representation of the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Youssef Abdelkareem , Shady Shehata , Fakhri Karray

Novel view synthesis of satellite images holds a wide range of practical applications. While recent advances in the Neural Radiance Field have predominantly targeted pin-hole cameras, and models for satellite cameras often demand sufficient…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Tongtong Zhang , Yuanxiang Li

Novel view synthesis of remote sensing scenes is of great significance for scene visualization, human-computer interaction, and various downstream applications. Despite the recent advances in computer graphics and photogrammetry technology,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Yongchang Wu , Zhengxia Zou , Zhenwei Shi

Novel view synthesis of static scenes has achieved remarkable advancements in producing photo-realistic results. However, key challenges remain for immersive rendering of dynamic scenes. One of the seminal image-based rendering method, the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Wenpeng Xing , Jie Chen

We propose pose-guided multiplane image (MPI) synthesis which can render an animatable character in real scenes with photorealistic quality. We use a portable camera rig to capture the multi-view images along with the driving signal for the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Hao Ouyang , Bo Zhang , Pan Zhang , Hao Yang , Jiaolong Yang , Dong Chen , Qifeng Chen , Fang Wen

Recently, learning methods have been designed to create Multiplane Images (MPIs) for view synthesis. While MPIs are extremely powerful and facilitate high quality renderings, a great amount of memory is required, making them impractical for…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Julia Navarro , Neus Sabater

While current multi-frame restoration methods combine information from multiple input images using 2D alignment techniques, recent advances in novel view synthesis are paving the way for a new paradigm relying on volumetric scene…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Thomas Tanay , Aleš Leonardis , Matteo Maggioni

The task of synthesizing novel views from a single image has useful applications in virtual reality and mobile computing, and a number of approaches to the problem have been proposed in recent years. A Multiplane Image (MPI) estimates the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Numair Khan , Douglas Lanman , Lei Xiao

Neural Radiance Field (NeRF) is a framework that represents a 3D scene in the weights of a fully connected neural network, known as the Multi-Layer Perception(MLP). The method was introduced for the task of novel view synthesis and is able…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Mohamed Debbagh

Recent novel view synthesis methods obtain promising results for relatively small scenes, e.g., indoor environments and scenes with a few objects, but tend to fail for unbounded outdoor scenes with a single image as input. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Xiaoyu Zhou , Zhiwei Lin , Xiaojun Shan , Yongtao Wang , Deqing Sun , Ming-Hsuan Yang

We explore the problem of view synthesis from a narrow baseline pair of images, and focus on generating high-quality view extrapolations with plausible disocclusions. Our method builds upon prior work in predicting a multiplane image (MPI),…

Computer Vision and Pattern Recognition · Computer Science 2019-05-02 Pratul P. Srinivasan , Richard Tucker , Jonathan T. Barron , Ravi Ramamoorthi , Ren Ng , Noah Snavely

Neural Radiance Field (NeRF) has shown impressive results in novel view synthesis, particularly in Virtual Reality (VR) and Augmented Reality (AR), thanks to its ability to represent scenes continuously. However, when just a few input view…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Hanxin Zhu , Tianyu He , Zhibo Chen

Existing Multi-Plane Image (MPI) based view-synthesis methods generate an MPI aligned with the input view using a fixed number of planes in one forward pass. These methods produce fast, high-quality rendering of novel views, but rely on…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Sushobhan Ghosh , Zhaoyang Lv , Nathan Matsuda , Lei Xiao , Andrew Berkovich , Oliver Cossairt

Neural Radiance Fields (NeRF) use multi-view images for 3D scene representation, demonstrating remarkable performance. As one of the primary sources of multi-view images, multi-camera systems encounter challenges such as varying intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Yu Gao , Lutong Su , Hao Liang , Yufeng Yue , Yi Yang , Mengyin Fu

We present a method that achieves state-of-the-art results for synthesizing novel views of complex scenes by optimizing an underlying continuous volumetric scene function using a sparse set of input views. Our algorithm represents a scene…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Ben Mildenhall , Pratul P. Srinivasan , Matthew Tancik , Jonathan T. Barron , Ravi Ramamoorthi , Ren Ng

Neural radiance fields (NeRFs) enable novel view synthesis with unprecedented visual quality. However, to render photorealistic images, NeRFs require hundreds of deep multilayer perceptron (MLP) evaluations - for each pixel. This is…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Ziyu Wan , Christian Richardt , Aljaž Božič , Chao Li , Vijay Rengarajan , Seonghyeon Nam , Xiaoyu Xiang , Tuotuo Li , Bo Zhu , Rakesh Ranjan , Jing Liao

This paper deals with the challenging task of synthesizing novel views for in-the-wild photographs. Existing methods have shown promising results leveraging monocular depth estimation and color inpainting with layered depth representations.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Yuxuan Han , Ruicheng Wang , Jiaolong Yang

The Multiplane Image (MPI), containing a set of fronto-parallel RGBA layers, is an effective and efficient representation for view synthesis from sparse inputs. Yet, its fixed structure limits the performance, especially for surfaces imaged…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Mingfang Zhang , Jinglu Wang , Xiao Li , Yifei Huang , Yoichi Sato , Yan Lu

Adopting Neural Radiance Fields (NeRF) to long-duration dynamic sequences has been challenging. Existing methods struggle to balance between quality and storage size and encounter difficulties with complex scene changes such as topological…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Minye Wu , Tinne Tuytelaars

Neural Radiance Fields (NeRF) achieve impressive view synthesis results for a variety of capture settings, including 360 capture of bounded scenes and forward-facing capture of bounded and unbounded scenes. NeRF fits multi-layer perceptrons…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Kai Zhang , Gernot Riegler , Noah Snavely , Vladlen Koltun
‹ Prev 1 2 3 10 Next ›