English
Related papers

Related papers: Quark: Real-time, High-resolution, and General Neu…

200 papers

Novel view synthesis is an important problem in computer vision and graphics. Over the years a large number of solutions have been put forward to solve the problem. However, the large-baseline novel view synthesis problem is far from being…

Computer Vision and Pattern Recognition · Computer Science 2018-05-08 Tewodros Habtegebrial , Kiran Varanasi , Christian Bailer , Didier Stricker

We propose a new method for realistic real-time novel-view synthesis (NVS) of large scenes. Existing neural rendering methods generate realistic results, but primarily work for small scale scenes (<50 square meters) and have difficulty at…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Jeffrey Yunfan Liu , Yun Chen , Ze Yang , Jingkang Wang , Sivabalan Manivasagam , Raquel Urtasun

We propose a learning-based approach for novel view synthesis for multi-camera 360$^{\circ}$ panorama capture rigs. Previous work constructs RGBD panoramas from such data, allowing for view synthesis with small amounts of translation, but…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Kai-En Lin , Zexiang Xu , Ben Mildenhall , Pratul P. Srinivasan , Yannick Hold-Geoffroy , Stephen DiVerdi , Qi Sun , Kalyan Sunkavalli , Ravi Ramamoorthi

This paper presents a new dataset for Novel View Synthesis, generated from a high-quality, animated film with stunning realism and intricate detail. Our dataset captures a variety of dynamic scenes, complete with detailed textures,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Michal Nazarczuk , Thomas Tanay , Arthur Moreau , Zhensong Zhang , Eduardo Pérez-Pellitero

This paper aims to tackle the challenge of dynamic view synthesis from multi-view videos. The key observation is that while previous grid-based methods offer consistent rendering, they fall short in capturing appearance details of a complex…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Haotong Lin , Sida Peng , Zhen Xu , Tao Xie , Xingyi He , Hujun Bao , Xiaowei Zhou

The task of novel view synthesis aims to generate unseen perspectives of an object or scene from a limited set of input images. Nevertheless, synthesizing novel views from a single image still remains a significant challenge in the realm of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Yifan Jiang , Hao Tang , Jen-Hao Rick Chang , Liangchen Song , Zhangyang Wang , Liangliang Cao

Novel view synthesis is a long-standing problem in machine learning and computer vision. Significant progress has recently been made in developing neural scene representations and rendering techniques that synthesize photorealistic images…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Alexander W. Bergman , Petr Kellnhofer , Gordon Wetzstein

Synthesizing photo-realistic images and videos is at the heart of computer graphics and has been the focus of decades of research. Traditionally, synthetic images of a scene are generated using rendering algorithms such as rasterization or…

Capturing and faithfully rendering photo-realistic humans from novel views is a fundamental problem for AR/VR applications. While prior work has shown impressive performance capture results in laboratory settings, it is non-trivial to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Phong Nguyen-Ha , Nikolaos Sarafianos , Christoph Lassner , Janne Heikkila , Tony Tung

Novel view synthesis is a challenging problem in computer vision and robotics. Different from the existing works, which need the reference images or 3D models of the scene to generate images under novel views, we propose a novel paradigm to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Xiang Guo , Bo Li , Yuchao Dai , Tongxin Zhang , Hui Deng

We present Knowledge NeRF to synthesize novel views for dynamic scenes. Reconstructing dynamic 3D scenes from few sparse views and rendering them from arbitrary perspectives is a challenging problem with applications in various domains.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Wenxiao Cai , Xinyue Lei , Xinyu He , Junming Leo Chen , Yangang Wang

In this paper the argument is made that for true novel view synthesis of objects, where the object can be synthesized from any viewpoint, an explicit 3D shape representation isdesired. Our method estimates point clouds to capture the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Hoang-An Le , Thomas Mensink , Partha Das , Theo Gevers

Neural Radiance Field (NeRF) has shown impressive results in novel view synthesis, particularly in Virtual Reality (VR) and Augmented Reality (AR), thanks to its ability to represent scenes continuously. However, when just a few input view…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Hanxin Zhu , Tianyu He , Zhibo Chen

We introduce a novel 3D generative method, Generative 3D Reconstruction (G3DR) in ImageNet, capable of generating diverse and high-quality 3D objects from single images, addressing the limitations of existing methods. At the heart of our…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Pradyumna Reddy , Ismail Elezi , Jiankang Deng

The task of generating novel views of real scenes is increasingly important nowadays when AI models become able to create realistic new worlds. In many practical applications, it is important for novel view synthesis methods to stay…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Alexandra Budisteanu , Dragos Costea , Alina Marcu , Marius Leordeanu

We present GeoNeRF, a generalizable photorealistic novel view synthesis method based on neural radiance fields. Our approach consists of two main stages: a geometry reasoner and a renderer. To render a novel view, the geometry reasoner…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Mohammad Mahdi Johari , Yann Lepoittevin , François Fleuret

We present a method for reconstructing high-quality meshes of large unbounded real-world scenes suitable for photorealistic novel view synthesis. We first optimize a hybrid neural volume-surface scene representation designed to have…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Lior Yariv , Peter Hedman , Christian Reiser , Dor Verbin , Pratul P. Srinivasan , Richard Szeliski , Jonathan T. Barron , Ben Mildenhall

3D reconstruction and view synthesis are foundational problems in computer vision, graphics, and immersive technologies such as augmented reality (AR), virtual reality (VR), and digital twins. Traditional methods rely on computationally…

Novel view synthesis techniques predominantly utilize RGB cameras, inheriting their limitations such as the need for sufficient lighting, susceptibility to motion blur, and restricted dynamic range. In contrast, event cameras are…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Sohaib Zahid , Viktor Rudnev , Eddy Ilg , Vladislav Golyanik

This paper presents a stylized novel view synthesis method. Applying state-of-the-art stylization methods to novel views frame by frame often causes jittering artifacts due to the lack of cross-view consistency. Therefore, this paper…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Thu Nguyen-Phuoc , Feng Liu , Lei Xiao