English
Related papers

Related papers: Neural Pixel Composition: 3D-4D View Synthesis fro…

200 papers

Synthesizing a densely sampled light field from a single image is highly beneficial for many applications. The conventional method reconstructs a depth map and relies on physical-based rendering and a secondary network to improve the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-01 Andre Ivan , Williem , In Kyu Park

Dense and accurate 3D mapping from a monocular sequence is a key technology for several applications and still an open research area. This paper leverages recent results on single-view CNN-based depth estimation and fuses them with…

Computer Vision and Pattern Recognition · Computer Science 2017-06-28 José M. Fácil , Alejo Concha , Luis Montesano , Javier Civera

We present a simple yet effective general-purpose framework for modeling 3D shapes by leveraging recent advances in 2D image generation using CNNs. Using just a single depth image of the object, we can output a dense multi-view depth map…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Kamal Gupta , Susmija Jabbireddy , Ketul Shah , Abhinav Shrivastava , Matthias Zwicker

Neural Radiance Fields (NeRF) have garnered remarkable success in novel view synthesis. Nonetheless, the task of generating high-quality images for novel views persists as a critical challenge. While the existing efforts have exhibited…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Linsheng Chen , Guangrun Wang , Liuchun Yuan , Keze Wang , Ken Deng , Philip H. S. Torr

Recent advancements in generative models have significantly improved novel view synthesis (NVS) from multi-view data. However, existing methods depend on external multi-view alignment processes, such as explicit pose estimation or…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Lingen Li , Zhaoyang Zhang , Yaowei Li , Jiale Xu , Wenbo Hu , Xiaoyu Li , Weihao Cheng , Jinwei Gu , Tianfan Xue , Ying Shan

Dense image alignment from RGB-D images remains a critical issue for real-world applications, especially under challenging lighting conditions and in a wide baseline setting. In this paper, we propose a new framework to learn a pixel-wise…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Binbin Xu , Andrew J. Davison , Stefan Leutenegger

Text-to-3D form plays a crucial role in creating editable 3D scenes for AR/VR. Recent advances have shown promise in merging neural radiance fields (NeRFs) with pre-trained diffusion models for text-to-3D object generation. However, one…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Haotian Bai , Yuanhuiyi Lyu , Lutao Jiang , Sijia Li , Haonan Lu , Xiaodong Lin , Lin Wang

Object viewpoint estimation from 2D images is an essential task in computer vision. However, two issues hinder its progress: scarcity of training data with viewpoint annotations, and a lack of powerful features. Inspired by the growing…

Computer Vision and Pattern Recognition · Computer Science 2015-05-22 Hao Su , Charles R. Qi , Yangyan Li , Leonidas Guibas

Novel-view synthesis plays a crucial role in computer vision with applications in 3D reconstruction, mixed reality, and robotics. Recent approaches, such as 3D Gaussian Splatting (3DGS), have emerged as state-of-the-art solutions, offering…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Ankit Dhiman , Tao Lu , R Srinath , Emre Arslan , Angela Xing , Yuanbo Xiangli , R Venkatesh Babu , Srinath Sridhar

In the last few years, several works have tackled the problem of novel view synthesis from stereo images or even from a single picture. However, previous methods are computationally expensive, specially for high-resolution images. In this…

Traditional photography composition approaches are dominated by 2D cropping-based methods. However, these methods fall short when scenes contain poorly arranged subjects. Professional photographers often employ perspective adjustment as a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Lujian Yao , Siming Zheng , Xinbin Yuan , Zhuoxuan Cai , Pu Wu , Jinwei Chen , Bo Li , Peng-Tao Jiang

Neural view synthesis (NVS) is one of the most successful techniques for synthesizing free viewpoint videos, capable of achieving high fidelity from only a sparse set of captured images. This success has led to many variants of the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Hanxue Liang , Tianhao Wu , Param Hanji , Francesco Banterle , Hongyun Gao , Rafal Mantiuk , Cengiz Oztireli

We present a method that synthesizes novel views of complex scenes by interpolating a sparse set of nearby views. The core of our method is a network architecture that includes a multilayer perceptron and a ray transformer that estimates…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Qianqian Wang , Zhicheng Wang , Kyle Genova , Pratul Srinivasan , Howard Zhou , Jonathan T. Barron , Ricardo Martin-Brualla , Noah Snavely , Thomas Funkhouser

Neural implicit representations have revolutionized dense multi-view surface reconstruction, yet their performance significantly diminishes with sparse input views. A few pioneering works have sought to tackle the challenge of sparse-view…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Sheng Ye , Yuze He , Matthieu Lin , Jenny Sheng , Ruoyu Fan , Yiheng Han , Yubin Hu , Ran Yi , Yu-Hui Wen , Yong-Jin Liu , Wenping Wang

We present an approach that learns to synthesize high-quality, novel views of 3D objects or scenes, while providing fine-grained and precise control over the 6-DOF viewpoint. The approach is self-supervised and only requires 2D images and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Xu Chen , Jie Song , Otmar Hilliges

An important problem for both graphics and vision is to synthesize novel views of a 3D object from a single image. This is particularly challenging due to the partial observability inherent in projecting a 3D object onto the image space,…

Machine Learning · Computer Science 2016-01-06 Jimei Yang , Scott Reed , Ming-Hsuan Yang , Honglak Lee

With dense inputs, Neural Radiance Fields (NeRF) is able to render photo-realistic novel views under static conditions. Although the synthesis quality is excellent, existing NeRF-based methods fail to obtain moderate three-dimensional (3D)…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Shu Chen , Junyao Li , Yang Zhang , Beiji Zou

Image compositing is a method used to generate realistic yet fake imagery by inserting contents from one image to another. Previous work in compositing has focused on improving appearance compatibility of a user selected foreground segment…

Graphics · Computer Science 2017-12-05 Fuwen Tan , Crispin Bernier , Benjamin Cohen , Vicente Ordonez , Connelly Barnes

Novel view synthesis is a long-standing problem in machine learning and computer vision. Significant progress has recently been made in developing neural scene representations and rendering techniques that synthesize photorealistic images…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Alexander W. Bergman , Petr Kellnhofer , Gordon Wetzstein

Novel view synthesis aims to synthesize new images from different viewpoints of given images. Most of previous works focus on generating novel views of certain objects with a fixed background. However, for some applications, such as virtual…

Computer Vision and Pattern Recognition · Computer Science 2018-02-21 Xiaochuan Yin , Henglai Wei , Penghong lin , Xiangwei Wang , Qijun Chen