English
Related papers

Related papers: Real-Time Position-Aware View Synthesis from Singl…

200 papers

Researches in novel viewpoint synthesis majorly focus on interpolation from multi-view input images. In this paper, we focus on a more challenging and ill-posed problem that is to synthesize novel viewpoints from one single input image. To…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Xiaodong Cun , Feng Xu , Chi-Man Pun , Hao Gao

View synthesis aims to generate novel views from one or more given source views. Although existing methods have achieved promising performance, they usually require paired views of different poses to learn a pixel transformation. This paper…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Bingzheng Liu , Jianjun Lei , Bo Peng , Chuanbo Yu , Wanqing Li , Nam Ling

A recent strand of work in view synthesis uses deep learning to generate multiplane images (a camera-centric, layered 3D representation) given two or more input images at known viewpoints. We apply this representation to single-view view…

Computer Vision and Pattern Recognition · Computer Science 2020-04-24 Richard Tucker , Noah Snavely

This paper tackles the problem of novel view synthesis from a single image. In particular, we target real-world scenes with rich geometric structure, a challenging task due to the large appearance variations of such scenes and the lack of…

Computer Vision and Pattern Recognition · Computer Science 2018-04-18 Miaomiao Liu , Xuming He , Mathieu Salzmann

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

We present Worldsheet, a method for novel view synthesis using just a single RGB image as input. The main insight is that simply shrink-wrapping a planar mesh sheet onto the input image, consistent with the learned intermediate depth,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Ronghang Hu , Nikhila Ravi , Alexander C. Berg , Deepak Pathak

Novel view synthesis from a single image has recently achieved remarkable results, although the requirement of some form of 3D, pose, or multi-view supervision at training time limits the deployment in real scenarios. This work aims at…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Pierluigi Zama Ramirez , Diego Martin Arroyo , Alessio Tonioni , Federico Tombari

Content creation, central to applications such as virtual reality, can be a tedious and time-consuming. Recent image synthesis methods simplify this task by offering tools to generate new views from as little as a single input image, or by…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Tewodros Habtegebrial , Varun Jampani , Orazio Gallo , Didier Stricker

Novel view synthesis is a long-standing problem. In this work, we consider a variant of the problem where we are given only a few context views sparsely covering a scene or an object. The goal is to predict novel viewpoints in the scene,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Jonáš Kulhánek , Erik Derner , Torsten Sattler , Robert Babuška

Novel view synthesis from a single image has recently attracted a lot of attention, and it has been primarily advanced by 3D deep learning and rendering techniques. However, most work is still limited by synthesizing new views within…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Xuanchi Ren , Xiaolong Wang

We present a method for novel view synthesis from input images that are freely distributed around a scene. Our method does not rely on a regular arrangement of input views, can synthesize images for free camera movement through the scene,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Gernot Riegler , Vladlen Koltun

The metaverse is expected to provide immersive entertainment, education, and business applications. However, virtual reality (VR) transmission over wireless networks is data- and computation-intensive, making it critical to introduce novel…

Image and Video Processing · Electrical Eng. & Systems 2024-01-03 Yiyu Guo , Zhijin Qin , Xiaoming Tao , Geoffrey Ye Li

Existing image-based rendering methods usually adopt depth-based image warping operation to synthesize novel views. In this paper, we reason the essential limitations of the traditional warping operation to be the limited neighborhood and…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Mantang Guo , Junhui Hou , Jing Jin , Hui Liu , Huanqiang Zeng , Jiwen Lu

This paper studies category-level object pose estimation based on a single monocular image. Recent advances in pose-aware generative models have paved the way for addressing this challenging task using analysis-by-synthesis. The idea is to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Jiaxin Guo , Fangxun Zhong , Rong Xiong , Yunhui Liu , Yue Wang , Yiyi Liao

This paper presents a learning-based approach to synthesize the view from an arbitrary camera position given a sparse set of images. A key challenge for this novel view synthesis arises from the reconstruction process, when the views from…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Nan Meng , Kai Li , Jianzhuang Liu , Edmund Y. Lam

We introduce a method for novel view synthesis given only a single wide-baseline stereo image pair. In this challenging regime, 3D scene points are regularly observed only once, requiring prior-based reconstruction of scene geometry and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yilun Du , Cameron Smith , Ayush Tewari , Vincent Sitzmann

Synthesizing a novel view from a single input image is a challenging task. Traditionally, this task was approached by estimating scene depth, warping, and inpainting, with machine learning models enabling parts of the pipeline. More…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Noam Elata , Bahjat Kawar , Yaron Ostrovsky-Berman , Miriam Farber , Ron Sokolovsky

Capturing and rendering novel views of complex real-world scenes is a long-standing problem in computer graphics and vision, with applications in augmented and virtual reality, immersive experiences and 3D photography. The advent of deep…

Graphics · Computer Science 2024-08-09 Ravi Ramamoorthi

Synthesizing novel views from a single view image is a highly ill-posed problem. We discover an effective solution to reduce the learning ambiguity by expanding the single-view view synthesis problem to a multi-view setting. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Yang Zhou , Hanjie Wu , Wenxi Liu , Zheng Xiong , Jing Qin , Shengfeng He

We study the problem of novel view synthesis of objects from a single image. Existing methods have demonstrated the potential in single-view view synthesis. However, they still fail to recover the fine appearance details, especially in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Xingyi Li , Chaoyi Hong , Yiran Wang , Zhiguo Cao , Ke Xian , Guosheng Lin
‹ Prev 1 2 3 10 Next ›