English
Related papers

Related papers: UniView: Enhancing Novel View Synthesis From A Sin…

200 papers

We introduce MultiDiff, a novel approach for consistent novel view synthesis of scenes from a single RGB image. The task of synthesizing novel views from a single reference image is highly ill-posed by nature, as there exist multiple,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Norman Müller , Katja Schwarz , Barbara Roessle , Lorenzo Porzi , Samuel Rota Bulò , Matthias Nießner , Peter Kontschieder

View synthesis aims to generate novel views from one or more given source views. Although existing methods have achieved promising performance, they usually require paired views of different poses to learn a pixel transformation. This paper…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Bingzheng Liu , Jianjun Lei , Bo Peng , Chuanbo Yu , Wanqing Li , Nam Ling

Researches in novel viewpoint synthesis majorly focus on interpolation from multi-view input images. In this paper, we focus on a more challenging and ill-posed problem that is to synthesize novel viewpoints from one single input image. To…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Xiaodong Cun , Feng Xu , Chi-Man Pun , Hao Gao

Taking an image of an object is at its core a lossy process. The rich information about the three-dimensional structure of the world is flattened to an image plane and decisions such as viewpoint and camera parameters are final and not…

Computer Vision and Pattern Recognition · Computer Science 2016-08-16 Konstantinos Rematas , Chuong Nguyen , Tobias Ritschel , Mario Fritz , Tinne Tuytelaars

Synthesizing novel views from a single view image is a highly ill-posed problem. We discover an effective solution to reduce the learning ambiguity by expanding the single-view view synthesis problem to a multi-view setting. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Yang Zhou , Hanjie Wu , Wenxi Liu , Zheng Xiong , Jing Qin , Shengfeng He

Novel-view synthesis through diffusion models has demonstrated remarkable potential for generating diverse and high-quality images. Yet, the independent process of image generation in these prevailing methods leads to challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Xianghui Yang , Yan Zuo , Sameera Ramasinghe , Loris Bazzani , Gil Avraham , Anton van den Hengel

Generating novel views of an object from a single image is a challenging task. It requires an understanding of the underlying 3D structure of the object from an image and rendering high-quality, spatially consistent new views. While recent…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Jeong-gi Kwak , Erqun Dong , Yuhe Jin , Hanseok Ko , Shweta Mahajan , Kwang Moo Yi

Novel view synthesis from a single image has recently achieved remarkable results, although the requirement of some form of 3D, pose, or multi-view supervision at training time limits the deployment in real scenarios. This work aims at…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Pierluigi Zama Ramirez , Diego Martin Arroyo , Alessio Tonioni , Federico Tombari

Single-image novel view synthesis is a challenging and ongoing problem that aims to generate an infinite number of consistent views from a single input image. Although significant efforts have been made to advance the quality of generated…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Guo Pu , Peng-Shuai Wang , Zhouhui Lian

Existing view synthesis methods mainly focus on the perspective images and have shown promising results. However, due to the limited field-of-view of the pinhole camera, the performance quickly degrades when large camera movements are…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Jiale Xu , Jia Zheng , Yanyu Xu , Rui Tang , Shenghua Gao

We introduce a method for novel view synthesis given only a single wide-baseline stereo image pair. In this challenging regime, 3D scene points are regularly observed only once, requiring prior-based reconstruction of scene geometry and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yilun Du , Cameron Smith , Ayush Tewari , Vincent Sitzmann

In this paper, we tackle the problem of generating a novel image from an arbitrary viewpoint given a single frame as input. While existing methods operating in this setup aim at predicting the target view depth map to guide the synthesis,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Giovanni Minelli , Matteo Poggi , Samuele Salti

Large diffusion models demonstrate remarkable zero-shot capabilities in novel view synthesis from a single image. However, these models often face challenges in maintaining consistency across novel and reference views. A crucial factor…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Botao Ye , Sifei Liu , Xueting Li , Marc Pollefeys , Ming-Hsuan Yang

Novel view synthesis aims to generate new view images of a given view image collection. Recent attempts address this problem relying on 3D geometry priors (e.g., shapes, sizes, and positions) learned from multi-view images. However, such…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Zixiong Huang , Qi Chen , Libo Sun , Yifan Yang , Naizhou Wang , Mingkui Tan , Qi Wu

We address the problem of novel view synthesis: given an input image, synthesizing new images of the same object or scene observed from arbitrary viewpoints. We approach this as a learning task but, critically, instead of learning to…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Tinghui Zhou , Shubham Tulsiani , Weilun Sun , Jitendra Malik , Alexei A. Efros

A recent strand of work in view synthesis uses deep learning to generate multiplane images (a camera-centric, layered 3D representation) given two or more input images at known viewpoints. We apply this representation to single-view view…

Computer Vision and Pattern Recognition · Computer Science 2020-04-24 Richard Tucker , Noah Snavely

The view synthesis problem--generating novel views of a scene from known imagery--has garnered recent attention due in part to compelling applications in virtual and augmented reality. In this paper, we explore an intriguing scenario for…

Computer Vision and Pattern Recognition · Computer Science 2018-05-25 Tinghui Zhou , Richard Tucker , John Flynn , Graham Fyffe , Noah Snavely

This paper presents a new method to synthesize an image from arbitrary views and times given a collection of images of a dynamic scene. A key challenge for the novel view synthesis arises from dynamic scene reconstruction where epipolar…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Jae Shin Yoon , Kihwan Kim , Orazio Gallo , Hyun Soo Park , Jan Kautz

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

The task of novel view synthesis aims to generate unseen perspectives of an object or scene from a limited set of input images. Nevertheless, synthesizing novel views from a single image still remains a significant challenge in the realm of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Yifan Jiang , Hao Tang , Jen-Hao Rick Chang , Liangchen Song , Zhangyang Wang , Liangliang Cao
‹ Prev 1 2 3 10 Next ›