中文
相关论文

相关论文: Single-View View Synthesis in the Wild with Learne…

200 篇论文

This paper studies single-image depth perception in the wild, i.e., recovering depth from a single image taken in unconstrained settings. We introduce a new dataset "Depth in the Wild" consisting of images in the wild annotated with…

计算机视觉与模式识别 · 计算机科学 2017-01-09 Weifeng Chen , Zhao Fu , Dawei Yang , Jia Deng

Many popular tourist landmarks are captured in a multitude of online, public photos. These photos represent a sparse and unstructured sampling of the plenoptic function for a particular scene. In this paper,we present a new approach to…

计算机视觉与模式识别 · 计算机科学 2020-07-31 Zhengqi Li , Wenqi Xian , Abe Davis , Noah Snavely

Single-view depth prediction is a fundamental problem in computer vision. Recently, deep learning methods have led to significant progress, but such methods are limited by the available training data. Current datasets based on 3D sensors…

计算机视觉与模式识别 · 计算机科学 2018-11-29 Zhengqi Li , Noah Snavely

We present NeX, a new approach to novel view synthesis based on enhancements of multiplane image (MPI) that can reproduce next-level view-dependent effects -- in real time. Unlike traditional MPI that uses a set of simple RGB$\alpha$…

计算机视觉与模式识别 · 计算机科学 2021-04-13 Suttisak Wizadwongsa , Pakkapon Phongthawee , Jiraphon Yenphraphai , Supasorn Suwajanakorn

We present a practical and robust deep learning solution for capturing and rendering novel views of complex real world scenes for virtual exploration. Previous approaches either require intractably dense view sampling or provide little to…

计算机视觉与模式识别 · 计算机科学 2019-05-03 Ben Mildenhall , Pratul P. Srinivasan , Rodrigo Ortiz-Cayon , Nima Khademi Kalantari , Ravi Ramamoorthi , Ren Ng , Abhishek Kar

Novel view synthesis of satellite images holds a wide range of practical applications. While recent advances in the Neural Radiance Field have predominantly targeted pin-hole cameras, and models for satellite cameras often demand sufficient…

计算机视觉与模式识别 · 计算机科学 2023-10-12 Tongtong Zhang , Yuanxiang Li

Inferring a meaningful geometric scene representation from a single image is a fundamental problem in computer vision. Approaches based on traditional depth map prediction can only reason about areas that are visible in the image.…

计算机视觉与模式识别 · 计算机科学 2023-04-20 Felix Wimbauer , Nan Yang , Christian Rupprecht , Daniel Cremers

We introduce an approach to enhance the novel view synthesis from images taken from a freely moving camera. The introduced approach focuses on outdoor scenes where recovering accurate geometric scaffold and camera pose is challenging,…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Nishant Jain , Suryansh Kumar , Luc Van Gool

Novel view synthesis from an in-the-wild video is difficult due to challenges like scene dynamics and lack of parallax. While existing methods have shown promising results with implicit neural radiance fields, they are slow to train and…

计算机视觉与模式识别 · 计算机科学 2024-07-22 Yao-Chih Lee , Zhoutong Zhang , Kevin Blackburn-Matzen , Simon Niklaus , Jianming Zhang , Jia-Bin Huang , Feng Liu

Monocular depth estimation aims at estimating a pixelwise depth map for a single image, which has wide applications in scene understanding and autonomous driving. Existing supervised and unsupervised methods face great challenges.…

计算机视觉与模式识别 · 计算机科学 2018-08-21 Xiaoyang Guo , Hongsheng Li , Shuai Yi , Jimmy Ren , Xiaogang Wang

We propose a novel approach for embedding novel views in a single JPEG image while preserving the perceptual fidelity of the modified JPEG image and the restored novel views. We adopt the popular novel view synthesis representation of…

计算机视觉与模式识别 · 计算机科学 2021-08-31 Yue Wu , Guotao Meng , Qifeng Chen

We present an approach that learns to synthesize high-quality, novel views of 3D objects or scenes, while providing fine-grained and precise control over the 6-DOF viewpoint. The approach is self-supervised and only requires 2D images and…

计算机视觉与模式识别 · 计算机科学 2019-09-10 Xu Chen , Jie Song , Otmar Hilliges

Synthesizing a densely sampled light field from a single image is highly beneficial for many applications. The conventional method reconstructs a depth map and relies on physical-based rendering and a secondary network to improve the…

计算机视觉与模式识别 · 计算机科学 2019-04-01 Andre Ivan , Williem , In Kyu Park

Most 3D reconstruction methods may only recover scene properties up to a global scale ambiguity. We present a novel approach to single view metrology that can recover the absolute scale of a scene represented by 3D heights of objects or…

计算机视觉与模式识别 · 计算机科学 2021-02-24 Rui Zhu , Xingyi Yang , Yannick Hold-Geoffroy , Federico Perazzi , Jonathan Eisenmann , Kalyan Sunkavalli , Manmohan Chandraker

We present a new method for lightweight novel-view synthesis that generalizes to an arbitrary forward-facing scene. Recent approaches are computationally expensive, require per-scene optimization, or produce a memory-expensive…

计算机视觉与模式识别 · 计算机科学 2022-10-05 Pavel Solovev , Taras Khakhulin , Denis Korzhenkov

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

计算机视觉与模式识别 · 计算机科学 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

We present an approach to infer a layer-structured 3D representation of a scene from a single input image. This allows us to infer not only the depth of the visible pixels, but also to capture the texture and depth for content in the scene…

计算机视觉与模式识别 · 计算机科学 2018-07-27 Shubham Tulsiani , Richard Tucker , Noah Snavely

This paper presents a learning-based approach to synthesize the view from an arbitrary camera position given a sparse set of images. A key challenge for this novel view synthesis arises from the reconstruction process, when the views from…

计算机视觉与模式识别 · 计算机科学 2021-04-06 Nan Meng , Kai Li , Jianzhuang Liu , Edmund Y. Lam

In this paper, we firstly consider view-dependent effects into single image-based novel view synthesis (NVS) problems. For this, we propose to exploit the camera motion priors in NVS to model view-dependent appearance or effects (VDE) as…

计算机视觉与模式识别 · 计算机科学 2023-12-14 Juan Luis Gonzalez Bello , Munchurl Kim

Recent advancements in view synthesis have significantly enhanced immersive experiences across various computer graphics and multimedia applications, including telepresence and entertainment. By enabling the generation of new perspectives…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Manu Gond , Emin Zerman , Sebastian Knorr , Mårten Sjöström