English
Related papers

Related papers: Learning Generalizable Light Field Networks from F…

200 papers

It is suggested that low-light image enhancement realizes one-to-many mapping since we have different definitions of NORMAL-light given application scenarios or users' aesthetic. However, most existing methods ignore subjectivity of the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Ya'nan Wang , Zhuqing Jiang , Chang Liu , Kai Li , Aidong Men , Haiying Wang

We present neural architectures that disentangle RGB-D images into objects' shapes and styles and a map of the background scene, and explore their applications for few-shot 3D object detection and few-shot concept classification. Our…

Computer Vision and Pattern Recognition · Computer Science 2021-07-22 Mihir Prabhudesai , Shamit Lal , Darshan Patil , Hsiao-Yu Tung , Adam W Harley , Katerina Fragkiadaki

This paper targets on learning-based novel view synthesis from a single or limited 2D images without the pose supervision. In the viewer-centered coordinates, we construct an end-to-end trainable conditional variational framework to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Xiaofeng Liu , Tong Che , Yiqun Lu , Chao Yang , Site Li , Jane You

In recent years, novel view synthesis has gained popularity in generating high-fidelity images. While demonstrating superior performance in the task of synthesizing novel views, the majority of these methods are still based on the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Xiaoyan Yang , Dingbo Lu , Yang Li , Chenhui Li , Changbo Wang

Low-shot visual learning---the ability to recognize novel object categories from very few examples---is a hallmark of human visual intelligence. Existing machine learning approaches fail to generalize in the same way. To make progress on…

Computer Vision and Pattern Recognition · Computer Science 2017-11-07 Bharath Hariharan , Ross Girshick

We present a novel deep architecture and a training strategy to learn a local feature pipeline from scratch, using collections of images without the need for human supervision. To do so we exploit depth and relative camera pose cues to…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Yuki Ono , Eduard Trulls , Pascal Fua , Kwang Moo Yi

Unsupervised image-to-image translation methods learn to map images in a given class to an analogous image in a different class, drawing on unstructured (non-registered) datasets of images. While remarkably successful, current methods…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Ming-Yu Liu , Xun Huang , Arun Mallya , Tero Karras , Timo Aila , Jaakko Lehtinen , Jan Kautz

We propose an automatic method to infer high dynamic range illumination from a single, limited field-of-view, low dynamic range photograph of an indoor scene. In contrast to previous work that relies on specialized image capture, user…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Marc-André Gardner , Kalyan Sunkavalli , Ersin Yumer , Xiaohui Shen , Emiliano Gambaretto , Christian Gagné , Jean-François Lalonde

We present a machine learning algorithm that takes as input a 2D RGB image and synthesizes a 4D RGBD light field (color and depth of the scene in each ray direction). For training, we introduce the largest public light field dataset,…

Computer Vision and Pattern Recognition · Computer Science 2017-08-11 Pratul P. Srinivasan , Tongzhou Wang , Ashwin Sreelal , Ravi Ramamoorthi , Ren Ng

The goal of this work is to perform 3D reconstruction and novel view synthesis from data captured by scanning platforms commonly deployed for world mapping in urban outdoor environments (e.g., Street View). Given a sequence of posed RGB…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Konstantinos Rematas , Andrew Liu , Pratul P. Srinivasan , Jonathan T. Barron , Andrea Tagliasacchi , Thomas Funkhouser , Vittorio Ferrari

Researches in novel viewpoint synthesis majorly focus on interpolation from multi-view input images. In this paper, we focus on a more challenging and ill-posed problem that is to synthesize novel viewpoints from one single input image. To…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Xiaodong Cun , Feng Xu , Chi-Man Pun , Hao Gao

Modern 3D computer vision leverages learning to boost geometric reasoning, mapping image data to classical structures such as cost volumes or epipolar constraints to improve matching. These architectures are specialized according to the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Vitor Guizilini , Igor Vasiljevic , Jiading Fang , Rares Ambrus , Greg Shakhnarovich , Matthew Walter , Adrien Gaidon

We present a practical and robust deep learning solution for capturing and rendering novel views of complex real world scenes for virtual exploration. Previous approaches either require intractably dense view sampling or provide little to…

Computer Vision and Pattern Recognition · Computer Science 2019-05-03 Ben Mildenhall , Pratul P. Srinivasan , Rodrigo Ortiz-Cayon , Nima Khademi Kalantari , Ravi Ramamoorthi , Ren Ng , Abhishek Kar

Neural Radiation Field (NeRF) technology can learn a 3D implicit model of a scene from 2D images and synthesize realistic novel view images. This technology has received widespread attention from the industry and has good application…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Shun Fang , Ming Cui , Xing Feng , Yanna Lv

We propose LIRF (Local Implicit Ray Function), a generalizable neural rendering approach for novel view rendering. Current generalizable neural radiance fields (NeRF) methods sample a scene with a single ray per pixel and may therefore…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Xin Huang , Qi Zhang , Ying Feng , Xiaoyu Li , Xuan Wang , Qing Wang

We present CG-NeRF, a cascade and generalizable neural radiance fields method for view synthesis. Recent generalizing view synthesis methods can render high-quality novel views using a set of nearby input views. However, the rendering speed…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Phong Nguyen-Ha , Lam Huynh , Esa Rahtu , Jiri Matas , Janne Heikkila

We present NeRF-SR, a solution for high-resolution (HR) novel view synthesis with mostly low-resolution (LR) inputs. Our method is built upon Neural Radiance Fields (NeRF) that predicts per-point density and color with a multi-layer…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Chen Wang , Xian Wu , Yuan-Chen Guo , Song-Hai Zhang , Yu-Wing Tai , Shi-Min Hu

Predicting novel views of a scene from real-world images has always been a challenging task. In this work, we propose a deep convolutional neural network (CNN) which learns to predict novel views of a scene from given collection of images.…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Amit More , Subhasis Chaudhuri

Novel view synthesis (NVS) aims to generate images at arbitrary viewpoints using multi-view images, and recent insights from neural radiance fields (NeRF) have contributed to remarkable improvements. Recently, studies on generalizable NeRF…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Youngho Yoon , Hyun-Kurl Jang , Kuk-Jin Yoon

This paper presents a learning-based approach to synthesize the view from an arbitrary camera position given a sparse set of images. A key challenge for this novel view synthesis arises from the reconstruction process, when the views from…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Nan Meng , Kai Li , Jianzhuang Liu , Edmund Y. Lam