English
Related papers

Related papers: Generate What You Can't See - a View-dependent Ima…

200 papers

Single image reflection separation is an ill-posed problem since two scenes, a transmitted scene and a reflected scene, need to be inferred from a single observation. To make the problem tractable, in this work we assume that categories of…

Computer Vision and Pattern Recognition · Computer Science 2018-01-15 Donghoon Lee , Ming-Hsuan Yang , Songhwai Oh

Image description task has been invariably examined in a static manner with qualitative presumptions held to be universally applicable, regardless of the scope or target of the description. In practice, however, different viewers may pay…

Computation and Language · Computer Science 2018-05-02 Andrew Shin , Yoshitaka Ushiku , Tatsuya Harada

We combine neural rendering with multi-modal image and text representations to synthesize diverse 3D objects solely from natural language descriptions. Our method, Dream Fields, can generate the geometry and color of a wide range of objects…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Ajay Jain , Ben Mildenhall , Jonathan T. Barron , Pieter Abbeel , Ben Poole

We present a method for creating 3D indoor scenes with a generative model learned from a collection of semantic-segmented depth images captured from different unknown scenes. Given a room with a specified size, our method automatically…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Ming-Jia Yang , Yu-Xiao Guo , Bin Zhou , Xin Tong

We tackle the challenge of learning a distribution over complex, realistic, indoor scenes. In this paper, we introduce Generative Scene Networks (GSN), which learns to decompose scenes into a collection of many local radiance fields that…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Terrance DeVries , Miguel Angel Bautista , Nitish Srivastava , Graham W. Taylor , Joshua M. Susskind

Learning to generate natural scenes has always been a daunting task in computer vision. This is even more laborious when generating images with very different views. When the views are very different, the view fields have little overlap or…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Hao Ding , Songsong Wu , Hao Tang , Fei Wu , Guangwei Gao , Xiao-Yuan Jing

We present a method for learning a generative 3D model based on neural radiance fields, trained solely from data with only single views of each object. While generating realistic images is no longer a difficult task, producing the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Daniel Rebain , Mark Matthews , Kwang Moo Yi , Dmitry Lagun , Andrea Tagliasacchi

Understanding the shape of a scene from a single color image is a formidable computer vision task. However, most methods aim to predict the geometry of surfaces that are visible to the camera, which is of limited use when planning paths for…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Jamie Watson , Michael Firman , Aron Monszpart , Gabriel J. Brostow

Humans can easily understand a single image as depicting multiple potential objects permitting interaction. We use this skill to plan our interactions with the world and accelerate understanding new objects without engaging in interaction.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Shengyi Qian , David F. Fouhey

Autonomous robotic tasks require actively perceiving the environment to achieve application-specific goals. In this paper, we address the problem of positioning an RGB camera to collect the most informative images to represent an unknown…

Robotics · Computer Science 2023-07-25 Liren Jin , Xieyuanli Chen , Julius Rückin , Marija Popović

One major goal of vision is to infer physical models of objects, surfaces, and their layout from sensors. In this paper, we aim to interpret indoor scenes from one RGBD image. Our representation encodes the layout of walls, which must…

Computer Vision and Pattern Recognition · Computer Science 2017-08-21 Ruiqi Guo , Chuhang Zou , Derek Hoiem

We introduce a scalable framework for novel view synthesis from RGB-D images with largely incomplete scene coverage. While generative neural approaches have demonstrated spectacular results on 2D images, they have not yet achieved similar…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Zuoyue Li , Tianxing Fan , Zhenqiang Li , Zhaopeng Cui , Yoichi Sato , Marc Pollefeys , Martin R. Oswald

We introduce an inversion based method, denoted as IMAge-Guided model INvErsion (IMAGINE), to generate high-quality and diverse images from only a single training sample. We leverage the knowledge of image semantics from a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Pei Wang , Yijun Li , Krishna Kumar Singh , Jingwan Lu , Nuno Vasconcelos

We present LR-GAN: an adversarial image generation model which takes scene structure and context into account. Unlike previous generative adversarial networks (GANs), the proposed GAN learns to generate image background and foregrounds…

Computer Vision and Pattern Recognition · Computer Science 2017-08-03 Jianwei Yang , Anitha Kannan , Dhruv Batra , Devi Parikh

The efficient computation of viewpoints under consideration of various system and process constraints is a common challenge that any robot vision system is confronted with when trying to execute a vision task. Although fundamental research…

Robotics · Computer Science 2023-06-13 Alejandro Magaña , Jonas Dirr , Philipp Bauer , Gunther Reinhart

We propose a method for converting a single RGB-D input image into a 3D photo - a multi-layer representation for novel view synthesis that contains hallucinated color and depth structures in regions occluded in the original view. We use a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Meng-Li Shih , Shih-Yang Su , Johannes Kopf , Jia-Bin Huang

Intelligent robots require object-level scene understanding to reason about possible tasks and interactions with the environment. Moreover, many perception tasks such as scene reconstruction, image retrieval, or place recognition can…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Cathrin Elich , Iro Armeni , Martin R. Oswald , Marc Pollefeys , Joerg Stueckler

The generation of high-quality images has become widely accessible and is a rapidly evolving process. As a result, anyone can generate images that are indistinguishable from real ones. This leads to a wide range of applications, including…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Sergey Sinitsa , Ohad Fried

In this work, we present a geometry-based grasping algorithm that is capable of efficiently generating both top and side grasps for unknown objects, using a single view RGB-D camera, and of selecting the most promising one. We demonstrate…

Robotics · Computer Science 2019-07-19 Brice Denoun , Beatriz Leon , Claudio Zito , Rustam Stolkin , Lorenzo Jamone , Miles Hansard

Current deep learning approaches in computer vision primarily focus on RGB data sacrificing information. In contrast, RAW images offer richer representation, which is crucial for precise recognition, particularly in challenging conditions…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Christoph Reinders , Radu Berdan , Beril Besbinar , Junji Otsuka , Daisuke Iso