English
Related papers

Related papers: Neural Illumination: Lighting Prediction for Indoo…

200 papers

In this paper we propose a neural message passing approach to augment an input 3D indoor scene with new objects matching their surroundings. Given an input, potentially incomplete, 3D scene and a query location, our method predicts a…

Computer Vision and Pattern Recognition · Computer Science 2019-07-29 Yang Zhou , Zachary While , Evangelos Kalogerakis

Reconstruction and intrinsic decomposition of scenes from captured imagery would enable many applications such as relighting and virtual object insertion. Recent NeRF based methods achieve impressive fidelity of 3D reconstruction, but bake…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Zian Wang , Tianchang Shen , Jun Gao , Shengyu Huang , Jacob Munkberg , Jon Hasselgren , Zan Gojcic , Wenzheng Chen , Sanja Fidler

We consider the challenging problem of predicting intrinsic object properties from a single image by exploiting differentiable renderers. Many previous learning-based approaches for inverse graphics adopt rasterization-based renderers and…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Wenzheng Chen , Joey Litalien , Jun Gao , Zian Wang , Clement Fuji Tsang , Sameh Khamis , Or Litany , Sanja Fidler

Mobile robots rely on maps to navigate through an environment. In the absence of any map, the robots must build the map online from partial observations as they move in the environment. Traditional methods build a map using only direct…

Robotics · Computer Science 2024-10-14 Vishnu Dutt Sharma

We present a method to separate a single image captured under two illuminants, with different spectra, into the two images corresponding to the appearance of the scene under each individual illuminant. We do this by training a deep neural…

Computer Vision and Pattern Recognition · Computer Science 2019-04-24 Zhuo Hui , Ayan Chakrabarti , Kalyan Sunkavalli , Aswin C. Sankaranarayanan

Inferring representations of 3D scenes from 2D observations is a fundamental problem of computer graphics, computer vision, and artificial intelligence. Emerging 3D-structured neural scene representations are a promising approach to 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Vincent Sitzmann , Semon Rezchikov , William T. Freeman , Joshua B. Tenenbaum , Fredo Durand

Estimating the 3D pose of an object is a challenging task that can be considered within augmented reality or robotic applications. In this paper, we propose a novel approach to perform 6 DoF object pose estimation from a single RGB-D image.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Mathieu Gonzalez , Amine Kacete , Albert Murienne , Eric Marchand

Obstacle avoidance from monocular images is a challenging problem for robots. Though multi-view structure-from-motion could build 3D maps, it is not robust in textureless environments. Some learning based methods exploit human demonstration…

Robotics · Computer Science 2017-05-01 Shichao Yang , Sandeep Konam , Chen Ma , Stephanie Rosenthal , Manuela Veloso , Sebastian Scherer

The problem of identifying the 3D pose of a known object from a given 2D image has important applications in Computer Vision ranging from robotic vision to image analysis. Our proposed method of registering a 3D model of a known object on a…

Computer Vision and Pattern Recognition · Computer Science 2012-02-10 Srimal Jayawardena , Marcus Hutter , Nathan Brewer

Most real-world 3D sensors such as LiDARs perform fixed scans of the entire environment, while being decoupled from the recognition system that processes the sensor data. In this work, we propose a method for 3D object recognition using…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Siddharth Ancha , Yaadhav Raaj , Peiyun Hu , Srinivasa G. Narasimhan , David Held

Neural radiance fields (NeRFs) have recently emerged as a promising approach for 3D reconstruction and novel view synthesis. However, NeRF-based methods encode shape, reflectance, and illumination implicitly and this makes it challenging…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Ruofan Liang , Jiahao Zhang , Haoda Li , Chen Yang , Yushi Guan , Nandita Vijaykumar

We study the problem of symmetry detection of 3D shapes from single-view RGB-D images, where severely missing data renders geometric detection approach infeasible. We propose an end-to-end deep neural network which is able to predict both…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Yifei Shi , Junwen Huang , Hongjia Zhang , Xin Xu , Szymon Rusinkiewicz , Kai Xu

Its numerous applications make multi-human 3D pose estimation a remarkably impactful area of research. Nevertheless, assuming a multiple-view system composed of several regular RGB cameras, 3D multi-pose estimation presents several…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Daniel Rodriguez-Criado , Pilar Bachiller , George Vogiatzis , Luis J. Manso

Indoor scene understanding is central to applications such as robot navigation and human companion assistance. Over the last years, data-driven deep neural networks have outperformed many traditional approaches thanks to their…

Computer Vision and Pattern Recognition · Computer Science 2017-07-04 Yinda Zhang , Shuran Song , Ersin Yumer , Manolis Savva , Joon-Young Lee , Hailin Jin , Thomas Funkhouser

Seeing-in-the-dark is one of the most important and challenging computer vision tasks due to its wide applications and extreme complexities of in-the-wild scenarios. Existing arts can be mainly divided into two threads: 1) RGB-dependent…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Muyao Niu , Zhuoxiao Li , Zhihang Zhong , Yinqiang Zheng

Recently neural volumetric representations such as neural reflectance fields have been widely applied to faithfully reproduce the appearance of real-world objects and scenes under novel viewpoints and lighting conditions. However, it…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Mohammad Shafiei , Sai Bi , Zhengqin Li , Aidas Liaudanskas , Rodrigo Ortiz-Cayon , Ravi Ramamoorthi

Neural rendering provides a fundamentally new way to render photorealistic images. Similar to traditional light-baking methods, neural rendering utilizes neural networks to bake representations of scenes, materials, and lights into latent…

Graphics · Computer Science 2024-05-30 Ziyang Zhang , Edgar Simo-Serra

Light plays an important role in human well-being. However, most computer vision tasks treat pixels without considering their relationship to physical luminance. To address this shortcoming, we introduce the Laval Photometric Indoor HDR…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Christophe Bolduc , Justine Giroux , Marc Hébert , Claude Demers , Jean-François Lalonde

Recent advances in 3D semantic scene understanding have shown impressive progress in 3D instance segmentation, enabling object-level reasoning about 3D scenes; however, a finer-grained understanding is required to enable interactions with…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Alexey Bokhovkin , Vladislav Ishimtsev , Emil Bogomolov , Denis Zorin , Alexey Artemov , Evgeny Burnaev , Angela Dai

In recent years, significant progress has been made in image recognition technology based on deep neural networks. However, improving recognition performance under low-light conditions remains a significant challenge. This study addresses…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Seitaro Ono , Yuka Ogino , Takahiro Toizumi , Atsushi Ito , Masato Tsukada