English
Related papers

Related papers: De-rendering the World's Revolutionary Artefacts

200 papers

Recovering the 3D geometry of a purely texture-less object with generally unknown surface reflectance (e.g. non-Lambertian) is regarded as a challenging task in multi-view reconstruction. The major obstacle revolves around establishing…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Ziang Cheng , Hongdong Li , Yuta Asano , Yinqiang Zheng , Imari Sato

An important problem for both graphics and vision is to synthesize novel views of a 3D object from a single image. This is particularly challenging due to the partial observability inherent in projecting a 3D object onto the image space,…

Machine Learning · Computer Science 2016-01-06 Jimei Yang , Scott Reed , Ming-Hsuan Yang , Honglak Lee

Implicit representations of 3D objects have recently achieved impressive results on learning-based 3D reconstruction tasks. While existing works use simple texture models to represent object appearance, photo-realistic image synthesis…

Computer Vision and Pattern Recognition · Computer Science 2020-03-30 Michael Oechsle , Michael Niemeyer , Lars Mescheder , Thilo Strauss , Andreas Geiger

Photographers routinely compose multiple manipulated photos of the same scene (layers) into a single image, which is better than any individual photo could be alone. Similarly, 3D artists set up rendering systems to produce layered images…

Graphics · Computer Science 2017-02-03 Carlo Innamorati , Tobias Ritschel , Tim Weyrich , Niloy J. Mitra

3D reconstruction is a fundamental problem in computer vision, and the task is especially challenging when the object to reconstruct is partially or fully occluded. We introduce a method that uses the shadows cast by an unobserved object in…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Ruoshi Liu , Sachit Menon , Chengzhi Mao , Dennis Park , Simon Stent , Carl Vondrick

Reflections often degrade the quality of the image by obstructing the background scene. This is not desirable for everyday users, and it negatively impacts the performance of multimedia applications that process images with reflections.…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Suhong Kim , Hamed RahmaniKhezri , Seyed Mohammad Nourbakhsh , Mohamed Hefeeda

Capturing geometric and material information from images remains a fundamental challenge in computer vision and graphics. Traditional optimization-based methods often require hours of computational time to reconstruct geometry, material…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Zhibing Li , Tong Wu , Jing Tan , Mengchen Zhang , Jiaqi Wang , Dahua Lin

Inverse rendering of an object under entirely unknown capture conditions is a fundamental challenge in computer vision and graphics. Neural approaches such as NeRF have achieved photorealistic results on novel view synthesis, but they…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Mark Boss , Andreas Engelhardt , Abhishek Kar , Yuanzhen Li , Deqing Sun , Jonathan T. Barron , Hendrik P. A. Lensch , Varun Jampani

3D image reconstruction from a limited number of 2D images has been a long-standing challenge in computer vision and image analysis. While deep learning-based approaches have achieved impressive performance in this area, existing deep…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Nivetha Jayakumar , Tonmoy Hossain , Miaomiao Zhang

In this work we introduce Lifting Autoencoders, a generative 3D surface-based model of object categories. We bring together ideas from non-rigid structure from motion, image formation, and morphable models to learn a controllable, geometric…

Computer Vision and Pattern Recognition · Computer Science 2019-04-29 Mihir Sahasrabudhe , Zhixin Shu , Edward Bartrum , Riza Alp Guler , Dimitris Samaras , Iasonas Kokkinos

Contrastive self-supervised learning has emerged as a promising approach to unsupervised visual representation learning. In general, these methods learn global (image-level) representations that are invariant to different views (i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Pedro O. Pinheiro , Amjad Almahairi , Ryan Y. Benmalek , Florian Golemo , Aaron Courville

Benefited from the deep learning, image Super-Resolution has been one of the most developing research fields in computer vision. Depending upon whether using a discriminator or not, a deep convolutional neural network can provide an image…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Zhi-Song Liu , Wan-Chi Siu , Li-Wen Wang , Chu-Tak Li , Marie-Paule Cani , Yui-Lam Chan

We address the problem of recovering the shape and spatially-varying reflectance of an object from multi-view images (and their camera poses) of an object illuminated by one unknown lighting condition. This enables the rendering of novel…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Xiuming Zhang , Pratul P. Srinivasan , Boyang Deng , Paul Debevec , William T. Freeman , Jonathan T. Barron

We present Neural Microfacet Fields, a method for recovering materials, geometry, and environment illumination from images of a scene. Our method uses a microfacet reflectance model within a volumetric setting by treating each sample along…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Alexander Mai , Dor Verbin , Falko Kuester , Sara Fridovich-Keil

We present a novel convolutional neural network architecture for photometric stereo (Woodham, 1980), a problem of recovering 3D object surface normals from multiple images observed under varying illuminations. Despite its long history in…

Computer Vision and Pattern Recognition · Computer Science 2018-05-30 Tatsunori Taniai , Takanori Maehara

This paper presents a new system to obtain dense object reconstructions along with 6-DoF poses from a single image. Geared towards high fidelity reconstruction, several recent approaches leverage implicit surface representations and deep…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Aniket Pokale , Aditya Aggarwal , K. Madhava Krishna

The availability of affordable and portable depth sensors has made scanning objects and people simpler than ever. However, dealing with occlusions and missing parts is still a significant challenge. The problem of reconstructing a (possibly…

Computer Vision and Pattern Recognition · Computer Science 2018-04-05 Or Litany , Alex Bronstein , Michael Bronstein , Ameesh Makadia

Deep generative models come with the promise to learn an explainable representation for visual objects that allows image sampling, synthesis, and selective modification. The main challenge is to learn to properly model the independent…

Computer Vision and Pattern Recognition · Computer Science 2019-10-24 Patrick Esser , Johannes Haux , Björn Ommer

Learning neural radiance fields of a scene has recently allowed realistic novel view synthesis of the scene, but they are limited to synthesize images under the original fixed lighting condition. Therefore, they are not flexible for the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Quan Zheng , Gurprit Singh , Hans-Peter Seidel

Deep neural network based methods are the state of the art in various image restoration problems. Standard supervised learning frameworks require a set of noisy measurement and clean image pairs for which a distance between the output of…

Image and Video Processing · Electrical Eng. & Systems 2021-03-31 Rihuan Ke , Carola-Bibiane Schönlieb