English
Related papers

Related papers: Unified Shape and SVBRDF Recovery using Differenti…

200 papers

We investigate the problem of learning category-specific 3D shape reconstruction from a variable number of RGB views of previously unobserved object instances. Most approaches for multiview shape reconstruction operate on sparse shape…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Srinath Sridhar , Davis Rempe , Julien Valentin , Sofien Bouaziz , Leonidas J. Guibas

We propose a method to detect and reconstruct multiple 3D objects from a single RGB image. The key idea is to optimize for detection, alignment and shape jointly over all objects in the RGB image, while focusing on realistic and physically…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Francis Engelmann , Konstantinos Rematas , Bastian Leibe , Vittorio Ferrari

We present a unified framework tackling two problems: class-specific 3D reconstruction from a single image, and generation of new 3D shape samples. These tasks have received considerable attention recently; however, most existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Paul Henderson , Vittorio Ferrari

Reconstructing real-world 3D objects has numerous applications in computer vision, such as virtual reality, video games, and animations. Ideally, 3D reconstruction methods should generate high-fidelity results with 3D consistency in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Jingnan Gao , Zhuo Chen , Yichao Yan , Bowen Pan , Zhe Wang , Jiangjing Lyu , Xiaokang Yang

3D reconstruction from images is a core problem in computer vision. With recent advances in deep learning, it has become possible to recover plausible 3D shapes even from single RGB images for the first time. However, obtaining detailed…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Tao Hu , Geng Lin , Zhizhong Han , Matthias Zwicker

We present a method for recovering the shape and radiance of a scene consisting of multiple people given solely a few images. Multi-human scenes are complex due to additional occlusion and clutter. For single-human settings, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Qian li , Victoria Fernàndez Abrevaya , Franck Multon , Adnane Boukhayma

Neural surface reconstruction aims to reconstruct accurate 3D surfaces based on multi-view images. Previous methods based on neural volume rendering mostly train a fully implicit model with MLPs, which typically require hours of training…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Tong Wu , Jiaqi Wang , Xingang Pan , Xudong Xu , Christian Theobalt , Ziwei Liu , Dahua Lin

Capturing the shape and spatially-varying appearance (SVBRDF) of an object from images is a challenging task that has applications in both computer vision and graphics. Traditional optimization-based approaches often need a large number of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Mark Boss , Varun Jampani , Kihwan Kim , Hendrik P. A. Lensch , Jan Kautz

Differentiable rendering is a technique to connect 3D scenes with corresponding 2D images. Since it is differentiable, processes during image formation can be learned. Previous approaches to differentiable rendering focus on mesh-based…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Cong Gao , Xingtong Liu , Wenhao Gu , Benjamin Killeen , Mehran Armand , Russell Taylor , Mathias Unberath

Learning a dense 3D model with fine-scale details from a single facial image is highly challenging and ill-posed. To address this problem, many approaches fit smooth geometries through facial prior while learning details as additional…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Xingyu Ren , Alexandros Lattas , Baris Gecer , Jiankang Deng , Chao Ma , Xiaokang Yang , Stefanos Zafeiriou

The long-coveted task of reconstructing 3D geometry from images is still a standing problem. In this paper, we build on the power of neural networks and introduce Pix2Vex, a network trained to convert camera-captured images into 3D…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Felix Petersen , Amit H. Bermano , Oliver Deussen , Daniel Cohen-Or

We propose Differentiable Stereopsis, a multi-view stereo approach that reconstructs shape and texture from few input views and noisy cameras. We pair traditional stereopsis and modern differentiable rendering to build an end-to-end model…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Shubham Goel , Georgia Gkioxari , Jitendra Malik

We present UniPlane, a novel method that unifies plane detection and reconstruction from posed monocular videos. Unlike existing methods that detect planes from local observations and associate them across the video for the final…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yuzhong Huang , Chen Liu , Ji Hou , Ke Huo , Shiyu Dong , Fred Morstatter

We introduce a theoretical framework for differentiable surface evolution that allows discrete topology changes through the use of topological derivatives for variational optimization of image functionals. While prior methods for inverse…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Ishit Mehta , Manmohan Chandraker , Ravi Ramamoorthi

Reconstructing objects from posed images is a crucial and complex task in computer graphics and computer vision. While NeRF-based neural reconstruction methods have exhibited impressive reconstruction ability, they tend to be…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Shuichang Lai , Letian Huang , Jie Guo , Kai Cheng , Bowen Pan , Xiaoxiao Long , Jiangjing Lyu , Chengfei Lv , Yanwen Guo

Reconstructing the shape and spatially varying surface appearances of a physical-world object as well as its surrounding illumination based on 2D images (e.g., photographs) of the object has been a long-standing problem in computer vision…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Cheng Sun , Guangyan Cai , Zhengqin Li , Kai Yan , Cheng Zhang , Carl Marshall , Jia-Bin Huang , Shuang Zhao , Zhao Dong

We present an algorithm for reconstructing dense, geometrically consistent depth for all pixels in a monocular video. We leverage a conventional structure-from-motion reconstruction to establish geometric constraints on pixels in the video.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Xuan Luo , Jia-Bin Huang , Richard Szeliski , Kevin Matzen , Johannes Kopf

This paper presents several new algorithms for the regularized reconstruction of a surface from its measured gradient field. By taking a matrix-algebraic approach, we establish general framework for the regularized reconstruction problem…

Numerical Analysis · Mathematics 2013-08-21 Matthew Harker , Paul O'Leary

In this work, we develop a novel technique for reconstructing images from projection-based nano- and microtomography. Our contribution focuses on enhancing reconstruction quality, particularly for specimen composed of homogeneous material…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Anuraag Mishra , Andrea Gilch , Benjamin Apeleo Zubiri , Jan Rolfes , Frauke Liers

3D reconstruction from images has wide applications in Virtual Reality and Automatic Driving, where the precision requirement is very high. Ground-breaking research in the neural radiance field (NeRF) by utilizing Multi-Layer Perceptions…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Jiaming Shen , Bolin Song , Zirui Wu , Yi Xu