English
Related papers

Related papers: Differentiable Stereopsis: Meshes from multiple vi…

200 papers

Recent advancements in 2D/3D generative techniques have facilitated the generation of dynamic 3D objects from monocular videos. Previous methods mainly rely on the implicit neural radiance fields (NeRF) or explicit Gaussian Splatting as the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Zhiqi Li , Yiming Chen , Peidong Liu

Neural approaches have shown a significant progress on camera-based reconstruction. But they require either a fairly dense sampling of the viewing sphere, or pre-training on an existing dataset, thereby limiting their generalizability. In…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Mohammed Brahimi , Bjoern Haefner , Zhenzhang Ye , Bastian Goldluecke , Daniel Cremers

We present a method to automatically compute correct gradients with respect to geometric scene parameters in neural SDF renderers. Recent physically-based differentiable rendering techniques for meshes have used edge-sampling to handle…

We investigate the problem of learning to generate 3D parametric surface representations for novel object instances, as seen from one or more views. Previous work on learning shape reconstruction from multiple views uses discrete…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Jiahui Lei , Srinath Sridhar , Paul Guerrero , Minhyuk Sung , Niloy Mitra , Leonidas J. Guibas

We introduce SparseNeuS, a novel neural rendering based method for the task of surface reconstruction from multi-view images. This task becomes more difficult when only sparse images are provided as input, a scenario where existing neural…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Xiaoxiao Long , Cheng Lin , Peng Wang , Taku Komura , Wenping Wang

Traditional stereo algorithms have focused their efforts on reconstruction quality and have largely avoided prioritizing for run time performance. Robots, on the other hand, require quick maneuverability and effective computation to observe…

Robotics · Computer Science 2016-02-18 Sudeep Pillai , Srikumar Ramalingam , John J. Leonard

This paper addresses the problem of generating textures for 3D mesh assets. Existing approaches often rely on image diffusion models to generate multi-view image observations, which are then transformed onto the mesh surface to produce a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Xuyang Wang , Ziang Cheng , Zhenyu Li , Jiayu Yang , Haorui Ji , Pan Ji , Mehrtash Harandi , Richard Hartley , Hongdong Li

We present a learning based approach for multi-view stereopsis (MVS). While current deep MVS methods achieve impressive results, they crucially rely on ground-truth 3D training data, and acquisition of such precise 3D geometry for…

Computer Vision and Pattern Recognition · Computer Science 2019-06-07 Tejas Khot , Shubham Agrawal , Shubham Tulsiani , Christoph Mertz , Simon Lucey , Martial Hebert

Modern optical satellite sensors enable high-resolution stereo reconstruction from space. But the challenging imaging conditions when observing the Earth from space push stereo matching to its limits. In practice, the resulting digital…

Image and Video Processing · Electrical Eng. & Systems 2021-12-21 Corinne Stucker , Konrad Schindler

Recent advances in differentiable rendering have sparked an interest in learning generative models of textured 3D meshes from image collections. These models natively disentangle pose and appearance, enable downstream applications in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Dario Pavllo , Jonas Kohler , Thomas Hofmann , Aurelien Lucchi

We present DeepMVS, a deep convolutional neural network (ConvNet) for multi-view stereo reconstruction. Taking an arbitrary number of posed images as input, we first produce a set of plane-sweep volumes and use the proposed DeepMVS network…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Po-Han Huang , Kevin Matzen , Johannes Kopf , Narendra Ahuja , Jia-Bin Huang

The advancement of diffusion models has pushed the boundary of text-to-3D object generation. While it is straightforward to composite objects into a scene with reasonable geometry, it is nontrivial to texture such a scene perfectly due to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Qi Wang , Ruijie Lu , Xudong Xu , Jingbo Wang , Michael Yu Wang , Bo Dai , Gang Zeng , Dan Xu

The estimation of 3D human body pose and shape from a single image has been extensively studied in recent years. However, the texture generation problem has not been fully discussed. In this paper, we propose an end-to-end learning strategy…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Jian Wang , Yunshan Zhong , Yachun Li , Chi Zhang , Yichen Wei

Patch-based stereo is nowadays a commonly used image-based technique for dense 3D reconstruction in large scale multi-view applications. The typical steps of such a pipeline can be summarized in stereo pair selection, depth map computation,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Elisavet Konstantina Stathopoulou , Fabio Remondino

Analysis of the 3D Texture is indispensable for various tasks, such as retrieval, segmentation, classification, and inspection of sculptures, knitted fabrics, and biological tissues. A 3D texture is a locally repeated surface variation…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Iyyakutti Iyappan Ganapathi , Fayaz Ali , Sajid Javed , Syed Sadaf Ali , Naoufel Werghi

Constructing 3D representations of object geometry is critical for many robotics tasks, particularly manipulation problems. These representations must be built from potentially noisy partial observations. In this work, we focus on the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Herbert Wright , Weiming Zhi , Martin Matak , Matthew Johnson-Roberson , Tucker Hermans

We propose an embarrassingly simple but very effective scheme for high-quality dense stereo reconstruction: (i) generate an approximate reconstruction with your favourite stereo matcher; (ii) rewarp the input images with that approximate…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Corinne Stucker , Konrad Schindler

This paper proposes a new end-to-end neural rendering architecture to transfer appearance and reenact human actors. Our method leverages a carefully designed graph convolutional network (GCN) to model the human body manifold structure,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Thiago L. Gomes , Thiago M. Coutinho , Rafael Azevedo , Renato Martins , Erickson R. Nascimento

Traditional multi-view photometric stereo (MVPS) methods are often composed of multiple disjoint stages, resulting in noticeable accumulated errors. In this paper, we present a neural inverse rendering method for MVPS based on implicit…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Wenqi Yang , Guanying Chen , Chaofeng Chen , Zhenfang Chen , Kwan-Yee K. Wong

We introduce a novel learning-based method to reconstruct the high-quality geometry and complex, spatially-varying BRDF of an arbitrary object from a sparse set of only six images captured by wide-baseline cameras under collocated point…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Sai Bi , Zexiang Xu , Kalyan Sunkavalli , David Kriegman , Ravi Ramamoorthi