English
Related papers

Related papers: Multi-modal 3D Shape Reconstruction Under Calibrat…

200 papers

We introduce a novel learning-based method to reconstruct the high-quality geometry and complex, spatially-varying BRDF of an arbitrary object from a sparse set of only six images captured by wide-baseline cameras under collocated point…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Sai Bi , Zexiang Xu , Kalyan Sunkavalli , David Kriegman , Ravi Ramamoorthi

Recent years have seen the development of mature solutions for reconstructing deformable surfaces from a single image, provided that they are relatively well-textured. By contrast, recovering the 3D shape of texture-less surfaces remains an…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Jan Bednařík , Pascal Fua , Mathieu Salzmann

Visual relocalization is crucial for autonomous visual localization and navigation of mobile robotics. Due to the improvement of CNN-based object detection algorithm, the robustness of visual relocalization is greatly enhanced especially in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Yifan Zhu , Lingjuan Miao , Haitao Wu , Zhiqiang Zhou , Weiyi Chen , Longwen Wu

This work proposes novel hyperparameter-free losses for single view 3D reconstruction with morphable models (3DMM). We dispense with the hyperparameters used in other works by exploiting geometry, so that the shape of the object and the…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Eduard Ramon , Guillermo Ruiz , Thomas Batard , Xavier Giró-i-Nieto

Integral field spectroscopy of high-redshift galaxies has become a powerful tool for understanding their dynamics and evolutionary states. However, in the case of gravitationally lensed systems, it has proved difficult to model both lensing…

Astrophysics of Galaxies · Physics 2022-04-13 Anthony J. Young , Charles R. Keeton , Andrew J. Baker

We introduce a novel learning-based method for encoding and manipulating 3D surface meshes. Our method is specifically designed to create an interpretable embedding space for deformable shape collections. Unlike previous 3D mesh…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Sara Hahner , Souhaib Attaiki , Jochen Garcke , Maks Ovsjanikov

Many vision-related tasks benefit from reasoning over multiple modalities to leverage complementary views of data in an attempt to learn robust embedding spaces. Most deep learning-based methods rely on a late fusion technique whereby…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Austin Reiter , Menglin Jia , Pu Yang , Ser-Nam Lim

Recent advancements in sensor technology and deep learning have led to significant progress in 3D human body reconstruction. However, most existing approaches rely on data from a specific sensor, which can be unreliable due to the inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Anjun Chen , Xiangyu Wang , Zhi Xu , Kun Shi , Yan Qin , Yuchi Huo , Jiming Chen , Qi Ye

We present NOVA3R, an effective approach for non-pixel-aligned 3D reconstruction from a set of unposed images in a feed-forward manner. Unlike pixel-aligned methods that tie geometry to per-ray predictions, our formulation learns a global,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Weirong Chen , Chuanxia Zheng , Ganlin Zhang , Andrea Vedaldi , Daniel Cremers

We present a technique for a complete 3D reconstruction of small objects moving in front of a textured background. It is a particular variation of multibody structure from motion, which specializes to two objects only. The scene is captured…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Petr Hruby , Tomas Pajdla

We present a novel approach for the reconstruction of dynamic geometric shapes using a single hand-held consumer-grade RGB-D sensor at real-time rates. Our method does not require a pre-defined shape template to start with and builds up the…

Computer Vision and Pattern Recognition · Computer Science 2016-08-02 Matthias Innmann , Michael Zollhöfer , Matthias Nießner , Christian Theobalt , Marc Stamminger

We introduce a new problem of retrieving 3D models that are deformable to a given query shape and present a novel deep deformation-aware embedding to solve this retrieval task. 3D model retrieval is a fundamental operation for recovering a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Mikaela Angelina Uy , Jingwei Huang , Minhyuk Sung , Tolga Birdal , Leonidas Guibas

Deformation field estimation is an important and challenging issue in many medical image registration applications. In recent years, deep learning technique has become a promising approach for simplifying registration problems, and has been…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Yujia Zhou , Shumao Pang , Jun Cheng , Yuhang Sun , Yi Wu , Lei Zhao , Yaqin Liu , Zhentai Lu , Wei Yang , Qianjin Feng

We present a statistical model for $3$D human faces in varying expression, which decomposes the surface of the face using a wavelet transform, and learns many localized, decorrelated multilinear models on the resulting coefficients. Using…

Computer Vision and Pattern Recognition · Computer Science 2014-07-02 Alan Brunton , Timo Bolkart , Stefanie Wuhrer

Recovering the 3D geometry of a purely texture-less object with generally unknown surface reflectance (e.g. non-Lambertian) is regarded as a challenging task in multi-view reconstruction. The major obstacle revolves around establishing…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Ziang Cheng , Hongdong Li , Yuta Asano , Yinqiang Zheng , Imari Sato

This paper presents ViewFormer, a simple yet effective model for multi-view 3d shape recognition and retrieval. We systematically investigate the existing methods for aggregating multi-view information and propose a novel ``view set"…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Hongyu Sun , Yongcai Wang , Peng Wang , Xudong Cai , Deying Li

Quantitative ultrasound (QUS) offers a non-invasive and objective way to quantify tissue health. We recently presented a spatially adaptive regularization method for reconstruction of a single QUS parameter, limited to a two dimensional…

Despite recent advancements in the Large Reconstruction Model (LRM) demonstrating impressive results, when extending its input from single image to multiple images, it exhibits inefficiencies, subpar geometric and texture quality, as well…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Mengfei Li , Xiaoxiao Long , Yixun Liang , Weiyu Li , Yuan Liu , Peng Li , Wenhan Luo , Wenping Wang , Yike Guo

In this paper, we develop a new method to automatically convert 2D line drawings from three orthographic views into 3D CAD models. Existing methods for this problem reconstruct 3D models by back-projecting the 2D observations into 3D space…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Wentao Hu , Jia Zheng , Zixin Zhang , Xiaojun Yuan , Jian Yin , Zihan Zhou

Reconstruction of a 3D shape from a single 2D image is a classical computer vision problem, whose difficulty stems from the inherent ambiguity of recovering occluded or only partially observed surfaces. Recent methods address this challenge…

Computer Vision and Pattern Recognition · Computer Science 2020-02-04 Yuan Yao , Nico Schertler , Enrique Rosales , Helge Rhodin , Leonid Sigal , Alla Sheffer