English
Related papers

Related papers: Robust 3D Shape Reconstruction in Zero-Shot from a…

200 papers

This paper presents an algorithm to reconstruct temporally consistent 3D meshes of deformable object instances from videos in the wild. Without requiring annotations of 3D mesh, 2D keypoints, or camera pose for each video frame, we pose…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Xueting Li , Sifei Liu , Shalini De Mello , Kihwan Kim , Xiaolong Wang , Ming-Hsuan Yang , Jan Kautz

3D shape reconstruction is a primary component of augmented/virtual reality. Despite being highly advanced, existing solutions based on RGB, RGB-D and Lidar sensors are power and data intensive, which introduces challenges for deployment in…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Alexis Baudron , Zihao W. Wang , Oliver Cossairt , Aggelos K. Katsaggelos

Single image 3D reconstruction is an important but challenging task that requires extensive knowledge of our natural world. Many existing methods solve this problem by optimizing a neural radiance field under the guidance of 2D diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Minghua Liu , Chao Xu , Haian Jin , Linghao Chen , Mukund Varma T , Zexiang Xu , Hao Su

While recent deep neural networks have achieved promising results for 3D reconstruction from a single-view image, these rely on the availability of RGB textures in images and extra information as supervision. In this work, we propose novel…

Computer Vision and Pattern Recognition · Computer Science 2017-01-18 Xinhan Di , Pengqian Yu

Precise camera control for reshooting dynamic videos is bottlenecked by the severe scarcity of paired multi-view data for non-rigid scenes. We overcome this limitation with a highly scalable self-supervised framework capable of leveraging…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Avinash Paliwal , Adithya Iyer , Shivin Yadav , Muhammad Ali Afridi , Midhun Harikumar

Large models have shown generalization across datasets for many low-level vision tasks, like depth estimation, but no such general models exist for scene flow. Even though scene flow has wide potential use, it is not used in practice…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Yiqing Liang , Abhishek Badki , Hang Su , James Tompkin , Orazio Gallo

We present a method to learn the 3D surface of objects directly from a collection of images. Previous work achieved this capability by exploiting additional manual annotation, such as object pose, 3D surface templates, temporal continuity…

Computer Vision and Pattern Recognition · Computer Science 2018-11-28 Attila Szabó , Paolo Favaro

Accurately analyzing the motion parts and their motion attributes in dynamic environments is crucial for advancing key areas such as embodied intelligence. Addressing the limitations of existing methods that rely on dense multi-view images…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Hongyi Zhou , Yulan Guo , Xiaogang Wang , Kai Xu

Large Reconstruction Models (LRMs) have recently become a popular method for creating 3D foundational models. Training 3D reconstruction models with 2D visual data traditionally requires prior knowledge of camera poses for the training…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Shiu-hong Kao , Xiao Li , Jinglu Wang , Yang Li , Chi-Keung Tang , Yu-Wing Tai , Yan Lu

Neural 3D scene reconstruction methods have achieved impressive performance when reconstructing complex geometry and low-textured regions in indoor scenes. However, these methods heavily rely on 3D data which is costly and time-consuming to…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Yi Guo , Che Sun , Yunde Jia , Yuwei Wu

Tracking and reconstructing 3D objects from cluttered scenes are the key components for computer vision, robotics and autonomous driving systems. While recent progress in implicit function has shown encouraging results on high-quality 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Jianglong Ye , Yuntao Chen , Naiyan Wang , Xiaolong Wang

Mapping and understanding complex 3D environments is fundamental to how autonomous systems perceive and interact with the physical world, requiring both precise geometric reconstruction and rich semantic comprehension. While existing 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Naman Patel , Prashanth Krishnamurthy , Farshad Khorrami

This paper shows that accurate underwater 3D shape reconstruction is possible using a single camera, observing a target through a refractive interface. We provide unified reconstruction techniques for a variety of scenarios such as single…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Kazuto Ichimaru , Yuichi Taguchi , Hiroshi Kawasaki

In recent years, 3D models have gained popularity in various fields, including entertainment, manufacturing, and simulation. However, manually creating these models can be a time-consuming and resource-intensive process, making it…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Potito Aghilar , Vito Walter Anelli , Michelantonio Trizio , Tommaso Di Noia

3D scene reconstruction is essential for applications in virtual reality, robotics, and autonomous driving, enabling machines to understand and interact with complex environments. Traditional 3D Gaussian Splatting techniques rely on images…

Graphics · Computer Science 2025-03-04 Changlin Song , Jiaqi Wang , Liyun Zhu , He Weng

We present a novel diffusion-based approach for coherent 3D scene reconstruction from a single RGB image. Our method utilizes an image-conditioned 3D scene diffusion model to simultaneously denoise the 3D poses and geometries of all objects…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Manuel Dahnert , Angela Dai , Norman Müller , Matthias Nießner

In this work we explore reconstructing hand-object interactions in the wild. The core challenge of this problem is the lack of appropriate 3D labeled data. To overcome this issue, we propose an optimization-based procedure which does not…

Computer Vision and Pattern Recognition · Computer Science 2022-01-03 Zhe Cao , Ilija Radosavovic , Angjoo Kanazawa , Jitendra Malik

Detecting and localizing glass in 3D environments poses significant challenges for visual perception systems, as the optical properties of glass often hinder conventional sensors from accurately distinguishing glass surfaces. The lack of…

Robotics · Computer Science 2025-09-09 Kai Zhang , Guoyang Zhao , Jianxing Shi , Bonan Liu , Weiqing Qi , Jun Ma

Reconstructing 3D scenes from sparse, unposed images remains challenging under real-world conditions with varying illumination and transient occlusions. Existing methods rely on scene-specific optimization using appearance embeddings or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Vinayak Gupta , Chih-Hao Lin , Shenlong Wang , Anand Bhattad , Jia-Bin Huang

3D reconstruction from a single-RGB image in unconstrained real-world scenarios presents numerous challenges due to the inherent diversity and complexity of objects and environments. In this paper, we introduce Anything-3D, a methodical…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Qiuhong Shen , Xingyi Yang , Xinchao Wang