English
Related papers

Related papers: ShapeClipper: Scalable 3D Shape Learning from Sing…

200 papers

3D shape reconstruction from a single image is a highly ill-posed problem. Modern deep learning based systems try to solve this problem by learning an end-to-end mapping from image to shape via a deep network. In this paper, we aim to solve…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Kejie Li , Ravi Garg , Ming Cai , Ian Reid

Object reconstruction from a single image -- in the wild -- is a problem where we can make progress and get meaningful results today. This is the main message of this paper, which introduces an automated pipeline with pixels as inputs and…

Computer Vision and Pattern Recognition · Computer Science 2015-05-08 Abhishek Kar , Shubham Tulsiani , João Carreira , Jitendra Malik

We show that generative models can be used to capture visual geometry constraints statistically. We use this fact to infer the 3D shape of object categories from raw single-view images. Differently from prior work, we use no external…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Shangzhe Wu , Christian Rupprecht , Andrea Vedaldi

We present a convolutional neural network for joint 3D shape prediction and viewpoint estimation from a single input image. During training, our network gets the learning signal from a silhouette of an object in the input image - a form of…

Robotics · Computer Science 2019-10-18 Oier Mees , Maxim Tatarchenko , Thomas Brox , Wolfram Burgard

We propose a novel technique for producing high-quality 3D models that match a given target object image or scan. Our method is based on retrieving an existing shape from a database of 3D models and then deforming its parts to match the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Mikaela Angelina Uy , Vladimir G. Kim , Minhyuk Sung , Noam Aigerman , Siddhartha Chaudhuri , Leonidas Guibas

Encouraged by the growing availability of pre-trained 2D diffusion models, image-to-3D generation by leveraging Score Distillation Sampling (SDS) is making remarkable progress. Most existing methods combine novel-view lifting from 2D…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Pengkun Liu , Yikai Wang , Fuchun Sun , Jiafang Li , Hang Xiao , Hongxiang Xue , Xinzhou Wang

Reconstructing object deformation from a single image remains a significant challenge in computer vision and graphics. Existing methods typically rely on multi-view video to recover deformation, limiting their applicability under…

Graphics · Computer Science 2025-09-29 Jinhyeok Kim , Jaehun Bang , Seunghyun Seo , Kyungdon Joo

Grasping unknown objects from a single view has remained a challenging topic in robotics due to the uncertainty of partial observation. Recent advances in large-scale models have led to benchmark solutions such as GraspNet-1Billion.…

Robotics · Computer Science 2025-07-17 Hao Chen , Takuya Kiyokawa , Zhengtao Hu , Weiwei Wan , Kensuke Harada

Perceiving accurate 3D object shape is important for robots to interact with the physical world. Current research along this direction has been primarily relying on visual observations. Vision, however useful, has inherent limitations due…

Computer Vision and Pattern Recognition · Computer Science 2018-08-10 Shaoxiong Wang , Jiajun Wu , Xingyuan Sun , Wenzhen Yuan , William T. Freeman , Joshua B. Tenenbaum , Edward H. Adelson

We study end-to-end learning strategies for 3D shape inference from images, in particular from a single image. Several approaches in this direction have been investigated that explore different shape representations and suitable learning…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Roman Klokov , Jakob Verbeek , Edmond Boyer

We present FaceLift, a novel feed-forward approach for generalizable high-quality 360-degree 3D head reconstruction from a single image. Our pipeline first employs a multi-view latent diffusion model to generate consistent side and back…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Weijie Lyu , Yi Zhou , Ming-Hsuan Yang , Zhixin Shu

Estimating the 3D shape of an object from a single or multiple images has gained popularity thanks to the recent breakthroughs powered by deep learning. Most approaches regress the full object shape in a canonical pose, possibly…

Computer Vision and Pattern Recognition · Computer Science 2020-11-19 Riccardo Spezialetti , David Joseph Tan , Alessio Tonioni , Keisuke Tateno , Federico Tombari

We present a learning framework for recovering the 3D shape, camera, and texture of an object from a single image. The shape is represented as a deformable 3D mesh model of an object category where a shape is parameterized by a learned mean…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Angjoo Kanazawa , Shubham Tulsiani , Alexei A. Efros , Jitendra Malik

We infer and generate three-dimensional (3D) scene information from a single input image and without supervision. This problem is under-explored, with most prior work relying on supervision from, e.g., 3D ground-truth, multiple images of a…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Sai Rajeswar , Fahim Mannan , Florian Golemo , Jérôme Parent-Lévesque , David Vazquez , Derek Nowrouzezahrai , Aaron Courville

Recent advances in 3D shape generation have achieved impressive results, but most existing methods rely on clean, unoccluded, and well-segmented inputs. Such conditions are rarely met in real-world scenarios. We present ShapeR, a novel…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Yawar Siddiqui , Duncan Frost , Samir Aroudj , Armen Avetisyan , Henry Howard-Jenkins , Daniel DeTone , Pierre Moulon , Qirui Wu , Zhengqin Li , Julian Straub , Richard Newcombe , Jakob Engel

There is some ambiguity in the 3D shape of an object when the number of observed views is small. Because of this ambiguity, although a 3D object reconstructor can be trained using a single view or a few views per object, reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2019-04-01 Hiroharu Kato , Tatsuya Harada

Learning deformable 3D objects from 2D images is often an ill-posed problem. Existing methods rely on explicit supervision to establish multi-view correspondences, such as template shape models and keypoint annotations, which restricts…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Shangzhe Wu , Tomas Jakab , Christian Rupprecht , Andrea Vedaldi

3D face reconstruction from a single image is a classical and challenging problem, with wide applications in many areas. Inspired by recent works in face animation from RGB-D or monocular video inputs, we develop a novel method for…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Luo Jiang , Juyong Zhang , Bailin Deng , Hao Li , Ligang Liu

3D visual grounding allows an embodied agent to understand visual information in real-world 3D environments based on human instructions, which is crucial for embodied intelligence. Existing 3D visual grounding methods typically rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Fan Li , Zanyi Wang , Zeyi Huang , Guang Dai , Jingdong Wang , Mengmeng Wang

Inferring the 3D shape of an object from an RGB image has shown impressive results, however, existing methods rely primarily on recognizing the most similar 3D model from the training set to solve the problem. These methods suffer from poor…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Haozhe Xie , Hongxun Yao , Shangchen Zhou , Shengping Zhang , Xiaoshuai Sun , Wenxiu Sun