English
Related papers

Related papers: Sparse multi-view hand-object reconstruction for u…

200 papers

We propose a method to detect and reconstruct multiple 3D objects from a single RGB image. The key idea is to optimize for detection, alignment and shape jointly over all objects in the RGB image, while focusing on realistic and physically…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Francis Engelmann , Konstantinos Rematas , Bastian Leibe , Vittorio Ferrari

We introduce a scalable approach for object pose estimation trained on simulated RGB views of multiple 3D models together. We learn an encoding of object views that does not only describe an implicit orientation of all objects seen during…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Martin Sundermeyer , Maximilian Durner , En Yen Puang , Zoltan-Csaba Marton , Narunas Vaskevicius , Kai O. Arras , Rudolph Triebel

We present iFusion, a novel 3D object reconstruction framework that requires only two views with unknown camera poses. While single-view reconstruction yields visually appealing results, it can deviate significantly from the actual object,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Chin-Hsuan Wu , Yen-Chun Chen , Bolivar Solarte , Lu Yuan , Min Sun

Recent hand-object interaction datasets show limited real object variability and rely on fitting the MANO parametric model to obtain groundtruth hand shapes. To go beyond these limitations and spur further research, we introduce the SHOWMe…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Anilkumar Swamy , Vincent Leroy , Philippe Weinzaepfel , Fabien Baradel , Salma Galaaoui , Romain Bregier , Matthieu Armando , Jean-Sebastien Franco , Gregory Rogez

The computer vision community has developed numerous techniques for digitally restoring true scene information from single-view degraded photographs, an important yet extremely ill-posed task. In this work, we tackle image restoration from…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yucheng Mao , Boyang Wang , Nilesh Kulkarni , Jeong Joon Park

There is some ambiguity in the 3D shape of an object when the number of observed views is small. Because of this ambiguity, although a 3D object reconstructor can be trained using a single view or a few views per object, reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2019-04-01 Hiroharu Kato , Tatsuya Harada

Bird-eye-view (BEV) based methods have made great progress recently in multi-view 3D detection task. Comparing with BEV based methods, sparse based methods lag behind in performance, but still have lots of non-negligible merits. To push…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Xuewu Lin , Tianwei Lin , Zixiang Pei , Lichao Huang , Zhizhong Su

Efficient and accurate 3D object shape reconstruction contributes significantly to the success of a robot's physical interaction with its environment. Acquiring accurate shape information about unknown objects is challenging, especially in…

Robotics · Computer Science 2023-08-02 Yiting Chen , Ahmet Ercan Tekden , Marc Peter Deisenroth , Yasemin Bekiroglu

We present a unified framework for understanding 3D hand and object interactions in raw image sequences from egocentric RGB cameras. Given a single RGB image, our model jointly estimates the 3D hand and object poses, models their…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Bugra Tekin , Federica Bogo , Marc Pollefeys

Existing methods for 3D tracking from monocular RGB videos predominantly consider articulated and rigid objects. Modelling dense non-rigid object deformations in this setting remained largely unaddressed so far, although such effects can…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Soshi Shimada , Vladislav Golyanik , Patrick Pérez , Christian Theobalt

Recently there has been a growing interest in category-level object pose and size estimation, and prevailing methods commonly rely on single view RGB-D images. However, one disadvantage of such methods is that they require accurate depth…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Jiaqi Yang , Yucong Chen , Xiangting Meng , Chenxin Yan , Min Li , Ran Cheng , Lige Liu , Tao Sun , Laurent Kneip

Accurate 3D reconstruction of the hand and object shape from a hand-object image is important for understanding human-object interaction as well as human daily activities. Different from bare hand pose estimation, hand-object interaction…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Yujin Chen , Zhigang Tu , Di Kang , Ruizhi Chen , Linchao Bao , Zhengyou Zhang , Junsong Yuan

While object reconstruction has made great strides in recent years, current methods typically require densely captured images and/or known camera poses, and generalize poorly to novel object categories. To step toward object reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Hanwen Jiang , Zhenyu Jiang , Kristen Grauman , Yuke Zhu

Accurate 6D object pose estimation is vital for robotics, augmented reality, and scene understanding. For seen objects, high accuracy is often attainable via per-object fine-tuning but generalizing to unseen objects remains a challenge. To…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Sajjad Pakdamansavoji , Yintao Ma , Amir Rasouli , Tongtong Cao

Recent years have seen the development of mature solutions for reconstructing deformable surfaces from a single image, provided that they are relatively well-textured. By contrast, recovering the 3D shape of texture-less surfaces remains an…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Jan Bednařík , Pascal Fua , Mathieu Salzmann

Object reconstruction is relevant for many autonomous robotic tasks that require interaction with the environment. A key challenge in such scenarios is planning view configurations to collect informative measurements for reconstructing an…

Robotics · Computer Science 2024-09-17 Sicong Pan , Liren Jin , Xuying Huang , Cyrill Stachniss , Marija Popović , Maren Bennewitz

We learn a self-supervised, single-view 3D reconstruction model that predicts the 3D mesh shape, texture and camera pose of a target object with a collection of 2D images and silhouettes. The proposed method does not necessitate 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Xueting Li , Sifei Liu , Kihwan Kim , Shalini De Mello , Varun Jampani , Ming-Hsuan Yang , Jan Kautz

This paper presents a neural architecture MVDiffusion++ for 3D object reconstruction that synthesizes dense and high-resolution views of an object given one or a few images without camera poses. MVDiffusion++ achieves superior flexibility…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Shitao Tang , Jiacheng Chen , Dilin Wang , Chengzhou Tang , Fuyang Zhang , Yuchen Fan , Vikas Chandra , Yasutaka Furukawa , Rakesh Ranjan

We present NeRSP, a Neural 3D reconstruction technique for Reflective surfaces with Sparse Polarized images. Reflective surface reconstruction is extremely challenging as specular reflections are view-dependent and thus violate the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Yufei Han , Heng Guo , Koki Fukai , Hiroaki Santo , Boxin Shi , Fumio Okura , Zhanyu Ma , Yunpeng Jia

Recent monocular 3D shape reconstruction methods have shown promising zero-shot results on object-segmented images without any occlusions. However, their effectiveness is significantly compromised in real-world conditions, due to imperfect…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Junhyeong Cho , Kim Youwang , Hunmin Yang , Tae-Hyun Oh