English
Related papers

Related papers: In-Hand 3D Object Scanning from an RGB Sequence

200 papers

Feedforward monocular face capture methods seek to reconstruct posed faces from a single image of a person. Current state of the art approaches have the ability to regress parametric 3D face models in real-time across a wide range of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Kelian Baert , Shrisha Bharadwaj , Fabien Castan , Benoit Maujean , Marc Christie , Victoria Abrevaya , Adnane Boukhayma

Our work aims to obtain 3D reconstruction of hands and manipulated objects from monocular videos. Reconstructing hand-object manipulations holds a great potential for robotics and learning from human demonstrations. The supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Yana Hasson , Gül Varol , Ivan Laptev , Cordelia Schmid

In this paper, we study the problem of 3D scene geometry decomposition and manipulation from 2D views. By leveraging the recent implicit neural representation techniques, particularly the appealing neural radiance fields, we introduce an…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Bing Wang , Lu Chen , Bo Yang

We present the first method for real-time full body capture that estimates shape and motion of body and hands together with a dynamic 3D face model from a single color image. Our approach uses a new neural network architecture that exploits…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Yuxiao Zhou , Marc Habermann , Ikhsanul Habibie , Ayush Tewari , Christian Theobalt , Feng Xu

We present a new learning-based framework S-3D-RCNN that can recover accurate object orientation in SO(3) and simultaneously predict implicit rigid shapes from stereo RGB images. For orientation estimation, in contrast to previous studies…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Shichao Li , Xijie Huang , Zechun Liu , Kwang-Ting Cheng

Recent progress in human shape learning, shows that neural implicit models are effective in generating 3D human surfaces from limited number of views, and even from a single RGB image. However, existing monocular approaches still struggle…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Marco Pesavento , Yuanlu Xu , Nikolaos Sarafianos , Robert Maier , Ziyan Wang , Chun-Han Yao , Marco Volino , Edmond Boyer , Adrian Hilton , Tony Tung

Most model-free visual object tracking methods formulate the tracking task as object location estimation given by a 2D segmentation or a bounding box in each video frame. We argue that this representation is limited and instead propose to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Denys Rozumnyi , Jiri Matas , Marc Pollefeys , Vittorio Ferrari , Martin R. Oswald

The problem of identifying the 3D pose of a known object from a given 2D image has important applications in Computer Vision. Our proposed method of registering a 3D model of a known object on a given 2D photo of the object has numerous…

Computer Vision and Pattern Recognition · Computer Science 2013-12-02 Srimal Jayawardena , Marcus Hutter , Nathan Brewer

Monocular 3D object detection has recently shown promising results, however there remain challenging problems. One of those is the lack of invariance to different camera intrinsic parameters, which can be observed across different 3D object…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Jonas Heylen , Mark De Wolf , Bruno Dawagne , Marc Proesmans , Luc Van Gool , Wim Abbeloos , Hazem Abdelkawy , Daniel Olmeda Reino

This work presents a flexible system to reconstruct 3D models of objects captured with an RGB-D sensor. A major advantage of the method is that our reconstruction pipeline allows the user to acquire a full 3D model of the object. This is…

Computer Vision and Pattern Recognition · Computer Science 2015-05-22 Aitor Aldoma , Johann Prankl , Alexander Svejda , Markus Vincze

We propose a novel method for 3D object reconstruction from a sparse set of views captured from a 360-degree calibrated camera rig. We represent the object surface through a hybrid model that uses both an MLP-based neural representation and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Llukman Cerkezi , Paolo Favaro

We propose a novel framework for 3D hand shape reconstruction and hand-object grasp optimization from a single RGB image. The representation of hand-object contact regions is critical for accurate reconstructions. Instead of approximating…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Ziwei Yu , Linlin Yang , You Xie , Ping Chen , Angela Yao

This work addresses a novel and challenging problem of estimating the full 3D hand shape and pose from a single RGB image. Most current methods in 3D hand analysis from monocular RGB images only focus on estimating the 3D locations of hand…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Liuhao Ge , Zhou Ren , Yuncheng Li , Zehao Xue , Yingying Wang , Jianfei Cai , Junsong Yuan

Accurate object segmentation is a crucial task in the context of robotic manipulation. However, creating sufficient annotated training data for neural networks is particularly time consuming and often requires manual labeling. To this end,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-09 Wout Boerdijk , Martin Sundermeyer , Maximilian Durner , Rudolph Triebel

3D object detection is an important capability needed in various practical applications such as driver assistance systems. Monocular 3D detection, as a representative general setting among image-based approaches, provides a more economical…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Tai Wang , Xinge Zhu , Jiangmiao Pang , Dahua Lin

3D understanding and rendering of moving humans from monocular videos is a challenging task. Despite recent progress, the task remains difficult in real-world scenarios, where obstacles may block the camera view and cause partial occlusions…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Tiange Xiang , Adam Sun , Jiajun Wu , Ehsan Adeli , Li Fei-Fei

In this work, we address the challenging task of 3D object recognition without the reliance on real-world 3D labeled data. Our goal is to predict the 3D shape, size, and 6D pose of objects within a single RGB-D image, operating at the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Mayank Lunayach , Sergey Zakharov , Dian Chen , Rares Ambrus , Zsolt Kira , Muhammad Zubair Irshad

Recent advances in 3D deep learning have shown that it is possible to train highly effective deep models for 3D shape generation, directly from 2D images. This is particularly interesting since the availability of 3D models is still limited…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Shichen Liu , Shunsuke Saito , Weikai Chen , Hao Li

In this paper, we tackle the problem of active robotic 3D reconstruction of an object. In particular, we study how a mobile robot with an arm-held camera can select a favorable number of views to recover an object's 3D shape efficiently.…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Soomin Lee , Le Chen , Jiahao Wang , Alexander Liniger , Suryansh Kumar , Fisher Yu

Reconstructing detailed 3D scenes from single-view images remains a challenging task due to limitations in existing approaches, which primarily focus on geometric shape recovery, overlooking object appearances and fine shape details. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Yixin Chen , Junfeng Ni , Nan Jiang , Yaowei Zhang , Yixin Zhu , Siyuan Huang