English
Related papers

Related papers: 3D Keypoint Estimation Using Implicit Representati…

200 papers

Occlusion poses a great threat to monocular multi-person 3D human pose estimation due to large variability in terms of the shape, appearance, and position of occluders. While existing methods try to handle occlusion with pose…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Qihao Liu , Yi Zhang , Song Bai , Alan Yuille

Learning local descriptors is an important problem in computer vision. While there are many techniques for learning local patch descriptors for 2D images, recently efforts have been made for learning local descriptors for 3D points. The…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Siddharth Srivastava , Brejesh Lall

Estimating the 3D pose of a hand from a 2D image is a well-studied problem and a requirement for several real-life applications such as virtual reality, augmented reality, and hand gesture recognition. Currently, reasonable estimations can…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Danilo Avola , Luigi Cinque , Alessio Fagioli , Gian Luca Foresti , Adriano Fragomeni , Daniele Pannone

Recent advances in localized implicit functions have enabled neural implicit representation to be scalable to large scenes. However, the regular subdivision of 3D space employed by these approaches fails to take into account the sparsity of…

Graphics · Computer Science 2021-11-02 Jia-Heng Tang , Weikai Chen , Jie Yang , Bo Wang , Songrun Liu , Bo Yang , Lin Gao

We present implicit displacement fields, a novel representation for detailed 3D geometry. Inspired by a classic surface deformation technique, displacement mapping, our method represents a complex surface as a smooth base surface plus a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-03 Wang Yifan , Lukas Rahmann , Olga Sorkine-Hornung

3D data is a valuable asset the computer vision filed as it provides rich information about the full geometry of sensed objects and scenes. Recently, with the availability of both large 3D datasets and computational power, it is today…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Eman Ahmed , Alexandre Saint , Abd El Rahman Shabayek , Kseniya Cherenkova , Rig Das , Gleb Gusev , Djamila Aouada , Bjorn Ottersten

We tackle the task of scalable unsupervised object-centric representation learning on 3D scenes. Existing approaches to object-centric representation learning show limitations in generalizing to larger scenes as their learning processes…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Tianyu Wang , Kee Siong Ng , Miaomiao Liu

Implicit functions represented as deep learning approximations are powerful for reconstructing 3D surfaces. However, they can only produce static surfaces that are not controllable, which provides limited ability to modify the resulting…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Bharat Lal Bhatnagar , Cristian Sminchisescu , Christian Theobalt , Gerard Pons-Moll

We characterize the problem of pose estimation for rigid objects in terms of determining viewpoint to explain coarse pose and keypoint prediction to capture the finer details. We address both these tasks in two different settings - the…

Computer Vision and Pattern Recognition · Computer Science 2015-04-28 Shubham Tulsiani , Jitendra Malik

Human is able to conduct 3D recognition by a limited number of haptic contacts between the target object and his/her fingers without seeing the object. This capability is defined as `haptic glance' in cognitive neuroscience. Most of the…

Artificial Intelligence · Computer Science 2021-02-16 Kevin Riou , Suiyi Ling , Guillaume Gallot , Patrick Le Callet

Recent development of neural implicit function has shown tremendous success on high-quality 3D shape reconstruction. However, most works divide the space into inside and outside of the shape, which limits their representing power to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Jianglong Ye , Yuntao Chen , Naiyan Wang , Xiaolong Wang

Implicit neural representations have shown promising potential for the 3D scene reconstruction. Recent work applies it to autonomous 3D reconstruction by learning information gain for view path planning. Effective as it is, the computation…

Robotics · Computer Science 2022-09-28 Jing Zeng , Yanxu Li , Yunlong Ran , Shuo Li , Fei Gao , Lincheng Li , Shibo He , Jiming chen , Qi Ye

Neural signed distance functions (SDFs) are emerging as an effective representation for 3D shapes. State-of-the-art methods typically encode the SDF with a large, fixed-size neural network to approximate complex shapes with implicit…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Towaki Takikawa , Joey Litalien , Kangxue Yin , Karsten Kreis , Charles Loop , Derek Nowrouzezahrai , Alec Jacobson , Morgan McGuire , Sanja Fidler

Learning implicit representations has been a widely used solution for surface reconstruction from 3D point clouds. The latest methods infer a distance or occupancy field by overfitting a neural network on a single point cloud. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Chao Chen , Yu-Shen Liu , Zhizhong Han

We present KDFNet, a novel method for 6D object pose estimation from RGB images. To handle occlusion, many recent works have proposed to localize 2D keypoints through pixel-wise voting and solve a Perspective-n-Point (PnP) problem for pose…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Xingyu Liu , Shun Iwase , Kris M. Kitani

We propose a system that learns to detect objects and infer their 3D poses in RGB-D images. Many existing systems can identify objects and infer 3D poses, but they heavily rely on human labels and 3D annotations. The challenge here is to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Mihir Prabhudesai , Shamit Lal , Hsiao-Yu Fish Tung , Adam W. Harley , Shubhankar Potdar , Katerina Fragkiadaki

We present an unsupervised approach for learning to estimate three dimensional (3D) facial structure from a single image while also predicting 3D viewpoint transformations that match a desired pose and facial geometry. We achieve this by…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Joel Ruben Antony Moniz , Christopher Beckham , Simon Rajotte , Sina Honari , Christopher Pal

We introduce a new implicit shape representation called Primary Ray-based Implicit Function (PRIF). In contrast to most existing approaches based on the signed distance function (SDF) which handles spatial locations, our representation…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Brandon Yushan Feng , Yinda Zhang , Danhang Tang , Ruofei Du , Amitabh Varshney

Deep implicit functions have shown remarkable shape modeling ability in various 3D computer vision tasks. One drawback is that it is hard for them to represent a 3D shape as multiple parts. Current solutions learn various primitives and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Chao Chen , Yu-Shen Liu , Zhizhong Han

We propose a novel unsupervised object localization method that allows us to explain the predictions of the model by utilizing self-supervised pre-trained models without additional finetuning. Existing unsupervised and self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Yeonghwan Song , Seokwoo Jang , Dina Katabi , Jeany Son