English
Related papers

Related papers: Neural Descriptor Fields: SE(3)-Equivariant Object…

200 papers

This paper presents a novel Learning from Demonstration (LfD) method that uses neural fields to learn new skills efficiently and accurately. It achieves this by utilizing a shared embedding to learn both scene and motion representations in…

Robotics · Computer Science 2023-08-16 Ahmet Tekden , Marc Peter Deisenroth , Yasemin Bekiroglu

Neural fields (NeRF) have emerged as a promising approach for representing continuous 3D scenes. Nevertheless, the lack of semantic encoding in NeRFs poses a significant challenge for scene decomposition. To address this challenge, we…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Ning Wang , Lefei Zhang , Angel X Chang

Dense reconstruction and differentiable rendering are fundamental tightly connected operations in 3D vision and computer graphics. Recent neural implicit representations demonstrate compelling advantages in reconstruction fidelity and…

Robotics · Computer Science 2026-05-25 Zhirui Dai , Hojoon Shin , Yulun Tian , Ki Myung Brian Lee , Nikolay Atanasov

Learned visual dynamics models have proven effective for robotic manipulation tasks. Yet, it remains unclear how best to represent scenes involving multi-object interactions. Current methods decompose a scene into discrete objects, but they…

The majority of descriptor-based methods for geometric processing of non-rigid shape rely on hand-crafted descriptors. Recently, learning-based techniques have been shown effective, achieving state-of-the-art results in a variety of tasks.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Zhangsihao Yang , Or Litany , Tolga Birdal , Srinath Sridhar , Leonidas Guibas

Coordinate-based implicit neural networks, or neural fields, have emerged as useful representations of shape and appearance in 3D computer vision. Despite advances, however, it remains challenging to build neural fields for categories of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Rohith Agaram , Shaurya Dewan , Rahul Sajnani , Adrien Poulenard , Madhava Krishna , Srinath Sridhar

Deep Implicit Functions (DIFs) represent 3D geometry with continuous signed distance functions learned through deep neural nets. Recently DIFs-based methods have been proposed to handle shape reconstruction and dense point correspondences…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Shanlin Sun , Kun Han , Deying Kong , Hao Tang , Xiangyi Yan , Xiaohui Xie

Neural fields, coordinate-based neural networks, have recently gained popularity for implicitly representing a scene. In contrast to classical methods that are based on explicit representations such as point clouds, neural fields provide a…

Robotics · Computer Science 2024-02-16 Stephen Hausler , David Hall , Sutharsan Mahendren , Peyman Moghadam

We present neural radiance fields (NeRF) with templates, dubbed Template-NeRF, for modeling appearance and geometry and generating dense shape correspondences simultaneously among objects of the same category from only multi-view posed…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Jianfei Guo , Zhiyuan Yang , Xi Lin , Qingfu Zhang

We present a solution for 3D object generation of ICCV 2023 OmniObject3D Challenge. In recent years, 3D object generation has made great process and achieved promising results, but it remains a challenging task due to the difficulty of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Zheyuan Yang , Yibo Liu , Guile Wu , Tongtong Cao , Yuan Ren , Yang Liu , Bingbing Liu

Estimating 6D poses and reconstructing 3D shapes of objects in open-world scenes from RGB-depth image pairs is challenging. Many existing methods rely on learning geometric features that correspond to specific templates while disregarding…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Haowen Wang , Zhipeng Fan , Zhen Zhao , Zhengping Che , Zhiyuan Xu , Dong Liu , Feifei Feng , Yakun Huang , Xiuquan Qiao , Jian Tang

Recent advances in Neural Radiance Fields (NeRF) boast impressive performances for generative tasks such as novel view synthesis and 3D reconstruction. Methods based on neural radiance fields are able to represent the 3D world implicitly by…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Jesus Zarzar , Sara Rojas , Silvio Giancola , Bernard Ghanem

One-shot transfer of dexterous grasps to novel scenes with object and context variations has been a challenging problem. While distilled feature fields from large vision models have enabled semantic correspondences across 3D scenes, their…

Object Pose Estimation is a crucial component in robotic grasping and augmented reality. Learning based approaches typically require training data from a highly accurate CAD model or labeled training data acquired using a complex setup. We…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Shishir Reddy Vutukur , Heike Brock , Benjamin Busam , Tolga Birdal , Andreas Hutter , Slobodan Ilic

We present a novel method, called NeuralUDF, for reconstructing surfaces with arbitrary topologies from 2D images via volume rendering. Recent advances in neural rendering based reconstruction have achieved compelling results. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Xiaoxiao Long , Cheng Lin , Lingjie Liu , Yuan Liu , Peng Wang , Christian Theobalt , Taku Komura , Wenping Wang

Recently, neural radiance fields (NeRF) have gained significant attention in the field of visual localization. However, existing NeRF-based approaches either lack geometric constraints or require extensive storage for feature matching,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Hongjia Zhai , Boming Zhao , Hai Li , Xiaokun Pan , Yijia He , Zhaopeng Cui , Hujun Bao , Guofeng Zhang

Neural distance fields (NDF) have emerged as a powerful tool for addressing challenges in 3D computer vision and graphics downstream problems. While significant progress has been made to learn NDF from various kind of sensor data, a crucial…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Akshit Singh , Karan Bhakuni , Rajendra Nagar

We propose a self-supervised training approach for learning view-invariant dense visual descriptors using image augmentations. Unlike existing works, which often require complex datasets, such as registered RGBD sequences, we train on an…

Visual localization to compute 6DoF camera pose from a given image has wide applications such as in robotics, virtual reality, augmented reality, etc. Two kinds of descriptors are important for the visual localization. One is global…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Pengju Zhang , Yihong Wu , Bingxi Liu

A human 3D avatar is one of the important elements in the metaverse, and the modeling effect directly affects people's visual experience. However, the human body has a complex topology and diverse details, so it is often expensive,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Mingyang Sun , Dingkang Yang , Dongliang Kou , Yang Jiang , Weihua Shan , Zhe Yan , Lihua Zhang