English
Related papers

Related papers: Tactile-Augmented Radiance Fields

200 papers

Neural radiance field (NeRF) attracts attention as a promising approach to reconstructing the 3D scene. As NeRF emerges, subsequent studies have been conducted to model dynamic scenes, which include motions or topological changes. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Hankyu Jang , Daeyoung Kim

The images captured by vision-based tactile sensors carry information about high-resolution tactile fields, such as the distribution of the contact forces applied to their soft sensing surface. However, extracting the information encoded in…

Robotics · Computer Science 2021-10-01 Carmelo Sferrazza , Raffaello D'Andrea

Neural Radiance Fields (NeRF) achieve impressive view synthesis results for a variety of capture settings, including 360 capture of bounded scenes and forward-facing capture of bounded and unbounded scenes. NeRF fits multi-layer perceptrons…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Kai Zhang , Gernot Riegler , Noah Snavely , Vladlen Koltun

Tactile sensing has proven to be an invaluable tool for enhancing robotic perception, particularly in scenarios where visual data is limited or unavailable. However, traditional methods for pose estimation using tactile data often rely on…

Robotics · Computer Science 2024-09-24 Jose A. Eyzaguirre , Miquel Oller , Nima Fazeli

This review thoroughly examines the role of semantically-aware Neural Radiance Fields (NeRFs) in visual scene understanding, covering an analysis of over 250 scholarly papers. It explores how NeRFs adeptly infer 3D representations for both…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Thang-Anh-Quan Nguyen , Amine Bourki , Mátyás Macudzinski , Anthony Brunel , Mohammed Bennamoun

Creating artistic 3D scenes can be time-consuming and requires specialized knowledge. To address this, recent works such as ARF, use a radiance field-based approach with style constraints to generate 3D scenes that resemble a style image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Deheng Zhang , Clara Fernandez-Labrador , Christopher Schroers

Image blending aims to combine multiple images seamlessly. It remains challenging for existing 2D-based methods, especially when input images are misaligned due to differences in 3D camera poses and object shapes. To tackle these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Hyunsu Kim , Gayoung Lee , Yunjey Choi , Jin-Hwa Kim , Jun-Yan Zhu

Neural Radiance Fields (NeRF) are able to reconstruct scenes with unprecedented fidelity, and various recent works have extended NeRF to handle dynamic scenes. A common approach to reconstruct such non-rigid scenes is through the use of a…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Keunhong Park , Utkarsh Sinha , Peter Hedman , Jonathan T. Barron , Sofien Bouaziz , Dan B Goldman , Ricardo Martin-Brualla , Steven M. Seitz

We present FPRF, a feed-forward photorealistic style transfer method for large-scale 3D neural radiance fields. FPRF stylizes large-scale 3D scenes with arbitrary, multiple style reference images without additional optimization while…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 GeonU Kim , Kim Youwang , Tae-Hyun Oh

We present a novel approach for synthesizing realistic novel views using Neural Radiance Fields (NeRF) with uncontrolled photos in the wild. While NeRF has shown impressive results in controlled settings, it struggles with transient objects…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Shuaixian Wang , Haoran Xu , Yaokun Li , Jiwei Chen , Guang Tan

We propose a novel framework to reconstruct accurate appearance and geometry with neural radiance fields (NeRF) for interacting hands, enabling the rendering of photo-realistic images and videos for gesture animation from arbitrary views.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Zhiyang Guo , Wengang Zhou , Min Wang , Li Li , Houqiang Li

Haptic technology enhances interactive experiences by providing force and tactile feedback, improving user performance and immersion. However, despite advancements, creating tactile experiences still remains challenging due to device…

Human-Computer Interaction · Computer Science 2025-08-28 Tom Roy , Yann Glemarec , Gurvan Lecuyer , Quentin Galvane , Philippe Guillotel , Ferran Argelaguet

Neural Radiance Fields (NeRF) has been applied to various tasks related to representations of 3D scenes. Most studies based on NeRF have focused on a small object, while a few studies have tried to reconstruct large-scale scenes although…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Hinata Aoki , Takao Yamanaka

Modeling hand-object interactions is a fundamentally challenging task in 3D computer vision. Despite remarkable progress that has been achieved in this field, existing methods still fail to synthesize the hand-object interaction…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Zhongqun Zhang , Jifei Song , Eduardo Pérez-Pellitero , Yiren Zhou , Hyung Jin Chang , Aleš Leonardis

Neural radiance fields (NeRFs) are promising 3D representations for scenes, objects, and humans. However, most existing methods require multi-view inputs and per-scene training, which limits their real-life applications. Moreover, current…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Xuan Huang , Hanhui Li , Zejun Yang , Zhisheng Wang , Xiaodan Liang

This paper introduces a novel continual learning framework for synthesising novel views of multiple scenes, learning multiple 3D scenes incrementally, and updating the network parameters only with the training data of the upcoming new…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Yuze Wang , Junyi Wang , Chen Wang , Wantong Duan , Yongtang Bao , Yue Qi

We study active perception from first principles to argue that an autonomous agent performing active perception should maximize the mutual information that past observations posses about future ones. Doing so requires (a) a representation…

Robotics · Computer Science 2024-05-07 Siming He , Christopher D. Hsu , Dexter Ong , Yifei Simon Shao , Pratik Chaudhari

A Neural Radiance Field (NeRF) encodes the specific relation of 3D geometry and appearance of a scene. We here ask the question whether we can transfer the appearance from a source NeRF onto a target 3D geometry in a semantically meaningful…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Michael Fischer , Zhengqin Li , Thu Nguyen-Phuoc , Aljaz Bozic , Zhao Dong , Carl Marshall , Tobias Ritschel

We present Neural Articulated Radiance Field (NARF), a novel deformable 3D representation for articulated objects learned from images. While recent advances in 3D implicit representation have made it possible to learn models of complex…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Atsuhiro Noguchi , Xiao Sun , Stephen Lin , Tatsuya Harada

Neural Radiance Fields (NeRFs) are a powerful representation for modeling a 3D scene as a continuous function. Though NeRF is able to render complex 3D scenes with view-dependent effects, few efforts have been devoted to exploring its…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Yifan Jiang , Peter Hedman , Ben Mildenhall , Dejia Xu , Jonathan T. Barron , Zhangyang Wang , Tianfan Xue