中文
相关论文

相关论文: Tactile-Augmented Radiance Fields

200 篇论文

Neural radiance field (NeRF) attracts attention as a promising approach to reconstructing the 3D scene. As NeRF emerges, subsequent studies have been conducted to model dynamic scenes, which include motions or topological changes. However,…

计算机视觉与模式识别 · 计算机科学 2022-12-07 Hankyu Jang , Daeyoung Kim

The images captured by vision-based tactile sensors carry information about high-resolution tactile fields, such as the distribution of the contact forces applied to their soft sensing surface. However, extracting the information encoded in…

机器人学 · 计算机科学 2021-10-01 Carmelo Sferrazza , Raffaello D'Andrea

Neural Radiance Fields (NeRF) achieve impressive view synthesis results for a variety of capture settings, including 360 capture of bounded scenes and forward-facing capture of bounded and unbounded scenes. NeRF fits multi-layer perceptrons…

计算机视觉与模式识别 · 计算机科学 2020-10-23 Kai Zhang , Gernot Riegler , Noah Snavely , Vladlen Koltun

Tactile sensing has proven to be an invaluable tool for enhancing robotic perception, particularly in scenarios where visual data is limited or unavailable. However, traditional methods for pose estimation using tactile data often rely on…

机器人学 · 计算机科学 2024-09-24 Jose A. Eyzaguirre , Miquel Oller , Nima Fazeli

This review thoroughly examines the role of semantically-aware Neural Radiance Fields (NeRFs) in visual scene understanding, covering an analysis of over 250 scholarly papers. It explores how NeRFs adeptly infer 3D representations for both…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Thang-Anh-Quan Nguyen , Amine Bourki , Mátyás Macudzinski , Anthony Brunel , Mohammed Bennamoun

Creating artistic 3D scenes can be time-consuming and requires specialized knowledge. To address this, recent works such as ARF, use a radiance field-based approach with style constraints to generate 3D scenes that resemble a style image…

计算机视觉与模式识别 · 计算机科学 2024-04-24 Deheng Zhang , Clara Fernandez-Labrador , Christopher Schroers

Image blending aims to combine multiple images seamlessly. It remains challenging for existing 2D-based methods, especially when input images are misaligned due to differences in 3D camera poses and object shapes. To tackle these issues, we…

计算机视觉与模式识别 · 计算机科学 2023-08-17 Hyunsu Kim , Gayoung Lee , Yunjey Choi , Jin-Hwa Kim , Jun-Yan Zhu

Neural Radiance Fields (NeRF) are able to reconstruct scenes with unprecedented fidelity, and various recent works have extended NeRF to handle dynamic scenes. A common approach to reconstruct such non-rigid scenes is through the use of a…

计算机视觉与模式识别 · 计算机科学 2021-09-13 Keunhong Park , Utkarsh Sinha , Peter Hedman , Jonathan T. Barron , Sofien Bouaziz , Dan B Goldman , Ricardo Martin-Brualla , Steven M. Seitz

We present FPRF, a feed-forward photorealistic style transfer method for large-scale 3D neural radiance fields. FPRF stylizes large-scale 3D scenes with arbitrary, multiple style reference images without additional optimization while…

计算机视觉与模式识别 · 计算机科学 2024-01-12 GeonU Kim , Kim Youwang , Tae-Hyun Oh

We present a novel approach for synthesizing realistic novel views using Neural Radiance Fields (NeRF) with uncontrolled photos in the wild. While NeRF has shown impressive results in controlled settings, it struggles with transient objects…

计算机视觉与模式识别 · 计算机科学 2026-02-05 Shuaixian Wang , Haoran Xu , Yaokun Li , Jiwei Chen , Guang Tan

We propose a novel framework to reconstruct accurate appearance and geometry with neural radiance fields (NeRF) for interacting hands, enabling the rendering of photo-realistic images and videos for gesture animation from arbitrary views.…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Zhiyang Guo , Wengang Zhou , Min Wang , Li Li , Houqiang Li

Haptic technology enhances interactive experiences by providing force and tactile feedback, improving user performance and immersion. However, despite advancements, creating tactile experiences still remains challenging due to device…

人机交互 · 计算机科学 2025-08-28 Tom Roy , Yann Glemarec , Gurvan Lecuyer , Quentin Galvane , Philippe Guillotel , Ferran Argelaguet

Neural Radiance Fields (NeRF) has been applied to various tasks related to representations of 3D scenes. Most studies based on NeRF have focused on a small object, while a few studies have tried to reconstruct large-scale scenes although…

计算机视觉与模式识别 · 计算机科学 2023-07-18 Hinata Aoki , Takao Yamanaka

Modeling hand-object interactions is a fundamentally challenging task in 3D computer vision. Despite remarkable progress that has been achieved in this field, existing methods still fail to synthesize the hand-object interaction…

计算机视觉与模式识别 · 计算机科学 2024-02-12 Zhongqun Zhang , Jifei Song , Eduardo Pérez-Pellitero , Yiren Zhou , Hyung Jin Chang , Aleš Leonardis

Neural radiance fields (NeRFs) are promising 3D representations for scenes, objects, and humans. However, most existing methods require multi-view inputs and per-scene training, which limits their real-life applications. Moreover, current…

计算机视觉与模式识别 · 计算机科学 2024-01-03 Xuan Huang , Hanhui Li , Zejun Yang , Zhisheng Wang , Xiaodan Liang

This paper introduces a novel continual learning framework for synthesising novel views of multiple scenes, learning multiple 3D scenes incrementally, and updating the network parameters only with the training data of the upcoming new…

计算机视觉与模式识别 · 计算机科学 2024-09-10 Yuze Wang , Junyi Wang , Chen Wang , Wantong Duan , Yongtang Bao , Yue Qi

We study active perception from first principles to argue that an autonomous agent performing active perception should maximize the mutual information that past observations posses about future ones. Doing so requires (a) a representation…

机器人学 · 计算机科学 2024-05-07 Siming He , Christopher D. Hsu , Dexter Ong , Yifei Simon Shao , Pratik Chaudhari

A Neural Radiance Field (NeRF) encodes the specific relation of 3D geometry and appearance of a scene. We here ask the question whether we can transfer the appearance from a source NeRF onto a target 3D geometry in a semantically meaningful…

计算机视觉与模式识别 · 计算机科学 2024-02-15 Michael Fischer , Zhengqin Li , Thu Nguyen-Phuoc , Aljaz Bozic , Zhao Dong , Carl Marshall , Tobias Ritschel

We present Neural Articulated Radiance Field (NARF), a novel deformable 3D representation for articulated objects learned from images. While recent advances in 3D implicit representation have made it possible to learn models of complex…

计算机视觉与模式识别 · 计算机科学 2021-08-19 Atsuhiro Noguchi , Xiao Sun , Stephen Lin , Tatsuya Harada

Neural Radiance Fields (NeRFs) are a powerful representation for modeling a 3D scene as a continuous function. Though NeRF is able to render complex 3D scenes with view-dependent effects, few efforts have been devoted to exploring its…

计算机视觉与模式识别 · 计算机科学 2022-11-18 Yifan Jiang , Peter Hedman , Ben Mildenhall , Dejia Xu , Jonathan T. Barron , Zhangyang Wang , Tianfan Xue