中文
相关论文

相关论文: Tactile-Augmented Radiance Fields

200 篇论文

Neural Radiance Field (NeRF) has recently emerged as a powerful representation to synthesize photorealistic novel views. While showing impressive performance, it relies on the availability of dense input views with highly accurate camera…

计算机视觉与模式识别 · 计算机科学 2023-06-14 Prune Truong , Marie-Julie Rakotosaona , Fabian Manhardt , Federico Tombari

A neural radiance field (NeRF) is a scene model supporting high-quality view synthesis, optimized per scene. In this paper, we explore enabling user editing of a category-level NeRF - also known as a conditional radiance field - trained on…

计算机视觉与模式识别 · 计算机科学 2021-06-07 Steven Liu , Xiuming Zhang , Zhoutong Zhang , Richard Zhang , Jun-Yan Zhu , Bryan Russell

Neural Radiances Fields (NeRF) and their extensions have shown great success in representing 3D scenes and synthesizing novel-view images. However, most NeRF methods take in low-dynamic-range (LDR) images, which may lose details, especially…

计算机视觉与模式识别 · 计算机科学 2024-01-12 Guanjun Wu , Taoran Yi , Jiemin Fang , Wenyu Liu , Xinggang Wang

We use neural radiance fields (NeRFs) to build interactive 3D environments from large-scale visual captures spanning buildings or even multiple city blocks collected primarily from drones. In contrast to single object scenes (on which NeRFs…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Haithem Turki , Deva Ramanan , Mahadev Satyanarayanan

In the realm of digital situational awareness during disaster situations, accurate digital representations, like 3D models, play an indispensable role. To ensure the safety of rescue teams, robotic platforms are often deployed to generate…

计算机视觉与模式识别 · 计算机科学 2024-01-15 Hartmut Surmann , Niklas Digakis , Jan-Nicklas Kremer , Julien Meine , Max Schulte , Niklas Voigt

In rapidly-evolving domains such as autonomous driving, the use of multiple sensors with different modalities is crucial to ensure high operational precision and stability. To correctly exploit the provided information by each sensor in a…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Quentin Herau , Nathan Piasco , Moussab Bennehar , Luis Roldão , Dzmitry Tsishkou , Cyrille Migniot , Pascal Vasseur , Cédric Demonceaux

High-fidelity sensor simulation of light-based sensors such as cameras and LiDARs is critical for safe and accurate autonomy testing. Neural radiance field (NeRF)-based methods that reconstruct sensor observations via ray-casting of…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Yun Chen , Matthew Haines , Jingkang Wang , Sahil Jain , Krzysztof Baron-Lis , Sivabalan Manivasagam , Ze Yang , Raquel Urtasun

Neural implicit representation of visual scenes has attracted a lot of attention in recent research of computer vision and graphics. Most prior methods focus on how to reconstruct 3D scene representation from a set of images. In this work,…

计算机视觉与模式识别 · 计算机科学 2024-09-12 Wenpu Li , Pian Wan , Peng Wang , Jinghang Li , Yi Zhou , Peidong Liu

Advances in image diffusion models have recently led to notable improvements in the generation of high-quality images. In combination with Neural Radiance Fields (NeRFs), they enabled new opportunities in 3D generation. However, most…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Jan-Niklas Dihlmann , Andreas Engelhardt , Hendrik Lensch

Neural radiance fields (NeRF) bring a new wave for 3D interactive experiences. However, as an important part of the immersive experiences, the defocus effects have not been fully explored within NeRF. Some recent NeRF-based methods generate…

计算机视觉与模式识别 · 计算机科学 2022-08-11 Yinhuai Wang , Shuzhou Yang , Yujie Hu , Jian Zhang

We present a unified and compact scene representation for robotics, where each object in the scene is depicted by a latent code capturing geometry and appearance. This representation can be decoded for various tasks such as novel view…

机器人学 · 计算机科学 2023-08-10 Valts Blukis , Taeyeop Lee , Jonathan Tremblay , Bowen Wen , In So Kweon , Kuk-Jin Yoon , Dieter Fox , Stan Birchfield

We present neural radiance fields for rendering and temporal (4D) reconstruction of humans in motion (H-NeRF), as captured by a sparse set of cameras or even from a monocular video. Our approach combines ideas from neural scene…

计算机视觉与模式识别 · 计算机科学 2021-11-03 Hongyi Xu , Thiemo Alldieck , Cristian Sminchisescu

Neural radiance fields~(NeRF) have recently been applied to render large-scale scenes. However, their limited model capacity typically results in blurred rendering results. Existing large-scale NeRFs primarily address this limitation by…

计算机视觉与模式识别 · 计算机科学 2024-09-16 Mingqi Shao , Feng Xiong , Hang Zhang , Shuang Yang , Mu Xu , Wei Bian , Xueqian Wang

Neural Radiance Fields (NeRFs) have emerged as a popular approach for novel view synthesis. While NeRFs are quickly being adapted for a wider set of applications, intuitively editing NeRF scenes is still an open challenge. One important…

Purely MLP-based neural radiance fields (NeRF-based methods) often suffer from underfitting with blurred renderings on large-scale scenes due to limited model capacity. Recent approaches propose to geographically divide the scene and adopt…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Linning Xu , Yuanbo Xiangli , Sida Peng , Xingang Pan , Nanxuan Zhao , Christian Theobalt , Bo Dai , Dahua Lin

Radiance fields have been a major breakthrough in the field of inverse rendering, novel view synthesis and 3D modeling of complex scenes from multi-view image collections. Since their introduction, it was shown that they could be extended…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Thibaud Ehret , Roger Marí , Dawa Derksen , Nicolas Gasnier , Gabriele Facciolo

Deep generative models allow for photorealistic image synthesis at high resolutions. But for many applications, this is not enough: content creation also needs to be controllable. While several recent works investigate how to disentangle…

计算机视觉与模式识别 · 计算机科学 2021-04-30 Michael Niemeyer , Andreas Geiger

Rendering scenes with a high-quality human face from arbitrary viewpoints is a practical and useful technique for many real-world applications. Recently, Neural Radiance Fields (NeRF), a rendering technique that uses neural networks to…

计算机视觉与模式识别 · 计算机科学 2022-06-01 Satoshi Tsutsui , Weijia Mao , Sijing Lin , Yunyi Zhu , Murong Ma , Mike Zheng Shou

We propose DistillNeRF, a self-supervised learning framework addressing the challenge of understanding 3D environments from limited 2D observations in outdoor autonomous driving scenes. Our method is a generalizable feedforward model that…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Letian Wang , Seung Wook Kim , Jiawei Yang , Cunjun Yu , Boris Ivanovic , Steven L. Waslander , Yue Wang , Sanja Fidler , Marco Pavone , Peter Karkus

In this work, we propose a novel method to supervise 3D Gaussian Splatting (3DGS) scenes using optical tactile sensors. Optical tactile sensors have become widespread in their use in robotics for manipulation and object representation;…

机器人学 · 计算机科学 2024-08-19 Aiden Swann , Matthew Strong , Won Kyung Do , Gadiel Sznaier Camps , Mac Schwager , Monroe Kennedy