中文
相关论文

相关论文: Neural Fields in Robotics: A Survey

200 篇论文

Neural fields have emerged as a new paradigm for representing signals, thanks to their ability to do it compactly while being easy to optimize. In most applications, however, neural fields are treated like black boxes, which precludes many…

计算机视觉与模式识别 · 计算机科学 2023-02-10 Guandao Yang , Sagie Benaim , Varun Jampani , Kyle Genova , Jonathan T. Barron , Thomas Funkhouser , Bharath Hariharan , Serge Belongie

Implicit Neural Representations (INRs) have emerged as a paradigm in knowledge representation, offering exceptional flexibility and performance across a diverse range of applications. INRs leverage multilayer perceptrons (MLPs) to model…

计算机视觉与模式识别 · 计算机科学 2025-02-19 Amer Essakine , Yanqi Cheng , Chun-Wun Cheng , Lipei Zhang , Zhongying Deng , Lei Zhu , Carola-Bibiane Schönlieb , Angelica I Aviles-Rivero

We present a method to map 2D image observations of a scene to a persistent 3D scene representation, enabling novel view synthesis and disentangled representation of the movable and immovable components of the scene. Motivated by the…

Neural Radiance Fields (NeRFs) have become a rapidly growing research field with the potential to revolutionize typical photogrammetric workflows, such as those used for 3D scene reconstruction. As input, NeRFs require multi-view images…

计算机视觉与模式识别 · 计算机科学 2024-05-08 Markus Hillemann , Robert Langendörfer , Max Heiken , Max Mehltretter , Andreas Schenk , Martin Weinmann , Stefan Hinz , Christian Heipke , Markus Ulrich

Neural distance fields (NDF) have emerged as a powerful tool for addressing challenges in 3D computer vision and graphics downstream problems. While significant progress has been made to learn NDF from various kind of sensor data, a crucial…

计算机视觉与模式识别 · 计算机科学 2024-12-23 Akshit Singh , Karan Bhakuni , Rajendra Nagar

Neural Radiance Fields (NeRFs) provide a high fidelity, continuous scene representation that can realistically represent complex behaviour of light. Despite works like Ref-NeRF improving geometry through physics-inspired models, the ability…

计算机视觉与模式识别 · 计算机科学 2025-07-22 Jack Naylor , Viorela Ila , Donald G. Dansereau

Reconstruction and intrinsic decomposition of scenes from captured imagery would enable many applications such as relighting and virtual object insertion. Recent NeRF based methods achieve impressive fidelity of 3D reconstruction, but bake…

计算机视觉与模式识别 · 计算机科学 2023-04-07 Zian Wang , Tianchang Shen , Jun Gao , Shengyu Huang , Jacob Munkberg , Jon Hasselgren , Zan Gojcic , Wenzheng Chen , Sanja Fidler

We present a novel type of neural fields that uses general radial bases for signal representation. State-of-the-art neural fields typically rely on grid-based representations for storing local neural features and N-dimensional linear…

计算机视觉与模式识别 · 计算机科学 2023-09-28 Zhang Chen , Zhong Li , Liangchen Song , Lele Chen , Jingyi Yu , Junsong Yuan , Yi Xu

Despite the growing availability of 3D urban datasets, extracting insights remains challenging due to computational bottlenecks and the complexity of interacting with data. In fact, the intricate geometry of 3D urban environments results in…

计算机视觉与模式识别 · 计算机科学 2025-11-19 Stefan Cobeli , Kazi Shahrukh Omar , Rodrigo Valença , Nivan Ferreira , Fabio Miranda

Photo-realistic free-viewpoint rendering of real-world scenes using classical computer graphics techniques is challenging, because it requires the difficult step of capturing detailed appearance and geometry models. Recent studies have…

计算机视觉与模式识别 · 计算机科学 2021-01-08 Lingjie Liu , Jiatao Gu , Kyaw Zaw Lin , Tat-Seng Chua , Christian Theobalt

In the realm of digital situational awareness during disaster situations, accurate digital representations, like 3D models, play an indispensable role. To ensure the safety of rescue teams, robotic platforms are often deployed to generate…

计算机视觉与模式识别 · 计算机科学 2024-01-15 Hartmut Surmann , Niklas Digakis , Jan-Nicklas Kremer , Julien Meine , Max Schulte , Niklas Voigt

Neural fields have emerged as a new data representation paradigm and have shown remarkable success in various signal representations. Since they preserve signals in their network parameters, the data transfer by sending and receiving the…

计算机视觉与模式识别 · 计算机科学 2022-07-21 Junwoo Cho , Seungtae Nam , Daniel Rho , Jong Hwan Ko , Eunbyung Park

We introduce Neural Radiance and Gaze Fields (NeRGs), a novel approach for representing visual attention in complex environments. Much like how Neural Radiance Fields (NeRFs) perform novel view synthesis, NeRGs reconstruct gaze patterns…

计算机视觉与模式识别 · 计算机科学 2025-12-04 Andrei Chubarau , Yinan Wang , James J. Clark

Utilizing multi-view inputs to synthesize novel-view images, Neural Radiance Fields (NeRF) have emerged as a popular research topic in 3D vision. In this work, we introduce a Generalizable Semantic Neural Radiance Field (GSNeRF), which…

计算机视觉与模式识别 · 计算机科学 2024-03-07 Zi-Ting Chou , Sheng-Yu Huang , I-Jieh Liu , Yu-Chiang Frank Wang

Neural Radiance Fields (NeRF) is an emerging technique to synthesize 3D objects from 2D images with a wide range of potential applications. However, rendering existing NeRF models is extremely computation intensive, making it challenging to…

分布式、并行与集群计算 · 计算机科学 2024-06-25 Zhe Wang , Yifei Zhu

We present Visual-Language Fields (VL-Fields), a neural implicit spatial representation that enables open-vocabulary semantic queries. Our model encodes and fuses the geometry of a scene with vision-language trained latent features by…

计算机视觉与模式识别 · 计算机科学 2023-05-26 Nikolaos Tsagkas , Oisin Mac Aodha , Chris Xiaoxuan Lu

Neural radiance fields (NeRFs) have become a ubiquitous tool for modeling scene appearance and geometry from multiview imagery. Recent work has also begun to explore how to use additional supervision from lidar or depth sensor measurements…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Anagh Malik , Parsa Mirdehghan , Sotiris Nousias , Kiriakos N. Kutulakos , David B. Lindell

Neural Radiance Fields (NeRF) is a novel implicit 3D reconstruction method that shows immense potential and has been gaining increasing attention. It enables the reconstruction of 3D scenes solely from a set of photographs. However, its…

计算机视觉与模式识别 · 计算机科学 2023-10-23 Jiaming Gu , Minchao Jiang , Hongsheng Li , Xiaoyuan Lu , Guangming Zhu , Syed Afaq Ali Shah , Liang Zhang , Mohammed Bennamoun

Neural Radiance Fields (NeRFs) have emerged as promising tools for advancing autonomous driving (AD) research, offering scalable closed-loop simulation and data augmentation capabilities. However, to trust the results achieved in…

计算机视觉与模式识别 · 计算机科学 2024-04-16 Carl Lindström , Georg Hess , Adam Lilja , Maryam Fatemi , Lars Hammarstrand , Christoffer Petersson , Lennart Svensson

Neural Radiance Fields (NeRFs) have emerged as a popular approach for novel view synthesis. While NeRFs are quickly being adapted for a wider set of applications, intuitively editing NeRF scenes is still an open challenge. One important…