中文
相关论文

相关论文: Voxel-Mesh Hybrid Representation for Real-Time Vie…

200 篇论文

We introduce Plenoxels (plenoptic voxels), a system for photorealistic view synthesis. Plenoxels represent a scene as a sparse 3D grid with spherical harmonics. This representation can be optimized from calibrated images via gradient…

计算机视觉与模式识别 · 计算机科学 2021-12-10 Alex Yu , Sara Fridovich-Keil , Matthew Tancik , Qinhong Chen , Benjamin Recht , Angjoo Kanazawa

Current 3D representations like meshes, voxels, point clouds, and NeRF-based neural implicit fields exhibit significant limitations: they are often task-specific, lacking universal applicability across reconstruction, generation, editing,…

图形学 · 计算机科学 2025-07-17 Tielong Wang , Yuxuan Xiong , Jinfan Liu , Zhifan Zhang , Ye Chen , Yue Shi , Bingbing Ni

The emerging Neural Radiance Field (NeRF) shows great potential in representing 3D scenes, which can render photo-realistic images from novel view with only sparse views given. However, utilizing NeRF to reconstruct real-world scenes…

计算机视觉与模式识别 · 计算机科学 2023-06-21 Chenbin Li , Yu Xin , Gaoyi Liu , Xiang Zeng , Ligang Liu

Voxels are a geometric representation used for rendering volumes, multi-resolution models, and indirect lighting effects. Since the memory consumption of uncompressed voxel volumes scales cubically with resolution, past works have…

图形学 · 计算机科学 2024-10-21 Russel Arbore , Jeffrey Liu , Aidan Wefel , Steven Gao , Eric Shaffer

Incremental scene reconstruction is essential to the navigation in robotics. Most of the conventional methods typically make use of either TSDF (truncated signed distance functions) volume or neural networks to implicitly represent the…

机器人学 · 计算机科学 2024-04-30 Shaofan Liu , Junbo Chen , Jianke Zhu

Despite the promising results of multi-view reconstruction, the recent neural rendering-based methods, such as implicit surface rendering (IDR) and volume rendering (NeuS), not only incur a heavy computational burden on training but also…

计算机视觉与模式识别 · 计算机科学 2023-05-30 Yisu Zhang , Jianke Zhu , Lixiang Lin

Modeling dynamic scenes is important for many applications such as virtual reality and telepresence. Despite achieving unprecedented fidelity for novel view synthesis in dynamic scenes, existing methods based on Neural Radiance Fields…

计算机视觉与模式识别 · 计算机科学 2022-06-07 Jia-Wei Liu , Yan-Pei Cao , Weijia Mao , Wenqiao Zhang , David Junhao Zhang , Jussi Keppo , Ying Shan , Xiaohu Qie , Mike Zheng Shou

We present MVSNeRF, a novel neural rendering approach that can efficiently reconstruct neural radiance fields for view synthesis. Unlike prior works on neural radiance fields that consider per-scene optimization on densely captured images,…

计算机视觉与模式识别 · 计算机科学 2021-08-25 Anpei Chen , Zexiang Xu , Fuqiang Zhao , Xiaoshuai Zhang , Fanbo Xiang , Jingyi Yu , Hao Su

High-quality view synthesis relies on volume rendering, splatting, or surface rendering. While surface rendering is typically the fastest, it struggles to accurately model fuzzy geometry like hair. In turn, alpha-blending techniques excel…

This paper presents a neural rendering method for controllable portrait video synthesis. Recent advances in volumetric neural rendering, such as neural radiance fields (NeRF), has enabled the photorealistic novel view synthesis of static…

计算机视觉与模式识别 · 计算机科学 2021-08-12 ShahRukh Athar , Zhixin Shu , Dimitris Samaras

Neural Radiance Fields (NeRF) has achieved unprecedented view synthesis quality using coordinate-based neural scene representations. However, NeRF's view dependency can only handle simple reflections like highlights but cannot deal with…

计算机视觉与模式识别 · 计算机科学 2022-04-07 Yuan-Chen Guo , Di Kang , Linchao Bao , Yu He , Song-Hai Zhang

Photorealistic rendering of dynamic humans is an important ability for telepresence systems, virtual shopping, synthetic data generation, and more. Recently, neural rendering methods, which combine techniques from computer graphics and…

计算机视觉与模式识别 · 计算机科学 2020-12-21 Ziyan Wang , Timur Bagautdinov , Stephen Lombardi , Tomas Simon , Jason Saragih , Jessica Hodgins , Michael Zollhöfer

We present a neural rendering framework that maps a voxelized scene into a high quality image. Highly-textured objects and scene element interactions are realistically rendered by our method, despite having a rough representation as an…

计算机视觉与模式识别 · 计算机科学 2020-04-07 Konstantinos Rematas , Vittorio Ferrari

We present PVSeRF, a learning framework that reconstructs neural radiance fields from single-view RGB images, for novel view synthesis. Previous solutions, such as pixelNeRF, rely only on pixel-aligned features and suffer from feature…

计算机视觉与模式识别 · 计算机科学 2022-02-11 Xianggang Yu , Jiapeng Tang , Yipeng Qin , Chenghong Li , Linchao Bao , Xiaoguang Han , Shuguang Cui

Neural Radiance Fields (NeRF) is a revolutionary approach for rendering scenes by sampling a single ray per pixel and it has demonstrated impressive capabilities in novel-view synthesis from static scene images. However, in practice, we…

计算机视觉与模式识别 · 计算机科学 2023-08-16 Yifan Yang , Shuhai Zhang , Zixiong Huang , Yubing Zhang , Mingkui Tan

Neural radiance fields (NeRFs) produce state-of-the-art view synthesis results. However, they are slow to render, requiring hundreds of network evaluations per pixel to approximate a volume rendering integral. Baking NeRFs into explicit…

计算机视觉与模式识别 · 计算机科学 2022-05-11 Benjamin Attal , Jia-Bin Huang , Michael Zollhoefer , Johannes Kopf , Changil Kim

While neural radiance fields (NeRF) have shown promise in novel view synthesis, their implicit representation limits explicit control over object manipulation. Existing research has proposed the integration of explicit geometric proxies to…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Zherui Qiu , Chenqu Ren , Kaiwen Song , Xiaoyi Zeng , Leyuan Yang , Juyong Zhang

Neural Radiance Field (NeRF) has shown impressive results in novel view synthesis, particularly in Virtual Reality (VR) and Augmented Reality (AR), thanks to its ability to represent scenes continuously. However, when just a few input view…

计算机视觉与模式识别 · 计算机科学 2024-02-27 Hanxin Zhu , Tianyu He , Zhibo Chen

State-of-the-art 3D-aware generative models rely on coordinate-based MLPs to parameterize 3D radiance fields. While demonstrating impressive results, querying an MLP for every sample along each ray leads to slow rendering. Therefore,…

计算机视觉与模式识别 · 计算机科学 2022-11-11 Katja Schwarz , Axel Sauer , Michael Niemeyer , Yiyi Liao , Andreas Geiger

Multi-View Stereo (MVS) is a core task in 3D computer vision. With the surge of novel deep learning methods, learned MVS has surpassed the accuracy of classical approaches, but still relies on building a memory intensive dense cost volume.…

计算机视觉与模式识别 · 计算机科学 2022-06-16 Radu Alexandru Rosu , Sven Behnke