English
Related papers

Related papers: HexPlane: A Fast Representation for Dynamic Scenes

200 papers

Recently, Neural Radiance Fields (NeRF) is revolutionizing the task of novel view synthesis (NVS) for its superior performance. In this paper, we propose to synthesize dynamic scenes. Extending the methods for static scenes to dynamic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Xiang Guo , Guanying Chen , Yuchao Dai , Xiaoqing Ye , Jiadai Sun , Xiao Tan , Errui Ding

Neural Radiance Fields (NeRF) has been wildly applied to various tasks for its high-quality representation of 3D scenes. It takes long per-scene training time and per-image testing time. In this paper, we present EfficientNeRF as an…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Tao Hu , Shu Liu , Yilun Chen , Tiancheng Shen , Jiaya Jia

Accurately and efficiently modeling dynamic scenes and motions is considered so challenging a task due to temporal dynamics and motion complexity. To address these challenges, we propose DynMF, a compact and efficient representation that…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Agelos Kratimenos , Jiahui Lei , Kostas Daniilidis

Learning-based 3D reconstruction using implicit neural representations has shown promising progress not only at the object level but also in more complicated scenes. In this paper, we propose Dynamic Plane Convolutional Occupancy Networks,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Stefan Lionar , Daniil Emtsev , Dusan Svilarkovic , Songyou Peng

Novel view synthesis from an in-the-wild video is difficult due to challenges like scene dynamics and lack of parallax. While existing methods have shown promising results with implicit neural radiance fields, they are slow to train and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Yao-Chih Lee , Zhoutong Zhang , Kevin Blackburn-Matzen , Simon Niklaus , Jianming Zhang , Jia-Bin Huang , Feng Liu

Rendering photo-realistic novel-view images of complex scenes has been a long-standing challenge in computer graphics. In recent years, great research progress has been made on enhancing rendering quality and accelerating rendering speed in…

Graphics · Computer Science 2024-02-21 Tiansong Zhou , Yebin Liu , Xuangeng Chu , Chengkun Cao , Changyin Zhou , Fei Yu , Yu Li

Driven by the appealing properties of neural fields for storing and communicating 3D data, the problem of directly processing them to address tasks such as classification and part segmentation has emerged and has been investigated in recent…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Adriano Cardace , Pierluigi Zama Ramirez , Francesco Ballerini , Allan Zhou , Samuele Salti , Luigi Di Stefano

Despite the impressive progress of telepresence systems for room-scale scenes with static and dynamic scene entities, expanding their capabilities to scenarios with larger dynamic environments beyond a fixed size of a few square-meters…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Leif Van Holland , Patrick Stotko , Stefan Krumpen , Reinhard Klein , Michael Weinmann

Urban scene generation has been developing rapidly recently. However, existing methods primarily focus on generating static and single-frame scenes, overlooking the inherently dynamic nature of real-world driving environments. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Hengwei Bian , Lingdong Kong , Haozhe Xie , Liang Pan , Yu Qiao , Ziwei Liu

3D rendering of dynamic face captures is a challenging problem, and it demands improvements on several fronts$\unicode{x2014}$photorealism, efficiency, compatibility, and configurability. We present a novel representation that enables…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Safa C. Medin , Gengyan Li , Ruofei Du , Stephan Garbin , Philip Davidson , Gregory W. Wornell , Thabo Beeler , Abhimitra Meka

We present a new method for generating realistic and view-consistent images with fine geometry from 2D image collections. Our method proposes a hybrid explicit-implicit representation called \textbf{OrthoPlanes}, which encodes fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Honglin He , Zhuoqian Yang , Shikai Li , Bo Dai , Wayne Wu

Intraoperative imaging techniques for reconstructing deformable tissues in vivo are pivotal for advanced surgical systems. Existing methods either compromise on rendering quality or are excessively computationally intensive, often demanding…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Chen Yang , Kailing Wang , Yuehao Wang , Qi Dou , Xiaokang Yang , Wei Shen

While the voxel-based methods have achieved promising results for multi-person 3D pose estimation from multi-cameras, they suffer from heavy computation burdens, especially for large scenes. We present Faster VoxelPose to address the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Hang Ye , Wentao Zhu , Chunyu Wang , Rujie Wu , Yizhou Wang

Tri-plane-like representations have been widely adopted in 3D-aware GANs for head image synthesis and other 3D object/scene modeling tasks due to their efficiency. However, querying features via Cartesian coordinate projection often leads…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Heyuan Li , Kenkun Liu , Lingteng Qiu , Qi Zuo , Keru Zheng , Zilong Dong , Xiaoguang Han

Although 3D Gaussian Splatting (3D-GS) achieves efficient rendering for novel view synthesis, extending it to dynamic scenes still results in substantial memory overhead from replicating Gaussians across frames. To address this challenge,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Chun-Tin Wu , Jun-Cheng Chen

Recent advances in large vision-language models (VLMs) have shown significant promise for 3D scene understanding. Existing VLM-based approaches typically align 3D scene features with the VLM's embedding space. However, this implicit…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Chen Li , Eric Peh , Basura Fernando

Neural volumetric representations have become a widely adopted model for radiance fields in 3D scenes. These representations are fully implicit or hybrid function approximators of the instantaneous volumetric radiance in a scene, which are…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Yuval Bahat , Yuxuan Zhang , Hendrik Sommerhoff , Andreas Kolb , Felix Heide

Learning object-centric representations from unsupervised videos is challenging. Unlike most previous approaches that focus on decomposing 2D images, we present a 3D generative model named DynaVol-S for dynamic scenes that enables…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Yanpeng Zhao , Yiwei Hao , Siyu Gao , Yunbo Wang , Xiaokang Yang

Feature representation plays a crucial role in visual correspondence, and recent methods for image matching resort to deeply stacked convolutional layers. These models, however, are both monolithic and static in the sense that they…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Juhong Min , Jongmin Lee , Jean Ponce , Minsu Cho

We introduce k-planes, a white-box model for radiance fields in arbitrary dimensions. Our model uses d choose 2 planes to represent a d-dimensional scene, providing a seamless way to go from static (d=3) to dynamic (d=4) scenes. This planar…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Sara Fridovich-Keil , Giacomo Meanti , Frederik Warburg , Benjamin Recht , Angjoo Kanazawa