English
Related papers

Related papers: Consistent Instance Field for Dynamic Scene Unders…

200 papers

Reconstructing dynamic scenes from video sequences is a highly promising task in the multimedia domain. While previous methods have made progress, they often struggle with slow rendering and managing temporal complexities such as…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Jinbo Yan , Rui Peng , Luyang Tang , Ronggang Wang

Representing and rendering dynamic scenes has been an important but challenging task. Especially, to accurately model complex motions, high efficiency is usually hard to guarantee. To achieve real-time dynamic scene rendering while also…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Guanjun Wu , Taoran Yi , Jiemin Fang , Lingxi Xie , Xiaopeng Zhang , Wei Wei , Wenyu Liu , Qi Tian , Xinggang Wang

The field of 3D reconstruction from images has rapidly evolved in the past few years, first with the introduction of Neural Radiance Field (NeRF) and more recently with 3D Gaussian Splatting (3DGS). The latter provides a significant edge…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Avinash Paliwal , Wei Ye , Jinhui Xiong , Dmytro Kotovenko , Rakesh Ranjan , Vikas Chandra , Nima Khademi Kalantari

Novel view synthesis (NVS) of static and dynamic urban scenes is essential for autonomous driving simulation, yet existing methods often struggle to balance reconstruction time with quality. While state-of-the-art neural radiance fields and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Sheng Miao , Sijin Li , Pan Wang , Dongfeng Bai , Bingbing Liu , Yue Wang , Andreas Geiger , Yiyi Liao

The perception of moving objects is crucial for autonomous robots performing collision avoidance in dynamic environments. LiDARs and cameras tremendously enhance scene interpretation but do not provide direct motion information and face…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Matthias Zeller , Vardeep S. Sandhu , Benedikt Mersch , Jens Behley , Michael Heidingsfeld , Cyrill Stachniss

In domain generalization, the knowledge learnt from one or multiple source domains is transferred to an unseen target domain. In this work, we propose a novel domain generalization approach for fine-grained scene recognition. We first…

Computer Vision and Pattern Recognition · Computer Science 2016-07-27 Marian George , Mandar Dixit , Gábor Zogg , Nuno Vasconcelos

We introduce GAUDI, a generative model capable of capturing the distribution of complex and realistic 3D scenes that can be rendered immersively from a moving camera. We tackle this challenging problem with a scalable yet powerful approach,…

Egocentric scenes exhibit frequent occlusions, varied viewpoints, and dynamic interactions compared to typical scene understanding tasks. Occlusions and varied viewpoints can lead to multi-view semantic inconsistencies, while dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Di Li , Jie Feng , Jiahao Chen , Weisheng Dong , Guanbin Li , Guangming Shi , Licheng Jiao

Humans can perceive scenes in 3D from a handful of 2D views. For AI agents, the ability to recognize a scene from any viewpoint given only a few images enables them to efficiently interact with the scene and its objects. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Shengyi Qian , Alexander Kirillov , Nikhila Ravi , Devendra Singh Chaplot , Justin Johnson , David F. Fouhey , Georgia Gkioxari

Accurate perception of dynamic traffic scenes is crucial for high-level autonomous driving systems, requiring robust object motion estimation and instance segmentation. However, traditional methods often treat them as separate tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Yinqi Chen , Meiying Zhang , Qi Hao , Guang Zhou

Neural implicit representations, including Neural Distance Fields and Neural Radiance Fields, have demonstrated significant capabilities for reconstructing surfaces with complicated geometry and topology, and generating novel views of a…

Graphics · Computer Science 2024-02-08 Lin Gao , Jie Yang , Bo-Tao Zhang , Jia-Mu Sun , Yu-Jie Yuan , Hongbo Fu , Yu-Kun Lai

In recent years, the paradigm of neural implicit representations has gained substantial attention in the field of Simultaneous Localization and Mapping (SLAM). However, a notable gap exists in the existing approaches when it comes to scene…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Hongjia Zhai , Gan Huang , Qirui Hu , Guanglin Li , Hujun Bao , Guofeng Zhang

Deep generative models allow for photorealistic image synthesis at high resolutions. But for many applications, this is not enough: content creation also needs to be controllable. While several recent works investigate how to disentangle…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Michael Niemeyer , Andreas Geiger

We introduce Ilov3Splat, a novel framework for instance-level open-vocabulary 3D scene understanding built on 3D Gaussian Splatting (3D-GS). Most prior work depends on 2D rendering-based matching or point-level semantic association, which…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Binh Long Nguyen , Kien Nguyen , Sridha Sridharan , Clinton Fookes , Peyman Moghadam

Dynamic scenes rendering is an intriguing yet challenging problem. Although current methods based on NeRF have achieved satisfactory performance, they still can not reach real-time levels. Recently, 3D Gaussian Splatting (3DGS) has garnered…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Jiahao Lu , Jiacheng Deng , Ruijie Zhu , Yanzhe Liang , Wenfei Yang , Tianzhu Zhang , Xu Zhou

This paper addresses the problem of dynamic scene surface reconstruction using Gaussian Splatting (GS), aiming to recover temporally consistent geometry. While existing GS-based dynamic surface reconstruction methods can yield superior…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Renjie Wu , Hongdong Li , Jose M. Alvarez , Miaomiao Liu

Novel view synthesis of dynamic scenes has been an intriguing yet challenging problem. Despite recent advancements, simultaneously achieving high-resolution photorealistic results, real-time rendering, and compact storage remains a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Zhan Li , Zhang Chen , Zhong Li , Yi Xu

Dynamic scene reconstruction represents a fundamental yet demanding challenge in computer vision and robotics. While recent progress in 3DGS-based methods has advanced dynamic scene modeling, obtaining high-fidelity rendering and accurate…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yinan Deng , Jianyu Dou , Jiahui Wang , Jingyu Zhao , Yi Yang , Yufeng Yue

We reinterpret 4D Gaussian Splatting as a continuous-time dynamical system, where scene motion arises from integrating a learned neural dynamical field rather than applying per-frame deformations. This formulation, which we call EvoGS,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Arnold Caleb Asiimwe , Carl Vondrick

We introduce a new approach for reconstruction and novel view synthesis of unbounded real-world scenes. In contrast to previous methods using either volumetric fields, grid-based models, or discrete point cloud proxies, we propose a hybrid…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Florian Hahlbohm , Linus Franke , Moritz Kappel , Susana Castillo , Martin Eisemann , Marc Stamminger , Marcus Magnor