English
Related papers

Related papers: Director: Instance-aware Gaussian Splatting for Dy…

200 papers

We present an efficient neural 3D scene representation for novel-view synthesis (NVS) in large-scale, dynamic urban areas. Existing works are not well suited for applications like mixed-reality or closed-loop simulation due to their limited…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Tobias Fischer , Jonas Kulhanek , Samuel Rota Bulò , Lorenzo Porzi , Marc Pollefeys , Peter Kontschieder

The field of novel-view synthesis has recently witnessed the emergence of 3D Gaussian Splatting, which represents scenes in a point-based manner and renders through rasterization. This methodology, in contrast to Radiance Fields that rely…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Fengyi Zhang , Yadan Luo , Tianjun Zhang , Lin Zhang , Zi Huang

Holistic 3D scene understanding, which jointly models geometry, appearance, and semantics, is crucial for applications like augmented reality and robotic interaction. Existing feed-forward 3D scene understanding methods (e.g., LSM) are…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Qijing Li , Jingxiang Sun , Liang An , Zhaoqi Su , Hongwen Zhang , Yebin Liu

3D Gaussian Splatting (3DGS) is a recent approach for scene rendering. Although primarily designed for view synthesis, its potential for scene understanding tasks remains underexplored. In this work, we conduct a comparative evaluation of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Julia Farganus , Krzysztof Żurawicki , Arkadiusz Gaweł , Weronika Jakubowska , Halina Kwaśnicka

We present GP-4DGS, a novel framework that integrates Gaussian Processes (GPs) into 4D Gaussian Splatting (4DGS) for principled probabilistic modeling of dynamic scenes. While existing 4DGS methods focus on deterministic reconstruction,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Mijeong Kim , Jungtaek Kim , Bohyung Han

Due to the flexible representation of arbitrary-shaped scene text and simple pipeline, bottom-up segmentation-based methods begin to be mainstream in real-time scene text detection. Despite great progress, these methods show deficiencies in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Xugong Qin , Pengyuan Lyu , Chengquan Zhang , Yu Zhou , Kun Yao , Peng Zhang , Hailun Lin , Weiping Wang

We propose a novel cross-spectral rendering framework based on 3D Gaussian Splatting (3DGS) that generates realistic and semantically meaningful splats from registered multi-view spectrum and segmentation maps. This extension enhances the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Saptarshi Neil Sinha , Holger Graf , Michael Weinmann

Reconstructing dynamic 3D scenes from monocular video remains fundamentally challenging due to the need to jointly infer motion, structure, and appearance from limited observations. Existing dynamic scene reconstruction methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Jiahui Li , Shengeng Tang , Jingxuan He , Gang Huang , Zhangye Wang , Yantao Pan , Lechao Cheng

In the domain of 3D scene representation, 3D Gaussian Splatting (3DGS) has emerged as a pivotal technology. However, its application to large-scale, high-resolution scenes (exceeding 4k$\times$4k pixels) is hindered by the excessive…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Wenkai Liu , Tao Guan , Bin Zhu , Lili Ju , Zikai Song , Dan Li , Yuesong Wang , Wei Yang

In the field of 3D dynamic scene reconstruction, how to balance model convergence rate and rendering quality has long been a critical challenge that urgently needs to be addressed, particularly in high-precision modeling of scenes with…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Nengbo Lu , Minghua Pan , Shaohua Sun , Yizhou Liang

In this work, we introduce a novel approach for creating controllable dynamics in 3D-generated Gaussians using casually captured reference videos. Our method transfers the motion of objects from reference videos to a variety of generated 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Zhoujie Fu , Jiacheng Wei , Wenhao Shen , Chaoyue Song , Xiaofeng Yang , Fayao Liu , Xulei Yang , Guosheng Lin

Gaussian splatting has emerged as a powerful 3D representation that harnesses the advantages of both explicit (mesh) and implicit (NeRF) 3D representations. In this paper, we seek to leverage Gaussian splatting to generate realistic…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Ye Yuan , Xueting Li , Yangyi Huang , Shalini De Mello , Koki Nagano , Jan Kautz , Umar Iqbal

3D scene stylization extends the work of neural style transfer to 3D. A vital challenge in this problem is to maintain the uniformity of the stylized appearance across multiple views. A vast majority of the previous works achieve this by…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Abhishek Saroha , Mariia Gladkova , Cecilia Curreli , Dominik Muhle , Tarun Yenamandra , Daniel Cremers

Understanding dynamic scenes from casual videos is critical for scalable robot learning, yet four-dimensional (4D) reconstruction under strictly monocular settings remains highly ill-posed. To address this challenge, our key insight is that…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Can Li , Jie Gu , Jingmin Chen , Fangzhou Qiu , Lei Sun

Reconstructing intricate, ever-changing environments remains a central ambition in computer vision, yet existing solutions often crumble before the complexity of real-world dynamics. We present DynaSplat, an approach that extends Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Junli Deng , Ping Shi , Qipei Li , Jinyang Guo

Recently, generalizable human Gaussian splatting from sparse-view inputs has been actively studied for the photorealistic human rendering. Most existing methods rely on explicit geometric constraints or predefined structural representations…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Jingi Kim , Wonjun Kim

Injecting semantics into 3D Gaussian Splatting (3DGS) has recently garnered significant attention. While current approaches typically distill 3D semantic features from 2D foundational models (e.g., CLIP and SAM) to facilitate novel view…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Wenbo Zhang , Lu Zhang , Ping Hu , Liqian Ma , Yunzhi Zhuge , Huchuan Lu

Realistic reconstruction of dynamic 4D scenes from monocular videos is essential for understanding the physical world. Despite recent progress in neural rendering, existing methods often struggle to recover accurate 3D geometry and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Haoran Zhou , Gim Hee Lee

3D Gaussian splats have emerged as a revolutionary, effective, learned representation for static 3D scenes. In this work, we explore using 2D Gaussian splats as a new primitive for representing videos. We propose GSVC, an approach to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Longan Wang , Yuang Shi , Wei Tsang Ooi

Previous surface reconstruction methods either suffer from low geometric accuracy or lengthy training times when dealing with real-world complex dynamic scenes involving multi-person activities, and human-object interactions. To tackle the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Shuo Wang , Binbin Huang , Ruoyu Wang , Shenghua Gao