English
Related papers

Related papers: 4D Synchronized Fields: Motion-Language Gaussian S…

200 papers

We introduce FLAG-4D, a novel framework for generating novel views of dynamic scenes by reconstructing how 3D Gaussian primitives evolve through space and time. Existing methods typically rely on a single Multilayer Perceptron (MLP) to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Guan Yuan Tan , Ngoc Tuan Vu , Arghya Pal , Sailaja Rajanala , Raphael Phan C. -W. , Mettu Srinivas , Chee-Ming Ting

Reconstructing and predicting dynamic 3D scenes from multi-view videos is a foundational task for robotics, AR/VR, and digital twins. Recent physics-informed Gaussian Splatting methods achieve impressive future frame extrapolation but lack…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Denis Gridusov , Maxim Popov , Sergey Kolyubin

Previous text-to-4D methods have leveraged multiple Score Distillation Sampling (SDS) techniques, combining motion priors from video-based diffusion models (DMs) with geometric priors from multiview DMs to implicitly guide 4D renderings.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Qiaowei Miao , JinSheng Quan , Kehan Li , Yawei Luo

Dynamic Gaussian Splatting approaches have achieved remarkable performance for 4D scene reconstruction. However, these approaches rely on dense-frame video sequences for photorealistic reconstruction. In real-world scenarios, due to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Changyue Shi , Chuxiao Yang , Xinyuan Hu , Minghao Chen , Wenwen Pan , Yan Yang , Jiajun Ding , Zhou Yu , Jun Yu

3D Gaussian Splatting (3DGS) has revolutionized 3D scene representation with superior efficiency and quality. While recent adaptations for computed tomography (CT) show promise, they struggle with severe artifacts under highly sparse-view…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Yuxiang Zhong , Jun Wei , Chaoqi Chen , Senyou An , Hui Huang

Recently, Gaussian splatting has received more and more attention in the field of static scene rendering. Due to the low computational overhead and inherent flexibility of explicit representations, plane-based explicit methods are popular…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Jiawei Xu , Zexin Fan , Jian Yang , Jin Xie

Combining 3D Gaussian splatting with Simultaneous Localization and Mapping (SLAM) has gained popularity as it enables continuous 3D environment reconstruction during motion. However, existing methods struggle in dynamic environments,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Yangfan Zhao , Hanwei Zhang , Ke Huang , Qiufeng Wang , Zhenzhou Shao , Dengyu Wu

In this work, we introduce a novel approach for creating controllable dynamics in 3D-generated Gaussians using casually captured reference videos. Our method transfers the motion of objects from reference videos to a variety of generated 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Zhoujie Fu , Jiacheng Wei , Wenhao Shen , Chaoyue Song , Xiaofeng Yang , Fayao Liu , Xulei Yang , Guosheng Lin

Reconstructing large-scale dynamic scenes from visual observations is a fundamental challenge in computer vision, with critical implications for robotics and autonomous systems. While recent differentiable rendering methods such as Neural…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jingkang Wang , Henry Che , Yun Chen , Ze Yang , Lily Goli , Sivabalan Manivasagam , Raquel Urtasun

Holistic 3D scene understanding, which jointly models geometry, appearance, and semantics, is crucial for applications like augmented reality and robotic interaction. Existing feed-forward 3D scene understanding methods (e.g., LSM) are…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Qijing Li , Jingxiang Sun , Liang An , Zhaoqi Su , Hongwen Zhang , Yebin Liu

Realistic reconstruction of dynamic 4D scenes from monocular videos is essential for understanding the physical world. Despite recent progress in neural rendering, existing methods often struggle to recover accurate 3D geometry and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Haoran Zhou , Gim Hee Lee

Scene representations using 3D Gaussian primitives have produced excellent results in modeling the appearance of static and dynamic 3D scenes. Many graphics applications, however, demand the ability to manipulate both the appearance and the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Ri-Zhao Qiu , Ge Yang , Weijia Zeng , Xiaolong Wang

Transient objects in casual multi-view captures cause ghosting artifacts in 3D Gaussian Splatting (3DGS) reconstruction. Existing solutions relied on scene decomposition at significant memory cost or on motion-based heuristics that were…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Aditi Prabakaran , Priyesh Shukla

Dynamic urban scene modeling is a rapidly evolving area with broad applications. While current approaches leveraging neural radiance fields or Gaussian Splatting have achieved fine-grained reconstruction and high-fidelity novel view…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Yuru Xiao , Zihan Lin , Chao Lu , Deming Zhai , Kui Jiang , Wenbo Zhao , Wei Zhang , Junjun Jiang , Huanran Wang , Xianming Liu

Dynamic 3D scene representation and novel view synthesis are crucial for enabling immersive experiences required by AR/VR and metaverse applications. It is a challenging task due to the complexity of unconstrained real-world scenes and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Zeyu Yang , Zijie Pan , Xiatian Zhu , Li Zhang , Jianfeng Feng , Yu-Gang Jiang , Philip H. S. Torr

Recent semantic 3D Gaussian Splatting (3DGS) methods primarily rely on 2D foundation models, often yielding ambiguous boundaries and limited support for structured urban semantics. While city models such as CityGML encode hierarchically…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Qilin Zhang , Jinyu Zhu , Olaf Wysocki , Benjamin Busam , Boris Jutzi

Deformable 3D Gaussian Splatting (3D-GS) is limited by missing intermediate motion information due to the low temporal resolution of RGB cameras. To address this, we introduce the first approach combining event cameras, which capture…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Wenhao Xu , Wenming Weng , Yueyi Zhang , Ruikang Xu , Zhiwei Xiong

We propose a feed-forward Gaussian Splatting model that unifies 3D scene and semantic field reconstruction. Combining 3D scenes with semantic fields facilitates the perception and understanding of the surrounding environment. However, key…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Qijian Tian , Xin Tan , Jingyu Gong , Yuan Xie , Lizhuang Ma

Accurate scene perception is critical for vision-based robotic manipulation. Existing approaches typically follow either a Vision-to-Action (V-A) paradigm, predicting actions directly from visual inputs, or a Vision-to-3D-to-Action (V-3D-A)…

Robotics · Computer Science 2026-05-25 Ying Chai , Litao Deng , Ruizhi Shao , Jiajun Zhang , Kangchen Lv , Liangjun Xing , Xiang Li , Hongwen Zhang , Yebin Liu

This paper focuses on a challenging setting of simultaneously modeling geometry and appearance of hand-object interaction scenes without any object priors. We follow the trend of dynamic 3D Gaussian Splatting based methods, and address…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Hao Tian , Chenyangguang Zhang , Rui Liu , Wen Shen , Xiaolin Qin