English
Related papers

Related papers: 4D Synchronized Fields: Motion-Language Gaussian S…

200 papers

Instruction-guided generative models, especially those using text-to-image (T2I) and text-to-video (T2V) diffusion frameworks, have advanced the field of content editing in recent years. To extend these capabilities to 4D scene, we…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Hasan Iqbal , Nazmul Karim , Umar Khalid , Azib Farooq , Zichun Zhong , Chen Chen , Jing Hua

3D reconstruction and relighting of objects made from scattering materials present a significant challenge due to the complex light transport beneath the surface. 3D Gaussian Splatting introduced high-quality novel view synthesis at…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jan-Niklas Dihlmann , Arjun Majumdar , Andreas Engelhardt , Raphael Braun , Hendrik P. A. Lensch

3D Gaussian Splatting (3DGS) has emerged as a powerful explicit representation enabling real-time, high-fidelity 3D reconstruction and novel view synthesis. However, its practical use is hindered by the massive memory and computational…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Seokhyun Youn , Soohyun Lee , Geonho Kim , Weeyoung Kwon , Sung-Ho Bae , Jihyong Oh

Real-time immersive video communications, particularly high-fidelity 3D telepresence, necessitates a synergistic balance between instantaneous dynamic scene reconstruction and high-efficiency data transmission. While recent advancements in…

Image and Video Processing · Electrical Eng. & Systems 2026-04-29 Dingxi Yang , Wenqi Guo , Yue Liu , Jungong Han , Zhijin Qin

3D neural style transfer has gained significant attention for its potential to provide user-friendly stylization with spatial consistency. However, existing 3D style transfer methods often fall short in terms of inference efficiency,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Wanlin Liang , Hongbin Xu , Weitao Chen , Feng Xiao , Wenxiong Kang

Persistent dynamic scene modeling for tracking and novel-view synthesis remains challenging due to the difficulty of capturing accurate deformations while maintaining computational efficiency. We propose SCas4D, a cascaded optimization…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Jipeng Lyu , Jiahua Dong , Yu-Xiong Wang

Gaussian Splatting has revolutionized the world of novel view synthesis by achieving high rendering performance in real-time. Recently, studies have focused on enriching these 3D representations with semantic information for downstream…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Mihnea-Bogdan Jurca , Remco Royen , Ion Giosan , Adrian Munteanu

2D Gaussian Splatting (2DGS) has recently become a promising paradigm for high-quality video representation. However, existing methods employ content-agnostic or spatio-temporal feature overlapping embeddings to predict canonical Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Jierun Lin , Jiacong Chen , Qingyu Mao , Shuai Liu , Xiandong Meng , Fanyang Meng , Yongsheng Liang

Traditional SLAM algorithms excel at camera tracking, but typically produce incomplete and low-resolution maps that are not tightly integrated with semantics prediction. Recent work integrates Gaussian Splatting (GS) into SLAM to enable…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Mingqi Jiang , Chanho Kim , Chen Ziwen , Li Fuxin

Neural fields have emerged as a powerful framework for representing continuous multidimensional signals such as images and videos, 3D and 4D objects and scenes, and radiance fields. While efficient, achieving high-quality representation…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Abdelaziz Bouzidi , Hamid Laga , Hazem Wannous , Ferdous Sohel

Feed-forward 3D Gaussian Splatting methods have achieved impressive reconstruction quality for autonomous driving scenes, yet they entangle scene geometry with transient appearance properties such as lighting, weather, and time of day. This…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Quentin Herau , Tianshuo Xu , Depu Meng , Jiezhi Yang , Chensheng Peng , Spencer Sherk , Yihan Hu , Wei Zhan

Reconstructing dynamic 4D scenes is challenging, as it requires robust disentanglement of dynamic objects from the static background. While 3D foundation models like VGGT provide accurate 3D geometry, their performance drops markedly when…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yu Hu , Chong Cheng , Sicheng Yu , Xiaoyang Guo , Hao Wang

The reconstruction of dynamic 3D scenes using 3D Gaussian Splatting has shown significant promise. A key challenge, however, remains in modeling realistic motion, as most methods fail to align the motion of Gaussians with real-world…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Junoh Lee , Junmyeong Lee , Yeon-Ji Song , Inhwan Bae , Jisu Shin , Hae-Gon Jeon , Jin-Hwa Kim

We present Inst4DGS, an instance-decomposed 4D Gaussian Splatting (4DGS) approach with long-horizon per-Gaussian trajectories. While dynamic 4DGS has advanced rapidly, instance-decomposed 4DGS remains underexplored, largely due to the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yonghan Lee , Dinesh Manocha

3D Semantic Occupancy Prediction is fundamental for spatial understanding, yet existing approaches face challenges in scalability and generalization due to their reliance on extensive labeled data and computationally intensive voxel-wise…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Haoyi Jiang , Liu Liu , Tianheng Cheng , Xinjie Wang , Tianwei Lin , Zhizhong Su , Wenyu Liu , Xinggang Wang

Precisely perceiving the geometric and semantic properties of real-world 3D objects is crucial for the continued evolution of augmented reality and robotic applications. To this end, we present Foundation Model Embedded Gaussian Splatting…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Xingxing Zuo , Pouya Samangouei , Yunwen Zhou , Yan Di , Mingyang Li

We introduce Drag4D, an interactive framework that integrates object motion control within text-driven 3D scene generation. This framework enables users to define 3D trajectories for the 3D objects generated from a single image, seamlessly…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Minjun Kang , Inkyu Shin , Taeyeop Lee , In So Kweon , Kuk-Jin Yoon

Modeling the time-varying 3D appearance of plants during growth poses unique challenges: unlike most dynamic scenes, plants continuously generate new geometry as they expand, branch, and differentiate. Existing dynamic scene representations…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Weihan Luo , Lily Goli , Sherwin Bahmani , Felix Taubner , Andrea Tagliasacchi , David B. Lindell

Although 3D Gaussian Splatting (3D-GS) achieves efficient rendering for novel view synthesis, extending it to dynamic scenes still results in substantial memory overhead from replicating Gaussians across frames. To address this challenge,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Chun-Tin Wu , Jun-Cheng Chen

While remarkable success has been achieved through diffusion-based 3D generative models for shapes, 4D generative modeling remains challenging due to the complexity of object deformations over time. We propose DNF, a new 4D representation…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Xinyi Zhang , Naiqi Li , Angela Dai