English
Related papers

Related papers: Interaction-Aware 4D Gaussian Splatting for Dynami…

200 papers

In this paper, we propose a 3D geometry-aware deformable Gaussian Splatting method for dynamic view synthesis. Existing neural radiance fields (NeRF) based solutions learn the deformation in an implicit manner, which cannot incorporate 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Zhicheng Lu , Xiang Guo , Le Hui , Tianrui Chen , Min Yang , Xiao Tang , Feng Zhu , Yuchao Dai

Urban scene reconstruction is critical for autonomous driving, enabling structured 3D representations for data synthesis and closed-loop testing. Supervised approaches rely on costly human annotations and lack scalability, while current…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Chenpeng Su , Wenhua Wu , Chensheng Peng , Tianchen Deng , Zhe Liu , Hesheng Wang

High-dynamic scene reconstruction aims to represent static background with rigid spatial features and dynamic objects with deformed continuous spatiotemporal features. Typically, existing methods adopt unified representation model (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Hanyu Zhou , Haonan Wang , Haoyue Liu , Yuxing Duan , Luxin Yan , Gim Hee Lee

We present GSD, a diffusion model approach based on Gaussian Splatting (GS) representation for 3D object reconstruction from a single view. Prior works suffer from inconsistent 3D geometry or mediocre rendering quality due to improper…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Yuxuan Mu , Xinxin Zuo , Chuan Guo , Yilin Wang , Juwei Lu , Xiaofeng Wu , Songcen Xu , Peng Dai , Youliang Yan , Li Cheng

Novel view synthesis has shown rapid progress recently, with methods capable of producing increasingly photorealistic results. 3D Gaussian Splatting has emerged as a promising method, producing high-quality renderings of scenes and enabling…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Richard Shaw , Michal Nazarczuk , Jifei Song , Arthur Moreau , Sibi Catley-Chandar , Helisa Dhamo , Eduardo Perez-Pellitero

This paper presents DENSER, an efficient and effective approach leveraging 3D Gaussian splatting (3DGS) for the reconstruction of dynamic urban environments. While several methods for photorealistic scene representations, both implicitly…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Mahmud A. Mohamad , Gamal Elghazaly , Arthur Hubert , Raphael Frank

Robotics applications often rely on scene reconstructions to enable downstream tasks. In this work, we tackle the challenge of actively building an accurate map of an unknown scene using an RGB-D camera on a mobile platform. We propose a…

Robotics · Computer Science 2025-04-09 Liren Jin , Xingguang Zhong , Yue Pan , Jens Behley , Cyrill Stachniss , Marija Popović

We propose a novel diffusion-based framework for reconstructing 3D geometry of hand-held objects from monocular RGB images by leveraging hand-object interaction as geometric guidance. Our method conditions a latent diffusion model on an…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Ayce Idil Aytekin , Helge Rhodin , Rishabh Dabral , Christian Theobalt

Recently, Gaussian Splatting (GS) has received a lot of attention in surface reconstruction. However, while 3D objects can be of complex and diverse shapes in the real world, existing GS-based methods only limitedly use a single type of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Haoxuan Qu , Yujun Cai , Hossein Rahmani , Ajay Kumar , Junsong Yuan , Jun Liu

Differentiable rendering techniques have recently shown promising results for free-viewpoint video synthesis of characters. However, such methods, either Gaussian Splatting or neural implicit rendering, typically necessitate per-subject…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Boyao Zhou , Shunyuan Zheng , Hanzhang Tu , Ruizhi Shao , Boning Liu , Shengping Zhang , Liqiang Nie , Yebin Liu

Recently, 3D Gaussian splatting has gained attention for its capability to generate high-fidelity rendering results. At the same time, most applications such as games, animation, and AR/VR use mesh-based representations to represent and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Jaehoon Choi , Yonghan Lee , Hyungtae Lee , Heesung Kwon , Dinesh Manocha

As the demand for immersive 3D content grows, the need for intuitive and efficient interaction methods becomes paramount. Current techniques for physically manipulating 3D content within Virtual Reality (VR) often face significant…

Gaussian Splatting and its dynamic extensions are effective for reconstructing 3D scenes from 2D images when there is significant camera movement to facilitate motion parallax and when scene objects remain relatively static. However, in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Liuyue Xie , Joel Julin , Koichiro Niinuma , Laszlo A. Jeni

Dynamic and static components in scenes often exhibit distinct properties, yet most 4D reconstruction methods treat them indiscriminately, leading to suboptimal performance in both cases. This work introduces SDD-4DGS, the first framework…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Dai Sun , Huhao Guan , Kun Zhang , Xike Xie , S. Kevin Zhou

Single view-based reconstruction of hand-object interaction is challenging due to the severe observation missing caused by occlusions. This paper proposes a physics-based method to better solve the ambiguities in the reconstruction. It…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Haoyu Hu , Xinyu Yi , Hao Zhang , Jun-Hai Yong , Feng Xu

Reconstructing a 3D scene from images is challenging due to the different ways light interacts with surfaces depending on the viewer's position and the surface's material. In classical computer graphics, materials can be classified as…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Mateusz Nowak , Wojciech Jarosz , Peter Chin

3D Gaussian Splatting (GS) enables highly photorealistic scene reconstruction from posed image sequences but struggles with viewpoint extrapolation due to its anisotropic nature, leading to overfitting and poor generalization, particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Shuohan Tao , Boyao Zhou , Hanzhang Tu , Yuwang Wang , Yebin Liu

Recent developments in 3D reconstruction and neural rendering have significantly propelled the capabilities of photo-realistic 3D scene rendering across various academic and industrial fields. The 3D Gaussian Splatting technique, alongside…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zexu Huang , Min Xu , Stuart Perry

3D Gaussian Splatting (3DGS) has revolutionized fast novel view synthesis, yet its opacity-based formulation makes surface extraction fundamentally difficult. Unlike implicit methods built on Signed Distance Fields or occupancy, 3DGS lacks…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Diego Gomez , Antoine Guédon , Nissim Maruani , Bingchen Gong , Maks Ovsjanikov

Transparent object manipulation remains a significant challenge in robotics due to the difficulty of acquiring accurate and dense depth measurements. Conventional depth sensors often fail with transparent objects, resulting in incomplete or…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Jeongyun Kim , Jeongho Noh , Dong-Guw Lee , Ayoung Kim