English
Related papers

Related papers: Efficient Physics Simulation for 3D Scenes via MLL…

200 papers

Novel view synthesis (NVS) of static and dynamic urban scenes is essential for autonomous driving simulation, yet existing methods often struggle to balance reconstruction time with quality. While state-of-the-art neural radiance fields and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Sheng Miao , Sijin Li , Pan Wang , Dongfeng Bai , Bingbing Liu , Yue Wang , Andreas Geiger , Yiyi Liao

3D Gaussian Splatting (3DGS) has recently unlocked real-time, high-fidelity novel view synthesis by representing scenes using explicit 3D primitives. However, traditional methods often require millions of Gaussians to capture complex…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Anh Thuan Tran , Jana Kosecka

In this paper, we introduce \textbf{GS-SLAM} that first utilizes 3D Gaussian representation in the Simultaneous Localization and Mapping (SLAM) system. It facilitates a better balance between efficiency and accuracy. Compared to recent SLAM…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Chi Yan , Delin Qu , Dan Xu , Bin Zhao , Zhigang Wang , Dong Wang , Xuelong Li

Tissue deformation poses a key challenge for accurate surgical scene reconstruction. Despite yielding high reconstruction quality, existing methods suffer from slow rendering speeds and long training times, limiting their intraoperative…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Shuojue Yang , Qian Li , Daiyun Shen , Bingchen Gong , Qi Dou , Yueming Jin

Reconstruction of rigid motion over large spatiotemporal scales remains a challenging task due to limitations in modeling paradigms, severe motion blur, and insufficient physical consistency. In this work, we propose PEGS, a framework that…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Yijun Xu , Jingrui Zhang , Hongyi Liu , Yuhan Chen , Yuanyang Wang , Qingyao Guo , Dingwen Wang , Lei Yu , Chu He

We present 3DGS-CD, the first 3D Gaussian Splatting (3DGS)-based method for detecting physical object rearrangements in 3D scenes. Our approach estimates 3D object-level changes by comparing two sets of unaligned images taken at different…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Ziqi Lu , Jianbo Ye , John Leonard

In the domain of 3D scene representation, 3D Gaussian Splatting (3DGS) has emerged as a pivotal technology. However, its application to large-scale, high-resolution scenes (exceeding 4k$\times$4k pixels) is hindered by the excessive…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Wenkai Liu , Tao Guan , Bin Zhu , Lili Ju , Zikai Song , Dan Li , Yuesong Wang , Wei Yang

Modern Gaussian Splatting methods have proven highly effective for real-time photorealistic rendering of 3D scenes. However, integrating semantic information into this representation remains a significant challenge, especially in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Roman Titkov , Egor Zubkov , Dmitry Yudin , Jaafar Mahmoud , Malik Mohrat , Gennady Sidorov

Multimodal large language models (MLLMs) have advanced the capabilities to interpret and act on visual input in 3D environments, empowering diverse applications such as robotics and situated conversational agents. When MLLMs reason over…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Zhuoheng Li , Ying Chen

Novel view synthesis of urban scenes is essential for autonomous driving-related applications.Existing NeRF and 3DGS-based methods show promising results in achieving photorealistic renderings but require slow, per-scene optimization. We…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Sheng Miao , Jiaxin Huang , Dongfeng Bai , Xu Yan , Hongyu Zhou , Yue Wang , Bingbing Liu , Andreas Geiger , Yiyi Liao

The recently developed Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have shown encouraging and impressive results for visual SLAM. However, most representative methods require RGBD sensors and are only available for indoor…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Zhe Xin , Chenyang Wu , Penghui Huang , Yanyong Zhang , Yinian Mao , Guoquan Huang

Robotic manipulation systems operating in complex environments rely on perception systems that provide information about the geometry (pose and 3D shape) of the objects in the scene along with other semantic information such as object…

Robotics · Computer Science 2023-05-17 Shubham Agrawal , Nikhil Chavan-Dafle , Isaac Kasahara , Selim Engin , Jinwook Huh , Volkan Isler

3D Gaussian splatting (3DGS) is a transformative technique with profound implications on novel view synthesis and real-time rendering. Given its importance, there have been many attempts to improve its performance. However, with the…

Hardware Architecture · Computer Science 2025-10-14 Yi Hu , Huiyang Zhou

This work presents DLO-Splatting, an algorithm for estimating the 3D shape of Deformable Linear Objects (DLOs) from multi-view RGB images and gripper state information through prediction-update filtering. The DLO-Splatting algorithm uses a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Holly Dinkel , Marcel Büsching , Alberta Longhini , Brian Coltin , Trey Smith , Danica Kragic , Mårten Björkman , Timothy Bretl

Scene generation with 3D assets presents a complex challenge, requiring both high-level semantic understanding and low-level geometric reasoning. While Multimodal Large Language Models (MLLMs) excel at semantic tasks, their application to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Ian Huang , Yanan Bao , Karen Truong , Howard Zhou , Cordelia Schmid , Leonidas Guibas , Alireza Fathi

Creating scenes for captured motions that achieve realistic human-scene interaction is crucial for 3D animation in movies or video games. As character motion is often captured in a blue-screened studio without real furniture or objects in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Jianan Li , Tao Huang , Qingxu Zhu , Tien-Tsin Wong

We present 3DGS-LM, a new method that accelerates the reconstruction of 3D Gaussian Splatting (3DGS) by replacing its ADAM optimizer with a tailored Levenberg-Marquardt (LM). Existing methods reduce the optimization time by decreasing the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Lukas Höllein , Aljaž Božič , Michael Zollhöfer , Matthias Nießner

Surgical simulation is essential for medical training, enabling practitioners to develop crucial skills in a risk-free environment while improving patient safety and surgical outcomes. However, conventional methods for building simulation…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Zhenya Yang

3D Gaussian Splatting (3DGS) has shown remarkable success in synthesizing novel views given multiple views of a static scene. Yet, 3DGS faces challenges when applied to dynamic scenes because 3D Gaussian parameters need to be updated per…

Graphics · Computer Science 2024-07-08 Kai Katsumata , Duc Minh Vo , Hideki Nakayama

3D Gaussian Splatting (3DGS) has emerged as a promising representation for photorealistic rendering of 3D scenes. However, its high storage requirements pose significant challenges for practical applications. We observe that Gaussians…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Yuang Shi , Simone Gasparini , Géraldine Morin , Chenggang Yang , Wei Tsang Ooi