English
Related papers

Related papers: Efficient Physics Simulation for 3D Scenes via MLL…

200 papers

Reconstructing dynamic scenes with multiple interacting humans and objects from sparse-view inputs is a critical yet challenging task, essential for creating high-fidelity digital twins for robotics and VR/AR. This problem, which we term…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Weiquan Wang , Jun Xiao , Feifei Shao , Yi Yang , Yueting Zhuang , Long Chen

Videos of robots interacting with objects encode rich information about the objects' dynamics. However, existing video prediction approaches typically do not explicitly account for the 3D information from videos, such as robot actions and…

Robotics · Computer Science 2024-10-25 Mingtong Zhang , Kaifeng Zhang , Yunzhu Li

Multi-view mesh reconstruction remains a core challenge in computer graphics and vision, especially for recovering high-frequency geometry from sparse observations. Recent methods such as 3D Gaussian Splatting (3DGS) and Neural Radiance…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Nandhana Sunil , Abhirami R Iyer , Avirup Mandal

3D reconstruction from a single-RGB image in unconstrained real-world scenarios presents numerous challenges due to the inherent diversity and complexity of objects and environments. In this paper, we introduce Anything-3D, a methodical…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Qiuhong Shen , Xingyi Yang , Xinchao Wang

Abstract representations of 3D scenes play a crucial role in computer vision, enabling a wide range of applications such as mapping, localization, surface reconstruction, and even advanced tasks like SLAM and rendering. Among these…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Chenggang Yang , Yuang Shi

Recently, several studies have combined Gaussian Splatting to obtain scene representations with language embeddings for open-vocabulary 3D scene understanding. While these methods perform well, they essentially require very dense multi-view…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Jun Hu , Zhang Chen , Zhong Li , Yi Xu , Juyong Zhang

3D Gaussian Splatting (3DGS) has recently gained popularity for efficient scene rendering by representing scenes as explicit sets of anisotropic 3D Gaussians. However, most existing work focuses primarily on modeling external surfaces. In…

Image and Video Processing · Electrical Eng. & Systems 2026-01-12 Shuxin Liang , Yihan Xiao , Wenlu Tang

Recently, 3D Gaussian Splatting (3DGS) has emerged as an efficient approach for accurately representing scenes. However, despite its superior novel view synthesis capabilities, extracting the geometry of the scene directly from the Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Yaniv Wolf , Amit Bracha , Ron Kimmel

Simultaneous localization and mapping (SLAM) technology has recently achieved photorealistic mapping capabilities thanks to the real-time, high-fidelity rendering enabled by 3D Gaussian Splatting (3DGS). However, due to the static…

Robotics · Computer Science 2025-12-01 Zhicong Sun , Jacqueline Lo , Jinxing Hu

Large-scale 3D reconstruction is critical in the field of robotics, and the potential of 3D Gaussian Splatting (3DGS) for achieving accurate object-level reconstruction has been demonstrated. However, ensuring geometric accuracy in outdoor…

Robotics · Computer Science 2024-09-20 Changjian Jiang , Ruilan Gao , Kele Shao , Yue Wang , Rong Xiong , Yu Zhang

Recovering physical properties of objects in motion is a core task across scientific and industrial applications. When the relative motion between the object and the sensing apparatus provides sufficient angular coverage, Computerized…

Numerical Analysis · Mathematics 2026-05-19 Daniel Burrows , Can Evren Yarman , Ozan Öktem

In the field of 3D dynamic scene reconstruction, how to balance model convergence rate and rendering quality has long been a critical challenge that urgently needs to be addressed, particularly in high-precision modeling of scenes with…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Nengbo Lu , Minghua Pan , Shaohua Sun , Yizhou Liang

Reconstructing posed 3D human models from monocular images has important applications in the sports industry, including performance tracking, injury prevention and virtual training. In this work, we combine 3D human pose and shape…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Lorenza Prospero , Abdullah Hamdi , Joao F. Henriques , Christian Rupprecht

This paper proposes Neural-MMGS, a novel neural 3DGS framework for multimodal large-scale scene reconstruction that fuses multiple sensing modalities in a per-gaussian compact, learnable embedding. While recent works focusing on large-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Sitian Shen , Georgi Pramatarov , Yifu Tao , Daniele De Martini

Recent Multi-Modal Large Language Models (MLLMs) have demonstrated strong capabilities in learning joint representations from text and images. However, their spatial reasoning remains limited. We introduce 3DFroMLLM, a novel framework that…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Noor Ahmed , Cameron Braunstein , Steffen Eger , Eddy Ilg

The emergence of 3D Gaussian Splatting (3DGS) has greatly accelerated the rendering speed of novel view synthesis. Unlike neural implicit representations like Neural Radiance Fields (NeRF) that represent a 3D scene with position and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Tong Wu , Yu-Jie Yuan , Ling-Xiao Zhang , Jie Yang , Yan-Pei Cao , Ling-Qi Yan , Lin Gao

Recent advances in neural rendering have improved both training and rendering times by orders of magnitude. While these methods demonstrate state-of-the-art quality and speed, they are designed for photogrammetry of static scenes and do not…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Muhammed Kocabas , Jen-Hao Rick Chang , James Gabriel , Oncel Tuzel , Anurag Ranjan

Accurately reconstructing a 3D scene including explicit geometry information is both attractive and challenging. Geometry reconstruction can benefit from incorporating differentiable appearance models, such as Neural Radiance Fields and 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Ancheng Lin , Yusheng Xiang , Paul Kennedy , Jun Li

While novel view synthesis for dynamic scenes has made significant progress, capturing skeleton models of objects and re-posing them remains a challenging task. To tackle this problem, in this paper, we propose a novel approach to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Diwen Wan , Yuxiang Wang , Ruijie Lu , Gang Zeng

The modeling and manipulation of 3D scenes captured from the real world are pivotal in various applications, attracting growing research interest. While previous works on editing have achieved interesting results through manipulating 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Guan Luo , Tian-Xing Xu , Ying-Tian Liu , Xiao-Xiong Fan , Fang-Lue Zhang , Song-Hai Zhang