English
Related papers

Related papers: PUGS: Zero-shot Physical Understanding with Gaussi…

200 papers

Reconstructing urban scenes is challenging due to their complex geometries and the presence of potentially dynamic objects. 3D Gaussian Splatting (3DGS)-based methods have shown strong performance, but existing approaches often incorporate…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Ziwen Li , Jiaxin Huang , Runnan Chen , Yunlong Che , Yandong Guo , Tongliang Liu , Fakhri Karray , Mingming Gong

6D object pose estimation for unseen objects is essential in robotics but traditionally relies on trained models that require large datasets, high computational costs, and struggle to generalize. Zero-shot approaches eliminate the need for…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Melvin Reka , Tessa Pulli , Markus Vincze

3D Gaussian Splatting (3DGS) proposes an efficient solution for novel view synthesis. Its framework provides fast and high-fidelity rendering. Although less complex than other solutions such as Neural Radiance Fields (NeRF), there are still…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Stéphane Pateux , Matthieu Gendrin , Luce Morin , Théo Ladune , Xiaoran Jiang

Existing end-to-end approaches of robotic manipulation often lack generalization to unseen objects or tasks due to limited data and poor interpretability. While recent Multimodal Large Language Models (MLLMs) demonstrate strong commonsense…

Robotics · Computer Science 2026-03-03 Zilong Xie , Jingyu Gong , Xin Tan , Zhizhong Zhang , Yuan Xie

Accurate 3D reconstruction of dynamic surgical scenes from endoscopic video is essential for robotic-assisted surgery. While recent 3D Gaussian Splatting methods have shown promise in achieving high-quality reconstructions with fast…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Jialei Chen , Xin Zhang , Mobarakol Islam , Francisco Vasconcelos , Danail Stoyanov , Daniel S. Elson , Baoru Huang

This paper presents Planar Gaussian Splatting (PGS), a novel neural rendering approach to learn the 3D geometry and parse the 3D planes of a scene, directly from multiple RGB images. The PGS leverages Gaussian primitives to model the scene…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Farhad G. Zanjani , Hong Cai , Hanno Ackermann , Leila Mirvakhabova , Fatih Porikli

Building articulated objects is a key challenge in computer vision. Existing methods often fail to effectively integrate information across different object states, limiting the accuracy of part-mesh reconstruction and part dynamics…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Yu Liu , Baoxiong Jia , Ruijie Lu , Junfeng Ni , Song-Chun Zhu , Siyuan Huang

Modeling complex rigid motion across large spatiotemporal spans remains an unresolved challenge in dynamic reconstruction. Existing paradigms are mainly confined to short-term, small-scale deformation and offer limited consideration for…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Yijun Xu , Jingrui Zhang , Yuhan Chen , Dingwen Wang , Lei Yu , Chu He

Recent efforts in using 3D Gaussians for scene reconstruction and novel view synthesis can achieve impressive results on curated benchmarks; however, images captured in real life are often blurry. In this work, we analyze the robustness of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Cheng Peng , Yutao Tang , Yifan Zhou , Nengyu Wang , Xijun Liu , Deming Li , Rama Chellappa

Stylizing a dynamic scene based on an exemplar image is critical for various real-world applications, including gaming, filmmaking, and augmented and virtual reality. However, achieving consistent stylization across both spatial and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Abhishek Saroha , Florian Hofherr , Mariia Gladkova , Cecilia Curreli , Or Litany , Daniel Cremers

Articulated objects are ubiquitous in daily environments, and their 3D reconstruction holds great significance across various fields. However, existing articulated object reconstruction methods typically require costly inputs such as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Di Wu , Liu Liu , Xueyu Yuan , Wenxiao Chen , Lijun Yue , Liuzhu Chen , Yiming Tang , Meng Wang

Recently, 3D Gaussian Splatting (3DGS) has emerged as an efficient approach for accurately representing scenes. However, despite its superior novel view synthesis capabilities, extracting the geometry of the scene directly from the Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Yaniv Wolf , Amit Bracha , Ron Kimmel

Implicit neural representation methods have shown impressive advancements in learning 3D scenes from unstructured in-the-wild photo collections but are still limited by the large computational cost of volumetric rendering. More recently, 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Hiba Dahmani , Moussab Bennehar , Nathan Piasco , Luis Roldao , Dzmitry Tsishkou

With the emergence of Gaussian Splats, recent efforts have focused on large-scale scene geometric reconstruction. However, most of these efforts either concentrate on memory reduction or spatial space division, neglecting information in the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Butian Xiong , Xiaoyu Ye , Tze Ho Elden Tse , Kai Han , Shuguang Cui , Zhen Li

Dynamic scene reconstruction is a long-term challenge in the field of 3D vision. Recently, the emergence of 3D Gaussian Splatting has provided new insights into this problem. Although subsequent efforts rapidly extend static 3D Gaussian to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Ruijie Zhu , Yanzhe Liang , Hanzhi Chang , Jiacheng Deng , Jiahao Lu , Wenfei Yang , Tianzhu Zhang , Yongdong Zhang

Generalizable perception is one of the pillars of high-level autonomy in space robotics. Estimating the structure and motion of unknown objects in dynamic environments is fundamental for such autonomous systems. Traditionally, the solutions…

Robotics · Computer Science 2024-11-26 Kuldeep R Barad , Antoine Richard , Jan Dentler , Miguel Olivares-Mendez , Carol Martinez

3D Gaussian splatting (3DGS) is an innovative rendering technique that surpasses the neural radiance field (NeRF) in both rendering speed and visual quality by leveraging an explicit 3D scene representation. Existing 3DGS approaches require…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Lintao Xiang , Hongpei Zheng , Yating Huang , Qijun Yang , Hujun Yin

Reconstructing and predicting dynamic 3D scenes from multi-view videos is a foundational task for robotics, AR/VR, and digital twins. Recent physics-informed Gaussian Splatting methods achieve impressive future frame extrapolation but lack…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Denis Gridusov , Maxim Popov , Sergey Kolyubin

Reconstructing objects from posed images is a crucial and complex task in computer graphics and computer vision. While NeRF-based neural reconstruction methods have exhibited impressive reconstruction ability, they tend to be…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Shuichang Lai , Letian Huang , Jie Guo , Kai Cheng , Bowen Pan , Xiaoxiao Long , Jiangjing Lyu , Chengfei Lv , Yanwen Guo

Underwater 3D scene reconstruction faces severe challenges from light absorption, scattering, and turbidity, which degrade geometry and color fidelity in traditional methods like Neural Radiance Fields (NeRF). While NeRF extensions such as…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Wenpeng Xing , Jie Chen , Zaifeng Yang , Changting Lin , Jianfeng Dong , Chaochao Chen , Xun Zhou , Meng Han