English
Related papers

Related papers: Mirage2Matter: A Physically Grounded Gaussian Worl…

200 papers

3D Gaussian Splatting (3DGS) enables the reconstruction of intricate digital 3D assets from multi-view images by leveraging a set of 3D Gaussian primitives for rendering. Its explicit and discrete representation facilitates the seamless…

Graphics · Computer Science 2025-05-13 Xijie Yang , Linning Xu , Lihan Jiang , Dahua Lin , Bo Dai

Sparse-view scene reconstruction often faces significant challenges due to the constraints imposed by limited observational data. These limitations result in incomplete information, leading to suboptimal reconstructions using existing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Xiangyu Sun , Runnan Chen , Mingming Gong , Dong Xu , Tongliang Liu

Accurate and efficient modeling of large-scale urban scenes is critical for applications such as AR navigation, UAV based inspection, and smart city digital twins. While aerial imagery offers broad coverage and complements limitations of…

Graphics · Computer Science 2025-06-10 Weihang Liu , Yuhui Zhong , Yuke Li , Xi Chen , Jiadi Cui , Honglong Zhang , Lan Xu , Xin Lou , Yujiao Shi , Jingyi Yu , Yingliang Zhang

Recently, 3D Gaussian Splatting (3DGS) has emerged as an efficient approach for accurately representing scenes. However, despite its superior novel view synthesis capabilities, extracting the geometry of the scene directly from the Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Yaniv Wolf , Amit Bracha , Ron Kimmel

Visuomotor policies learned from teleoperated demonstrations face challenges such as lengthy data collection, high costs, and limited data diversity. Existing approaches address these issues by augmenting image observations in RGB space or…

Robotics · Computer Science 2025-04-18 Sizhe Yang , Wenye Yu , Jia Zeng , Jun Lv , Kerui Ren , Cewu Lu , Dahua Lin , Jiangmiao Pang

As multimodal language models advance, their application to 3D scene understanding is a fast-growing frontier, driving the development of 3D Vision-Language Models (VLMs). Current methods show strong dependence on object detectors,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Anna-Maria Halacheva , Jan-Nico Zaech , Xi Wang , Danda Pani Paudel , Luc Van Gool

Learning robust robot policies in real-world environments requires diverse data augmentation, yet scaling real-world data collection is costly due to the need for acquiring physical assets and reconfiguring environments. Therefore,…

The advancement of real-time 3D scene reconstruction and novel view synthesis has been significantly propelled by 3D Gaussian Splatting (3DGS). However, effectively training large-scale 3DGS and rendering it in real-time across various…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Yang Liu , He Guan , Chuanchen Luo , Lue Fan , Naiyan Wang , Junran Peng , Zhaoxiang Zhang

Virtual production (VP) use LED walls to provide both background imagery and image-based lighting. While this enables on-set compositing, it couples lighting to background and scene appearance, limiting flexibility for downstream editing.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Adrian Azzarelli , Nantheera Anantrasirichai , James Pollock , David R. Bull

Reconstructing 3D scenes with high fidelity and efficiency remains a central pursuit in computer vision and graphics. Recent advances in 3D Gaussian Splatting (3DGS) enable photorealistic rendering with Gaussian primitives, yet the modeling…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Guangchi Fang , Bing Wang

Robotic manipulation policies are advancing rapidly, but their direct evaluation in the real world remains costly, time-consuming, and difficult to reproduce, particularly for tasks involving deformable objects. Simulation provides a…

Event cameras offer promising advantages such as high dynamic range and low latency, making them well-suited for challenging lighting conditions and fast-moving scenarios. However, reconstructing 3D scenes from raw event streams is…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Jiaxu Wang , Junhao He , Ziyi Zhang , Mingyuan Sun , Jingkai Sun , Renjing Xu

3D Gaussian Splatting (3DGS), a 3D representation method with photorealistic real-time rendering capabilities, is regarded as an effective tool for narrowing the sim-to-real gap. However, it lacks fine-grained semantics and physical…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Bingchen Miao , Rong Wei , Zhiqi Ge , Xiaoquan sun , Shiqi Gao , Jingzhe Zhu , Renhan Wang , Siliang Tang , Jun Xiao , Rui Tang , Juncheng Li

The emergence of 3D Gaussian Splatting (3D-GS) has significantly advanced 3D reconstruction by providing high fidelity and fast training speeds across various scenarios. While recent efforts have mainly focused on improving model structures…

Graphics · Computer Science 2025-03-07 Yifei Gao , Jun Huang , Lei Wang , Ruiting Dai , Jun Cheng

Vision-language-action (VLA) policies have advanced language-conditioned robotic manipulation by transferring semantic priors from pretrained vision-language models to action generation. However, standard action-imitation learning often…

Robotics · Computer Science 2026-05-29 Zijian Zhang , Yuqing Jiang , Qian Cheng , Xiaofan Li , Si Liu , Ding Zhao , Ping Luo , Weitao Zhou , Haibao Yu

This paper presents GSWorld, a robust, photo-realistic simulator for robotics manipulation that combines 3D Gaussian Splatting with physics engines. Our framework advocates "closing the loop" of developing manipulation policies with…

Robotics · Computer Science 2025-10-24 Guangqi Jiang , Haoran Chang , Ri-Zhao Qiu , Yutong Liang , Mazeyu Ji , Jiyue Zhu , Zhao Dong , Xueyan Zou , Xiaolong Wang

Recent advances in Gaussian Splatting have enabled fast, high-fidelity 3D scene generation, yet these methods remain purely visual and lack an understanding of how shapes behave in the physical world. We introduce Physics-Guided 3D Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Zachary Lee , Maxwell Jacobson , Yexiang Xue

3D Gaussian Splatting (3DGS) has recently gained popularity for efficient scene rendering by representing scenes as explicit sets of anisotropic 3D Gaussians. However, most existing work focuses primarily on modeling external surfaces. In…

Image and Video Processing · Electrical Eng. & Systems 2026-01-12 Shuxin Liang , Yihan Xiao , Wenlu Tang

Training embodied AI agents depends critically on the visual fidelity of simulation environments and the ability to model dynamic humans. Current simulators rely on mesh-based rasterization with limited visual realism, and their support for…

Seamless integration of both aerial and street view images remains a significant challenge in neural scene reconstruction and rendering. Existing methods predominantly focus on single domain, limiting their applications in immersive…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Lihan Jiang , Kerui Ren , Mulin Yu , Linning Xu , Junting Dong , Tao Lu , Feng Zhao , Dahua Lin , Bo Dai