English
Related papers

Related papers: ReaDy-Go: Real-to-Sim Dynamic 3D Gaussian Splattin…

200 papers

This paper presents a novel approach to image-goal navigation by integrating 3D Gaussian Splatting (3DGS) with Visual Navigation Models (VNMs), a method we refer to as GSplatVNM. VNMs offer a promising paradigm for image-goal navigation by…

Robotics · Computer Science 2025-07-29 Kohei Honda , Takeshi Ishita , Yasuhiro Yoshimura , Ryo Yonetani

Image-goal navigation enables a robot to reach the location where a target image was captured, using visual cues for guidance. However, current methods either rely heavily on data and computationally expensive learning-based approaches or…

Robotics · Computer Science 2024-09-17 Wugang Meng , Tianfu Wu , Huan Yin , Fumin Zhang

The scalability of robotic learning is fundamentally bottlenecked by the significant cost and labor of real-world data collection. While simulated data offers a scalable alternative, it often fails to generalize to the real world due to…

Reconstructing dynamic scenes with large-scale and complex motions remains a significant challenge. Recent techniques like Neural Radiance Fields and 3D Gaussian Splatting (3DGS) have shown promise but still struggle with scenes involving…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Qiankun Gao , Yanmin Wu , Chengxiang Wen , Jiarui Meng , Luyang Tang , Jie Chen , Ronggang Wang , Jian Zhang

We propose a method to enhance 3D Gaussian Splatting (3DGS)~\cite{Kerbl2023}, addressing challenges in initialization, optimization, and density control. Gaussian Splatting is an alternative for rendering realistic images while supporting…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Xingjun Wang , Lianlei Shan

Embodied AI research is undergoing a shift toward vision-centric perceptual paradigms. While massively parallel simulators have catalyzed breakthroughs in proprioception-based locomotion, their potential remains largely untapped for…

3D Gaussian Splatting SLAM has emerged as a widely used technique for high-fidelity mapping in spatial intelligence. However, existing methods often rely on a single representation scheme, which limits their performance in large-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Wenkai Zhu , Xu Li , Qimin Xu , Benwu Wang , Kun Wei , Yiming Peng , Zihang Wang

As consumer Virtual Reality (VR) and Mixed Reality (MR) technologies gain momentum, there's a growing focus on the development of engagements with 3D virtual content. Unfortunately, traditional techniques for content creation, editing, and…

Human-Computer Interaction · Computer Science 2024-05-07 Ying Jiang , Chang Yu , Tianyi Xie , Xuan Li , Yutao Feng , Huamin Wang , Minchen Li , Henry Lau , Feng Gao , Yin Yang , Chenfanfu Jiang

This paper targets the challenge of real-time LiDAR re-simulation in dynamic driving scenarios. Recent approaches utilize neural radiance fields combined with the physical modeling of LiDAR sensors to achieve high-fidelity re-simulation…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Chenxu Zhou , Lvchang Fu , Sida Peng , Yunzhi Yan , Zhanhua Zhang , Yong Chen , Jiazhi Xia , Xiaowei Zhou

Efficient acquisition of real-world embodied data has been increasingly critical. However, large-scale demonstrations captured by remote operation tend to take extremely high costs and fail to scale up the data size in an efficient manner.…

Robotics · Computer Science 2025-08-05 Xinhai Li , Jialin Li , Ziheng Zhang , Rui Zhang , Fan Jia , Tiancai Wang , Haoqiang Fan , Kuo-Kun Tseng , Ruiping Wang

Reconstructing and predicting dynamic 3D scenes from multi-view videos is a foundational task for robotics, AR/VR, and digital twins. Recent physics-informed Gaussian Splatting methods achieve impressive future frame extrapolation but lack…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Denis Gridusov , Maxim Popov , Sergey Kolyubin

Dynamic scene rendering opens new avenues in autonomous driving by enabling closed-loop simulations with photorealistic data, which is crucial for validating end-to-end algorithms. However, the complex and highly dynamic nature of traffic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Rui Song , Chenwei Liang , Yan Xia , Walter Zimmer , Hu Cao , Holger Caesar , Andreas Festag , Alois Knoll

Scalable sensor simulation is an important yet challenging open problem for safety-critical domains such as self-driving. Current works in image simulation either fail to be photorealistic or do not model the 3D environment and the dynamic…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Yun Chen , Frieda Rong , Shivam Duggal , Shenlong Wang , Xinchen Yan , Sivabalan Manivasagam , Shangjie Xue , Ersin Yumer , Raquel Urtasun

The emergence of 3D Gaussian Splatting for fast and high-quality novel view synthesize has opened up the possibility to construct photo-realistic simulations from video for robotic reinforcement learning. While the approach has been…

Robotics · Computer Science 2024-10-28 Liyou Zhou , Oleg Sinavski , Athanasios Polydoros

We present DeSiRe-GS, a self-supervised gaussian splatting representation, enabling effective static-dynamic decomposition and high-fidelity surface reconstruction in complex driving scenarios. Our approach employs a two-stage optimization…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Chensheng Peng , Chengwei Zhang , Yixiao Wang , Chenfeng Xu , Yichen Xie , Wenzhao Zheng , Kurt Keutzer , Masayoshi Tomizuka , Wei Zhan

Learning visuomotor policies for Autonomous Aerial Vehicles (AAVs) relying solely on monocular vision is an attractive yet highly challenging paradigm. Existing end-to-end learning approaches directly map high-dimensional RGB observations…

Robotics · Computer Science 2026-04-08 Yuhang Zhang , Mingsheng Li , Yujing Shang , Zhuoyuan Yu , Chao Yan , Jiaping Xiao , Mir Feroskhan

Dynamic scene reconstruction has garnered significant attention in recent years due to its capabilities in high-quality and real-time rendering. Among various methodologies, constructing a 4D spatial-temporal representation, such as 4D-GS,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Weiwei Cai , Weicai Ye , Peng Ye , Tong He , Tao Chen

Open-vocabulary panoptic reconstruction is essential for advanced robotics perception and simulation. However, existing methods based on 3D Gaussian Splatting (3DGS) often struggle to simultaneously achieve geometric accuracy, coherent…

Robotics · Computer Science 2026-04-14 Xuan Yu , Yuxuan Xie , Changjian Jiang , Shichao Zhai , Rong Xiong , Yu Zhang , Yue Wang

In-hand object reorientation requires precise estimation of the object pose to handle complex task dynamics. While RGB sensing offers rich semantic cues for pose tracking, existing solutions rely on multi-camera setups or costly ray…

Robotics · Computer Science 2026-04-14 Arjun Bhardwaj , Maximum Wilder-Smith , Mayank Mittal , Vaishakh Patil , Marco Hutter

Reconstructing dynamic 3D scenes with photorealistic detail and strong temporal coherence remains a significant challenge. Existing Gaussian splatting approaches for dynamic scene modeling often rely on per-frame optimization, which can…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Tingxuan Huang , Haowei Zhu , Jun-hai Yong , Hao Pan , Bin Wang