中文
相关论文

相关论文: High-Fidelity Simulated Data Generation for Real-W…

200 篇论文

We propose HoliGS, a novel deformable Gaussian splatting framework that addresses embodied view synthesis from long monocular RGB videos. Unlike prior 4D Gaussian splatting and dynamic NeRF pipelines, which struggle with training overhead…

计算机视觉与模式识别 · 计算机科学 2025-06-25 Xiaoyuan Wang , Yizhou Zhao , Botao Ye , Xiaojun Shan , Weijie Lyu , Lu Qi , Kelvin C. K. Chan , Yinxiao Li , Ming-Hsuan Yang

Robotic cutting, or milling, plays a significant role in applications such as disassembly, decommissioning, and demolition. Planning and control of cutting in real-world scenarios in uncertain environments is a complex task, with the…

机器人学 · 计算机科学 2024-09-09 Jamie Hathaway , Rustam Stolkin , Alireza Rastegarpanah

Novel view synthesis for dynamic scenes is still a challenging problem in computer vision and graphics. Recently, Gaussian splatting has emerged as a robust technique to represent static scenes and enable high-quality and real-time novel…

计算机视觉与模式识别 · 计算机科学 2024-04-15 Yi-Hua Huang , Yang-Tian Sun , Ziyi Yang , Xiaoyang Lyu , Yan-Pei Cao , Xiaojuan Qi

Reliable simulation evaluation of robot manipulation policies serves as a high-fidelity proxy for real-world performance. Although existing benchmarks cover a wide range of task categories, they lack visual realism, creating a large domain…

机器人学 · 计算机科学 2026-05-08 Yixin Zhu , Zixiong Wang , Jian Yang , Jin Xie , Jingyi Yu , Jiayuan Gu , Beibei Wang

Accurately manipulating articulated objects is a challenging yet important task for real robot applications. In this paper, we present a novel framework called Sim2Real$^2$ to enable the robot to manipulate an unseen articulated object to…

机器人学 · 计算机科学 2023-02-22 Liqian Ma , Jiaojiao Meng , Shuntao Liu , Weihang Chen , Jing Xu , Rui Chen

Language-augmented scene representations hold great promise for large-scale robotics applications such as search-and-rescue, smart cities, and mining. Many of these scenarios are time-sensitive, requiring rapid scene encoding while also…

计算机视觉与模式识别 · 计算机科学 2025-08-19 Laszlo Szilagyi , Francis Engelmann , Jeannette Bohg

3D Gaussian Splatting is a powerful visual representation, providing high-quality and efficient 3D scene reconstruction, but it is crucially dependent on accurate camera poses typically obtained from computationally intensive processes like…

机器人学 · 计算机科学 2026-04-15 Daniel Yang , Jungseok Hong , John J. Leonard , Yogesh Girdhar

3D Gaussian Splatting (3DGS) has garnered significant attention in robotics for its explicit, high fidelity dense scene representation, demonstrating strong potential for robotic applications. However, 3DGS-based methods in robotics…

机器人学 · 计算机科学 2025-03-25 Bin Fu , Jialin Li , Bin Zhang , Ruiping Wang , Xilin Chen

Novel view synthesis has shown rapid progress recently, with methods capable of producing increasingly photorealistic results. 3D Gaussian Splatting has emerged as a promising method, producing high-quality renderings of scenes and enabling…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Richard Shaw , Michal Nazarczuk , Jifei Song , Arthur Moreau , Sibi Catley-Chandar , Helisa Dhamo , Eduardo Perez-Pellitero

As consumer Virtual Reality (VR) and Mixed Reality (MR) technologies gain momentum, there's a growing focus on the development of engagements with 3D virtual content. Unfortunately, traditional techniques for content creation, editing, and…

人机交互 · 计算机科学 2024-05-07 Ying Jiang , Chang Yu , Tianyi Xie , Xuan Li , Yutao Feng , Huamin Wang , Minchen Li , Henry Lau , Feng Gao , Yin Yang , Chenfanfu Jiang

Reconstructing dynamic 3D scenes from 2D images and generating diverse views over time is challenging due to scene complexity and temporal dynamics. Despite advancements in neural implicit models, limitations persist: (i) Inadequate Scene…

计算机视觉与模式识别 · 计算机科学 2024-02-23 Zeyu Yang , Hongye Yang , Zijie Pan , Li Zhang

By combining differentiable rendering with explicit point-based scene representations, 3D Gaussian Splatting (3DGS) has demonstrated breakthrough 3D reconstruction capabilities. However, to date 3DGS has had limited impact on robotics,…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Tianyi Xiong , Jiayi Wu , Botao He , Cornelia Fermuller , Yiannis Aloimonos , Heng Huang , Christopher A. Metzler

Simultaneous Localization and Mapping (SLAM) is a foundational component in robotics, AR/VR, and autonomous systems. With the rising focus on spatial AI in recent years, combining SLAM with semantic understanding has become increasingly…

计算机视觉与模式识别 · 计算机科学 2026-02-11 Jisang Yoo , Gyeongjin Kang , Hyun-kyu Ko , Hyeonwoo Yu , Eunbyung Park

While 3D Gaussian Splatting (3DGS) has revolutionized photorealistic rendering, its vast ecosystem of assets remains incompatible with high-performance LiDAR simulation, a critical tool for robotics and autonomous driving. We present…

机器人学 · 计算机科学 2025-09-23 Junzhe Wu , Yufei Jia , Yiyi Yan , Zhixing Chen , Tiao Tan , Zifan Wang , Guangyu Wang

3D Gaussian Splatting (3DGS) has gained significant attention for its real-time, photo-realistic rendering in novel-view synthesis and 3D modeling. However, existing methods struggle with accurately modeling scenes affected by transient…

计算机视觉与模式识别 · 计算机科学 2025-07-30 Chuanyu Fu , Yuqi Zhang , Kunbin Yao , Guanying Chen , Yuan Xiong , Chuan Huang , Shuguang Cui , Xiaochun Cao

Reconstructing and predicting dynamic 3D scenes from multi-view videos is a foundational task for robotics, AR/VR, and digital twins. Recent physics-informed Gaussian Splatting methods achieve impressive future frame extrapolation but lack…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Denis Gridusov , Maxim Popov , Sergey Kolyubin

Robot simulation has been an essential tool for data-driven manipulation tasks. However, most existing simulation frameworks lack either efficient and accurate models of physical interactions with tactile sensors or realistic tactile…

机器人学 · 计算机科学 2022-08-08 Zilin Si , Zirui Zhu , Arpit Agarwal , Stuart Anderson , Wenzhen Yuan

Recent advances in Gaussian Splatting have enabled fast, high-fidelity 3D scene generation, yet these methods remain purely visual and lack an understanding of how shapes behave in the physical world. We introduce Physics-Guided 3D Gaussian…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Zachary Lee , Maxwell Jacobson , Yexiang Xue

Building articulated objects is a key challenge in computer vision. Existing methods often fail to effectively integrate information across different object states, limiting the accuracy of part-mesh reconstruction and part dynamics…

计算机视觉与模式识别 · 计算机科学 2025-05-28 Yu Liu , Baoxiong Jia , Ruijie Lu , Junfeng Ni , Song-Chun Zhu , Siyuan Huang

Previous surface reconstruction methods either suffer from low geometric accuracy or lengthy training times when dealing with real-world complex dynamic scenes involving multi-person activities, and human-object interactions. To tackle the…

计算机视觉与模式识别 · 计算机科学 2024-09-30 Shuo Wang , Binbin Huang , Ruoyu Wang , Shenghua Gao