中文
相关论文

相关论文: Real2Sim: A Physics-driven and Editable Gaussian S…

200 篇论文

Detecting a diverse range of objects under various driving scenarios is essential for the effectiveness of autonomous driving systems. However, the real-world data collected often lacks the necessary diversity presenting a long-tail…

计算机视觉与模式识别 · 计算机科学 2024-03-25 Aqeel Anwar , Tae Eun Choe , Zian Wang , Sanja Fidler , Minwoo Park

Representing and rendering dynamic scenes has been an important but challenging task. Especially, to accurately model complex motions, high efficiency is usually hard to guarantee. To achieve real-time dynamic scene rendering while also…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Guanjun Wu , Taoran Yi , Jiemin Fang , Lingxi Xie , Xiaopeng Zhang , Wei Wei , Wenyu Liu , Qi Tian , Xinggang Wang

Data-driven learning approaches for physics simulation, sometimes referred to as world models, have emerged as promising alternatives to traditional physics simulators due to their differentiable nature. Prior work has demonstrated…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Chanho Kim , Suhas V. Sumukh , Li Fuxin

The realistic reconstruction of street scenes is critical for developing real-world simulators in autonomous driving. Most existing methods rely on object pose annotations, using these poses to reconstruct dynamic objects and move them…

计算机视觉与模式识别 · 计算机科学 2025-07-09 Zipei Ma , Junzhe Jiang , Yurui Chen , Li Zhang

Robust and realistic rendering for large-scale road scenes is essential in autonomous driving simulation. Recently, 3D Gaussian Splatting (3D-GS) has made groundbreaking progress in neural rendering, but the general fidelity of large-scale…

计算机视觉与模式识别 · 计算机科学 2024-08-28 Saining Zhang , Baijun Ye , Xiaoxue Chen , Yuantao Chen , Zongzheng Zhang , Cheng Peng , Yongliang Shi , Hao Zhao

Dynamic 4D Gaussian Splatting (4DGS) effectively extends the high-speed rendering capabilities of 3D Gaussian Splatting (3DGS) to represent volumetric videos. However, the large number of Gaussians, substantial temporal redundancies, and…

图形学 · 计算机科学 2026-01-14 Hyeongmin Lee , Kyungjune Baek

Autonomous driving evaluation requires simulation environments that closely replicate actual road conditions, including real-world sensory data and responsive feedback loops. However, many existing simulations need to predict waypoints…

机器人学 · 计算机科学 2024-11-19 Tianyi Yan , Dongming Wu , Wencheng Han , Junpeng Jiang , Xia Zhou , Kun Zhan , Cheng-zhong Xu , Jianbing Shen

Accurate 3D reconstruction of vehicles is vital for applications such as vehicle inspection, predictive maintenance, and urban planning. Existing methods like Neural Radiance Fields and Gaussian Splatting have shown impressive results but…

计算机视觉与模式识别 · 计算机科学 2025-07-17 Davide Di Nucci , Matteo Tomei , Guido Borghi , Luca Ciuffreda , Roberto Vezzani , Rita Cucchiara

Cross-domain transfer in robotic manipulation remains a longstanding challenge due to the significant domain gap between simulated and real-world environments. Existing methods such as domain randomization, adaptation, and sim-real…

机器人学 · 计算机科学 2025-12-05 Jian Tang , Pu Pang , Haowen Sun , Chengzhong Ma , Xingyu Chen , Hua Huang , Xuguang Lan

Photorealistic 4D reconstruction of street scenes is essential for developing real-world simulators in autonomous driving. However, most existing methods perform this task offline and rely on time-consuming iterative processes, limiting…

计算机视觉与模式识别 · 计算机科学 2024-12-13 Hao Lu , Tianshuo Xu , Wenzhao Zheng , Yunpeng Zhang , Wei Zhan , Dalong Du , Masayoshi Tomizuka , Kurt Keutzer , Yingcong Chen

Novel view synthesis has shown rapid progress recently, with methods capable of producing increasingly photorealistic results. 3D Gaussian Splatting has emerged as a promising method, producing high-quality renderings of scenes and enabling…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Richard Shaw , Michal Nazarczuk , Jifei Song , Arthur Moreau , Sibi Catley-Chandar , Helisa Dhamo , Eduardo Perez-Pellitero

Simultaneous localization and mapping (SLAM) technology has recently achieved photorealistic mapping capabilities thanks to the real-time, high-fidelity rendering enabled by 3D Gaussian Splatting (3DGS). However, due to the static…

机器人学 · 计算机科学 2025-12-01 Zhicong Sun , Jacqueline Lo , Jinxing Hu

We consider the problem of estimating an object's physical properties such as mass, friction, and elasticity directly from video sequences. Such a system identification problem is fundamentally ill-posed due to the loss of information…

Scene view synthesis, which generates novel views from limited perspectives, is increasingly vital for applications like virtual reality, augmented reality, and robotics. Unlike object-based tasks, such as generating 360{\deg} views of a…

计算机视觉与模式识别 · 计算机科学 2025-04-29 Xiaofeng Jin , Yan Fang , Matteo Frosi , Jianfei Ge , Jiangjian Xiao , Matteo Matteucci

This paper describes the Qualcomm AI Research solution to the RealADSim-NVS challenge, hosted at the RealADSim Workshop at ICCV 2025. The challenge concerns novel view synthesis in street scenes, and participants are required to generate,…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Mohamed Omran , Farhad Zanjani , Davide Abati , Jens Petersen , Amirhossein Habibian

Reconstructing dynamic scenes with multiple interacting humans and objects from sparse-view inputs is a critical yet challenging task, essential for creating high-fidelity digital twins for robotics and VR/AR. This problem, which we term…

计算机视觉与模式识别 · 计算机科学 2026-04-09 Weiquan Wang , Jun Xiao , Feifei Shao , Yi Yang , Yueting Zhuang , Long Chen

This paper introduces a novel pipeline for generating large-scale, highly realistic, and automatically labeled datasets for computer vision tasks in robotic environments. Our approach addresses the critical challenges of the domain gap…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Patryk Niżeniec , Marcin Iwanowski

The scalability of embodied intelligence is fundamentally constrained by the scarcity of real-world interaction data. While simulation platforms provide a promising alternative, existing approaches often suffer from a substantial visual and…

Recent advances in 3D representations, such as Neural Radiance Fields and 3D Gaussian Splatting, have greatly improved realistic scene modeling and novel-view synthesis. However, achieving controllable and consistent editing in dynamic 3D…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Kai He , Chin-Hsuan Wu , Igor Gilitschenski

Real2Sim2Real plays a critical role in robotic arm control and reinforcement learning, yet bridging this gap remains a significant challenge due to the complex physical properties of robots and the objects they manipulate. Existing methods…