English
Related papers

Related papers: Mirage2Matter: A Physically Grounded Gaussian Worl…

200 papers

3D Gaussian Splatting reconstructs scenes by starting from a sparse Structure-from-Motion initialization and refining under-reconstructed regions. This process is slow, as it requires multiple densification steps where Gaussians are…

Graphics · Computer Science 2026-02-13 Dmytro Kotovenko , Olga Grebenkova , Björn Ommer

Modern autonomous vehicle simulators feature an ever-growing library of assets, including vehicles, buildings, roads, pedestrians, and more. While this level of customization proves beneficial when creating virtual urban environments, this…

Robotics · Computer Science 2024-12-30 Rami Wilson

Modern vision language pipelines are driven by RGB vision encoders trained on massive image text corpora. While these pipelines have enabled impressive zero-shot capabilities and strong transfer across tasks, they still inherit two…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Yasmine Omri , Connor Ding , Tsachy Weissman , Thierry Tambe

Despite its significant achievements in large-scale scene reconstruction, 3D Gaussian Splatting still faces substantial challenges, including slow processing, high computational costs, and limited geometric accuracy. These core issues arise…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yuanyuan Gao , Hao Li , Jiaqi Chen , Zhengyu Zou , Zhihang Zhong , Dingwen Zhang , Xiao Sun , Junwei Han

Reconstructing large-scale urban scenes from sparse aerial views is a crucial yet challenging task. Due to biased top-down and shallow-oblique camera poses, sparse aerial captures exhibit strong evidence imbalance: roofs and open regions…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Dongli Wu , Zhuoxiao Li , Tongyan Hua , Yinrui Ren , Xiaobao Wei , Rongjun Qin , Wufan Zhao

Building articulated objects is a key challenge in computer vision. Existing methods often fail to effectively integrate information across different object states, limiting the accuracy of part-mesh reconstruction and part dynamics…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Yu Liu , Baoxiong Jia , Ruijie Lu , Junfeng Ni , Song-Chun Zhu , Siyuan Huang

Urban scene reconstruction requires modeling both static infrastructure and dynamic elements while supporting diverse environmental conditions. We present \textbf{StyledStreets}, a multi-style street simulator that achieves…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Yuyin Chen , Yida Wang , Xueyang Zhang , Kun Zhan , Peng Jia , Yifei Zhan , Xianpeng Lang

3D Gaussian Splatting has achieved remarkable success in reconstructing both static and dynamic 3D scenes. However, in a scene represented by 3D Gaussian primitives, interactions between objects suffer from inaccurate 3D segmentation,…

Graphics · Computer Science 2025-06-10 Zeyu Xiao , Zhenyi Wu , Mingyang Sun , Qipeng Yan , Yufan Guo , Zhuoer Liang , Lihua Zhang

Developing world models that understand complex physical interactions is essential for advancing robotic planning and simulation.However, existing methods often struggle to accurately model the environment under conditions of data scarcity…

Robotics · Computer Science 2026-02-12 Meizhong Wang , Wanxin Jin , Kun Cao , Lihua Xie , Yiguang Hong

3D Shape represented as point cloud has achieve advancements in multimodal pre-training to align image and language descriptions, which is curial to object identification, classification, and retrieval. However, the discrete representations…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Haoyuan Li , Yanpeng Zhou , Yihan Zeng , Hang Xu , Xiaodan Liang

We introduce OmniRe, a comprehensive system for efficiently creating high-fidelity digital twins of dynamic real-world scenes from on-device logs. Recent methods using neural fields or Gaussian Splatting primarily focus on vehicles,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Ziyu Chen , Jiawei Yang , Jiahui Huang , Riccardo de Lutio , Janick Martinez Esturo , Boris Ivanovic , Or Litany , Zan Gojcic , Sanja Fidler , Marco Pavone , Li Song , Yue Wang

This paper proposes Neural-MMGS, a novel neural 3DGS framework for multimodal large-scale scene reconstruction that fuses multiple sensing modalities in a per-gaussian compact, learnable embedding. While recent works focusing on large-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Sitian Shen , Georgi Pramatarov , Yifu Tao , Daniele De Martini

The development of generalizable Novel View Synthesis (NVS) models is critically limited by the scarcity of large-scale training data featuring diverse and precise camera trajectories. While real-world captures are photorealistic, they are…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Chenhan Jiang , Yu Chen , Qingwen Zhang , Jifei Song , Songcen Xu , Dit-Yan Yeung , Jiankang Deng

This work focuses on modeling dynamic urban environments for autonomous driving simulation. Contemporary data-driven methods using neural radiance fields have achieved photorealistic driving scene modeling, but they suffer from low…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Guile Wu , Dongfeng Bai , Bingbing Liu

Recent advances in novel view synthesis (NVS) have enabled real-time rendering with 3D Gaussian Splatting (3DGS). However, existing methods struggle with artifacts and missing regions when rendering from viewpoints that deviate from the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Minsu Kim , Subin Jeon , In Cho , Mijin Yoo , Seon Joo Kim

UAV navigation in unstructured outdoor environments using passive monocular vision is hindered by the substantial visual domain gap between simulation and reality. While 3D Gaussian Splatting enables photorealistic scene reconstruction from…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Zinan Lv , Yeqian Qian , Chen Sang , Hao Liu , Danping Zou , Ming Yang

Recent advancements in 3D Gaussian Splatting(3DGS) have significantly improved semantic scene understanding, enabling natural language queries to localize objects within a scene. However, existing methods primarily focus on embedding…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Xihan Wang , Dianyi Yang , Yu Gao , Yufeng Yue , Yi Yang , Mengyin Fu

Understanding and replicating the real world is a critical challenge in Artificial General Intelligence (AGI) research. To achieve this, many existing approaches, such as world models, aim to capture the fundamental principles governing the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Yuqi Hu , Longguang Wang , Xian Liu , Ling-Hao Chen , Yuwei Guo , Yukai Shi , Ce Liu , Anyi Rao , Zeyu Wang , Hui Xiong

World models empower model-based agents to interactively explore, reason, and plan within imagined environments for real-world decision-making. However, the high demand for interactivity poses challenges in harnessing recent advancements in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jialong Wu , Shaofeng Yin , Ningya Feng , Xu He , Dong Li , Jianye Hao , Mingsheng Long

This paper investigates an open research challenge of reconstructing high-quality, large 3D open scenes from images. It is observed existing methods have various limitations, such as requiring precise camera poses for input and dense…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Chong Cheng , Gaochao Song , Yiyang Yao , Qinzheng Zhou , Gangjian Zhang , Hao Wang