English
Related papers

Related papers: SIMSplat: Predictive Driving Scene Editing with La…

200 papers

Learning 4D language fields to enable time-sensitive, open-ended language queries in dynamic scenes is essential for many real-world applications. While LangSplat successfully grounds CLIP features into 3D Gaussian representations,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Wanhua Li , Renping Zhou , Jiawei Zhou , Yingwei Song , Johannes Herter , Minghan Qin , Gao Huang , Hanspeter Pfister

We have introduced SegSplat, a novel framework designed to bridge the gap between rapid, feed-forward 3D reconstruction and rich, open-vocabulary semantic understanding. By constructing a compact semantic memory bank from multi-view 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Peter Siegel , Federico Tombari , Marc Pollefeys , Daniel Barath

Open-vocabulary 3D scene understanding presents a significant challenge in computer vision, with wide-ranging applications in embodied agents and augmented reality systems. Existing methods adopt neurel rendering methods as 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Jun Guo , Xiaojian Ma , Yue Fan , Huaping Liu , Qing Li

TL;DR: Gaussian Splatting is a widely adopted approach for 3D scene representation, offering efficient, high-quality reconstruction and rendering. A key reason for its success is the simplicity of representing scenes with sets of Gaussians,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Jiahuan Cheng , Jan-Nico Zaech , Luc Van Gool , Danda Pani Paudel

Novel view synthesis of urban scenes is essential for autonomous driving-related applications.Existing NeRF and 3DGS-based methods show promising results in achieving photorealistic renderings but require slow, per-scene optimization. We…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Sheng Miao , Jiaxin Huang , Dongfeng Bai , Xu Yan , Hongyu Zhou , Yue Wang , Bingbing Liu , Andreas Geiger , Yiyi Liao

Many 3D scene editing tasks focus on modifying local regions rather than the entire scene, except for some global applications like style transfer, and in the context of 3D Gaussian Splatting (3DGS), where scenes are represented by a series…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Lanqing Guo , Yufei Wang , Hezhen Hu , Yan Zheng , Yeying Jin , Siyu Huang , Zhangyang Wang

3D Gaussian Splatting (3DGS) has recently unlocked real-time, high-fidelity novel view synthesis by representing scenes using explicit 3D primitives. However, traditional methods often require millions of Gaussians to capture complex…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Anh Thuan Tran , Jana Kosecka

Novel view synthesis has shown rapid progress recently, with methods capable of producing increasingly photorealistic results. 3D Gaussian Splatting has emerged as a promising method, producing high-quality renderings of scenes and enabling…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Richard Shaw , Michal Nazarczuk , Jifei Song , Arthur Moreau , Sibi Catley-Chandar , Helisa Dhamo , Eduardo Perez-Pellitero

This work focuses on modeling dynamic urban environments for autonomous driving simulation. Contemporary data-driven methods using neural radiance fields have achieved photorealistic driving scene modeling, but they suffer from low…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Guile Wu , Dongfeng Bai , Bingbing Liu

With the emergence of large-scale Text-to-Image(T2I) models and implicit 3D representations like Neural Radiance Fields (NeRF), many text-driven generative editing methods based on NeRF have appeared. However, the implicit encoding of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Yanhao Sun , RunZe Tian , Xiao Han , XinYao Liu , Yan Zhang , Kai Xu

Autonomous driving systems rely heavily on multimodal perception data to understand complex environments. However, the long-tailed distribution of real-world data hinders generalization, especially for rare but safety-critical vehicle…

Artificial Intelligence · Computer Science 2025-08-01 Shouyi Lu , Zihan Lin , Chao Lu , Huanran Wang , Guirong Zhuo , Lianqing Zheng

Language-augmented scene representations hold great promise for large-scale robotics applications such as search-and-rescue, smart cities, and mining. Many of these scenarios are time-sensitive, requiring rapid scene encoding while also…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Laszlo Szilagyi , Francis Engelmann , Jeannette Bohg

Recent advancements in camera-based occupancy prediction have focused on the simultaneous prediction of 3D semantics and scene flow, a task that presents significant challenges due to specific difficulties, e.g., occlusions and unbalanced…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Ziyue Zhu , Shenlong Wang , Jin Xie , Jiang-jiang Liu , Jingdong Wang , Jian Yang

The modeling and manipulation of 3D scenes captured from the real world are pivotal in various applications, attracting growing research interest. While previous works on editing have achieved interesting results through manipulating 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Guan Luo , Tian-Xing Xu , Ying-Tian Liu , Xiao-Xiong Fan , Fang-Lue Zhang , Song-Hai Zhang

Recent advances in text-to-3D creation integrate the potent prior of Diffusion Models from text-to-image generation into 3D domain. Nevertheless, generating 3D scenes with multiple objects remains challenging. Therefore, we present…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Yueming Zhao , Xuening Yuan , Hongyu Yang , Di Huang

Dynamic scene reconstruction represents a fundamental yet demanding challenge in computer vision and robotics. While recent progress in 3DGS-based methods has advanced dynamic scene modeling, obtaining high-fidelity rendering and accurate…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yinan Deng , Jianyu Dou , Jiahui Wang , Jingyu Zhao , Yi Yang , Yufeng Yue

Novel view synthesis (NVS) of static and dynamic urban scenes is essential for autonomous driving simulation, yet existing methods often struggle to balance reconstruction time with quality. While state-of-the-art neural radiance fields and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Sheng Miao , Sijin Li , Pan Wang , Dongfeng Bai , Bingbing Liu , Yue Wang , Andreas Geiger , Yiyi Liao

Generating synthetic images is a useful method for cheaply obtaining labeled data for training computer vision models. However, obtaining accurate 3D models of relevant objects is necessary, and the resulting images often have a gap in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Bram Vanherle , Brent Zoomers , Jeroen Put , Frank Van Reeth , Nick Michiels

As multimodal language models advance, their application to 3D scene understanding is a fast-growing frontier, driving the development of 3D Vision-Language Models (VLMs). Current methods show strong dependence on object detectors,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Anna-Maria Halacheva , Jan-Nico Zaech , Xi Wang , Danda Pani Paudel , Luc Van Gool

Feed-forward 3D Gaussian Splatting methods have achieved impressive reconstruction quality for autonomous driving scenes, yet they entangle scene geometry with transient appearance properties such as lighting, weather, and time of day. This…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Quentin Herau , Tianshuo Xu , Depu Meng , Jiezhi Yang , Chensheng Peng , Spencer Sherk , Yihan Hu , Wei Zhan