English
Related papers

Related papers: MuDG: Taming Multi-modal Diffusion with Gaussian S…

200 papers

This paper proposes Neural-MMGS, a novel neural 3DGS framework for multimodal large-scale scene reconstruction that fuses multiple sensing modalities in a per-gaussian compact, learnable embedding. While recent works focusing on large-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Sitian Shen , Georgi Pramatarov , Yifu Tao , Daniele De Martini

Novel-view synthesis aims to generate novel views of a scene from multiple input images or videos, and recent advancements like 3D Gaussian splatting (3DGS) have achieved notable success in producing photorealistic renderings with efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Xi Liu , Chaoyi Zhou , Siyu Huang

We present GSD, a diffusion model approach based on Gaussian Splatting (GS) representation for 3D object reconstruction from a single view. Prior works suffer from inconsistent 3D geometry or mediocre rendering quality due to improper…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Yuxuan Mu , Xinxin Zuo , Chuan Guo , Yilin Wang , Juwei Lu , Xiaofeng Wu , Songcen Xu , Peng Dai , Youliang Yan , Li Cheng

3D Gaussian Splatting (3DGS) has demonstrated remarkable performance in scene synthesis and novel view synthesis tasks. Typically, the initialization of 3D Gaussian primitives relies on point clouds derived from Structure-from-Motion (SfM)…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Shan Chen , Jiale Zhou , Lei Li

In this study, we present an end-to-end pipeline capable of converting drone-captured video streams into high-fidelity 3D reconstructions with minimal latency. Unmanned aerial vehicles (UAVs) are extensively used in aerial real-time…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Christos Maikos , Georgios Angelidis , Georgios Th. Papadopoulos

3D Gaussian Splatting (3DGS) has emerged as a transformative method in the field of real-time novel synthesis. Based on 3DGS, recent advancements cope with large-scale scenes via spatial-based partition strategy to reduce video memory and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Tengfei Wang , Xin Wang , Yongmao Hou , Yiwei Xu , Wendi Zhang , Zongqian Zhan

Novel view synthesis (NVS) and surface reconstruction (SR) are essential tasks in 3D Gaussian Splatting (3D-GS). Despite recent progress, these tasks are often addressed independently, with GS-based rendering methods struggling under…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Qingyuan Zhou , Yuehu Gong , Weidong Yang , Jiaze Li , Yeqi Luo , Baixin Xu , Shuhao Li , Ben Fei , Ying He

This paper focuses on scene reconstruction under nighttime conditions in autonomous driving simulation. Recent methods based on Neural Radiance Fields (NeRFs) and 3D Gaussian Splatting (3DGS) have achieved photorealistic modeling in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Tae-Kyeong Kim , Xingxin Chen , Guile Wu , Chengjie Huang , Dongfeng Bai , Bingbing Liu

3D scene representations have gained immense popularity in recent years. Methods that use Neural Radiance fields are versatile for traditional tasks such as novel view synthesis. In recent times, some work has emerged that aims to extend…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Shijie Zhou , Haoran Chang , Sicheng Jiang , Zhiwen Fan , Zehao Zhu , Dejia Xu , Pradyumna Chari , Suya You , Zhangyang Wang , Achuta Kadambi

This work focuses on modeling dynamic urban environments for autonomous driving simulation. Contemporary data-driven methods using neural radiance fields have achieved photorealistic driving scene modeling, but they suffer from low…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Guile Wu , Dongfeng Bai , Bingbing Liu

While 3D Gaussian Splatting (3DGS) enables high-quality, real-time rendering for bounded scenes, its extension to large-scale urban environments gives rise to critical challenges in terms of geometric consistency, memory efficiency, and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Changbai Li , Haodong Zhu , Hanlin Chen , Xiuping Liang , Tongfei Chen , Shuwei Shao , Linlin Yang , Huobin Tan , Baochang Zhang

Recent advances in 3D Gaussian Splatting have shown remarkable potential for novel view synthesis. However, most existing large-scale scene reconstruction methods rely on the divide-and-conquer paradigm, which often leads to the loss of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Chuandong Liu , Huijiao Wang , Lei Yu , Gui-Song Xia

3D scene reconstruction and rendering are core tasks in computer vision, with applications spanning industrial monitoring, robotics, and autonomous driving. Recent advances in 3D Gaussian Splatting (GS) and its variants have achieved…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Chi-Shiang Gau , Konstantinos D. Polyzos , Athanasios Bacharis , Saketh Madhuvarasu , Tara Javidi

Generating ground-level views and coherent 3D site models from aerial-only imagery is challenging due to extreme viewpoint changes, missing intermediate observations, and large scale variations. Existing methods either refine renderings…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Sirshapan Mitra , Yogesh S. Rawat

3D Gaussian Splatting (3DGS) has recently emerged as a powerful explicit representation enabling fast, high-fidelity rendering, making it a promising foundation for closed-loop simulators and perception models in autonomous driving.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Kota Shimomura , Hidehisa Arai , Tsubasa Takahashi , Takayoshi Yamashita , Hironobu Fujiyoshi

Recent 3D Gaussian Splatting (3DGS) methods have demonstrated the feasibility of self-driving scene reconstruction and novel view synthesis. However, most existing methods either rely solely on cameras or use LiDAR only for Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 ZY Chen , F Zhu , H Zhu , DY Kong , XK Kuang , YJ Zhang , CM Jiang

Seamless integration of both aerial and street view images remains a significant challenge in neural scene reconstruction and rendering. Existing methods predominantly focus on single domain, limiting their applications in immersive…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Lihan Jiang , Kerui Ren , Mulin Yu , Linning Xu , Junting Dong , Tao Lu , Feng Zhao , Dahua Lin , Bo Dai

Novel view synthesis of urban scenes is essential for autonomous driving-related applications.Existing NeRF and 3DGS-based methods show promising results in achieving photorealistic renderings but require slow, per-scene optimization. We…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Sheng Miao , Jiaxin Huang , Dongfeng Bai , Xu Yan , Hongyu Zhou , Yue Wang , Bingbing Liu , Andreas Geiger , Yiyi Liao

Recently, 3D Gaussian Splatting and its derivatives have achieved significant breakthroughs in large-scale scene reconstruction. However, how to efficiently and stably achieve high-quality geometric fidelity remains a core challenge. To…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Kehua Chen , Tianlu Mao , Xinzhu Ma , Hao Jiang , Zehao Li , Zihan Liu , Shuqin Gao , Honglong Zhao , Feng Dai , Yucheng Zhang , Zhaoqi Wang

LiDAR novel view synthesis (NVS) has emerged as a novel task within LiDAR simulation, offering valuable simulated point cloud data from novel viewpoints to aid in autonomous driving systems. However, existing LiDAR NVS methods typically…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Junzhe Jiang , Chun Gu , Yurui Chen , Li Zhang