English
Related papers

Related papers: Joint Semantic and Rendering Enhancements in 3D Ga…

200 papers

Open-vocabulary querying in 3D space is challenging but essential for scene understanding tasks such as object localization and segmentation. Language-embedded scene representations have made progress by incorporating language features into…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Jin-Chuan Shi , Miao Wang , Hao-Bin Duan , Shao-Hua Guan

Precisely perceiving the geometric and semantic properties of real-world 3D objects is crucial for the continued evolution of augmented reality and robotic applications. To this end, we present Foundation Model Embedded Gaussian Splatting…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Xingxing Zuo , Pouya Samangouei , Yunwen Zhou , Yan Di , Mingyang Li

We achieve 3D semantic scene labeling by exploring semantic relation between each point and its contextual neighbors through edges. Besides an encoder-decoder branch for predicting point labels, we construct an edge branch to hierarchically…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Li Jiang , Hengshuang Zhao , Shu Liu , Xiaoyong Shen , Chi-Wing Fu , Jiaya Jia

Establishing dense correspondence across 3D shapes is crucial for fundamental downstream tasks, including texture transfer, shape interpolation, and robotic manipulation. However, learning these mappings without manual supervision remains a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Qinfeng Xiao , Guofeng Mei , Qilong Liu , Chenyuan Yi , Fabio Poiesi , Jian Zhang , Bo Yang , Yick Kit-lun

3D Gaussian Splatting (3DGS) has emerged as a real-time, differentiable representation for neural scene understanding. However, existing 3DGS-based methods struggle to represent hierarchical 3D semantic structures and capture whole-part…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Jingbin You , Zehao Li , Hao Jiang , Xinzhu Ma , Shuqin Gao , Honglong Zhao , Congcong Zheng , Tianlu Mao , Feng Dai , Yucheng Zhang , Zhaoqi Wang

NeRF-based 3D-aware Generative Adversarial Networks (GANs) like EG3D or GIRAFFE have shown very high rendering quality under large representational variety. However, rendering with Neural Radiance Fields poses challenges for 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Florian Barthel , Arian Beckmann , Wieland Morgenstern , Anna Hilsmann , Peter Eisert

Implicit neural representations and 3D Gaussian splatting (3DGS) have shown great potential for scene reconstruction. Recent studies have expanded their applications in autonomous reconstruction through task assignment methods. However,…

Robotics · Computer Science 2024-12-04 Jing Zeng , Qi Ye , Tianle Liu , Yang Xu , Jin Li , Jinming Xu , Liang Li , Jiming Chen

Fast, reliable shape reconstruction is an essential ingredient in many computer vision applications. Neural Radiance Fields demonstrated that photorealistic novel view synthesis is within reach, but was gated by performance requirements for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Leonid Keselman , Martial Hebert

As multimodal language models advance, their application to 3D scene understanding is a fast-growing frontier, driving the development of 3D Vision-Language Models (VLMs). Current methods show strong dependence on object detectors,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Anna-Maria Halacheva , Jan-Nico Zaech , Xi Wang , Danda Pani Paudel , Luc Van Gool

Lifting multi-view 2D instance segmentation to a radiance field has proven to be effective to enhance 3D understanding. Existing methods rely on direct matching for end-to-end lifting, yielding inferior results; or employ a two-stage…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Runsong Zhu , Shi Qiu , Zhengzhe Liu , Ka-Hei Hui , Qianyi Wu , Pheng-Ann Heng , Chi-Wing Fu

3D Gaussian Splatting (3DGS) has emerged as a powerful representation for neural scene reconstruction, offering high-quality novel view synthesis while maintaining computational efficiency. In this paper, we extend the capabilities of 3DGS…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Jens Piekenbrinck , Christian Schmidt , Alexander Hermans , Narunas Vaskevicius , Timm Linder , Bastian Leibe

Reconstructing dynamic 3D scenes from 2D images and generating diverse views over time is challenging due to scene complexity and temporal dynamics. Despite advancements in neural implicit models, limitations persist: (i) Inadequate Scene…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Zeyu Yang , Hongye Yang , Zijie Pan , Li Zhang

Open-vocabulary panoptic reconstruction is a challenging task for simultaneous scene reconstruction and understanding. Recently, methods have been proposed for 3D scene understanding based on Gaussian splatting. However, these methods are…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yuxuan Xie , Xuan Yu , Changjian Jiang , Sitong Mao , Shunbo Zhou , Rui Fan , Rong Xiong , Yue Wang

Measuring and alleviating the discrepancies between the synthetic (source) and real scene (target) data is the core issue for domain adaptive semantic segmentation. Though recent works have introduced depth information in the source domain…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Yinghong Liao , Wending Zhou , Xu Yan , Shuguang Cui , Yizhou Yu , Zhen Li

3D Gaussian Splatting (3DGS) has emerged as a transformative method in the field of real-time novel synthesis. Based on 3DGS, recent advancements cope with large-scale scenes via spatial-based partition strategy to reduce video memory and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Tengfei Wang , Xin Wang , Yongmao Hou , Yiwei Xu , Wendi Zhang , Zongqian Zhan

3D Gaussian Splatting (3DGS) has become an emerging tool for dynamic scene reconstruction. However, existing methods focus mainly on extending static 3DGS into a time-variant representation, while overlooking the rich motion information…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Zhiyang Guo , Wengang Zhou , Li Li , Min Wang , Houqiang Li

We present a novel approach for enhancing the resolution and geometric fidelity of 3D Gaussian Splatting (3DGS) beyond native training resolution. Current 3DGS methods are fundamentally limited by their input resolution, producing…

Graphics · Computer Science 2025-06-10 Shuja Khalid , Mohamed Ibrahim , Yang Liu

Semantic Communication (SC) is a novel paradigm for data transmission in 6G. However, there are several challenges posed when performing SC in 3D scenarios: 1) 3D semantic extraction; 2) Latent semantic redundancy; and 3) Uncertain channel…

Information Theory · Computer Science 2024-03-12 Feibo Jiang , Yubo Peng , Li Dong , Kezhi Wang , Kun Yang , Cunhua Pan , Xiaohu You

Representing 3D scenes from multiview images is a core challenge in computer vision and graphics, which requires both precise rendering and accurate reconstruction. Recently, 3D Gaussian Splatting (3DGS) has garnered significant attention…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 You Shen , Zhipeng Zhang , Xinyang Li , Yansong Qu , Yu Lin , Shengchuan Zhang , Liujuan Cao

3D Gaussian Splatting (3DGS) has emerged as a powerful technique for novel view synthesis, subsequently extending into numerous spatial AI applications. However, most existing 3DGS methods operate in isolation, focusing on specific domains.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yueen Ma , Zenglin Xu , Irwin King