English
Related papers

Related papers: MatSpray: Fusing 2D Material World Knowledge on 3D…

200 papers

Recently, 3D Gaussian Splatting (3DGS) has emerged as an efficient approach for accurately representing scenes. However, despite its superior novel view synthesis capabilities, extracting the geometry of the scene directly from the Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Yaniv Wolf , Amit Bracha , Ron Kimmel

Recently, the surge of efficient and automated 3D AI-generated content (AIGC) methods has increasingly illuminated the path of transforming human imagination into complex 3D structures. However, the automated generation of 3D content is…

Graphics · Computer Science 2024-12-20 Pei Chen , Fudong Wang , Yixuan Tong , Jingdong Chen , Ming Yang , Minghui Yang

This paper proposes a novel framework for large-scale scene reconstruction based on 3D Gaussian splatting (3DGS) and aims to address the scalability and accuracy challenges faced by existing methods. For tackling the scalability issue, we…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Hanyue Zhang , Zhiliu Yang , Xinhe Zuo , Yuxin Tong , Ying Long , Chen Liu

Surface reconstruction has been widely studied in computer vision and graphics. However, existing surface reconstruction works struggle to recover accurate scene geometry when the input views are extremely sparse. To address this issue, we…

Graphics · Computer Science 2025-11-26 Hanzhi Chang , Ruijie Zhu , Wenjie Chang , Mulin Yu , Yanzhe Liang , Jiahao Lu , Zhuoyuan Li , Tianzhu Zhang

This paper investigates an open research challenge of reconstructing high-quality, large 3D open scenes from images. It is observed existing methods have various limitations, such as requiring precise camera poses for input and dense…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Chong Cheng , Gaochao Song , Yiyang Yao , Qinzheng Zhou , Gangjian Zhang , Hao Wang

In addition to color and textural information, geometry provides important cues for 3D scene reconstruction. However, current reconstruction methods only include geometry at the feature level thus not fully exploiting the geometric…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Ruihong Yin , Sezer Karaoglu , Theo Gevers

3D Gaussians have recently emerged as an efficient representation for novel view synthesis. This work studies its editability with a particular focus on the inpainting task, which aims to supplement an incomplete set of 3D Gaussians with…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Zhiheng Liu , Hao Ouyang , Qiuyu Wang , Ka Leong Cheng , Jie Xiao , Kai Zhu , Nan Xue , Yu Liu , Yujun Shen , Yang Cao

Recent advances in radiance fields and novel view synthesis enable creation of realistic digital twins from photographs. However, current methods struggle with flat, texture-less surfaces, creating uneven and semi-transparent…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Maria Taktasheva , Lily Goli , Alessandro Fiorini , Zhen Li , Daniel Rebain , Andrea Tagliasacchi

Novel view synthesis (NVS) and surface reconstruction (SR) are essential tasks in 3D Gaussian Splatting (3D-GS). Despite recent progress, these tasks are often addressed independently, with GS-based rendering methods struggling under…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Qingyuan Zhou , Yuehu Gong , Weidong Yang , Jiaze Li , Yeqi Luo , Baixin Xu , Shuhao Li , Ben Fei , Ying He

Decomposing geometry, materials and lighting from a set of images, namely inverse rendering, has been a long-standing problem in computer vision and graphics. Recent advances in neural rendering enable photo-realistic and plausible inverse…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Silong Yong , Venkata Nagarjun Pudureddiyur Manivannan , Bernhard Kerbl , Zifu Wan , Simon Stepputtis , Katia Sycara , Yaqi Xie

Recent advancements in neural rendering, particularly 2D Gaussian Splatting (2DGS), have shown promising results for jointly reconstructing fine appearance and geometry by leveraging 2D Gaussian surfels. However, current methods face…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yunzhou Song , Heguang Lin , Jiahui Lei , Lingjie Liu , Kostas Daniilidis

Existing 2D methods utilize UNet-based diffusion models to generate multi-view physically-based rendering (PBR) maps but struggle with multi-view inconsistency, while some 3D methods directly generate UV maps, encountering generalization…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Shenhao Zhu , Lingteng Qiu , Xiaodong Gu , Zhengyi Zhao , Chao Xu , Yuxiao He , Zhe Li , Xiaoguang Han , Yao Yao , Xun Cao , Siyu Zhu , Weihao Yuan , Zilong Dong , Hao Zhu

3D scene reconstruction under unposed sparse viewpoints is a highly challenging yet practically important problem, especially in outdoor scenes due to complex lighting and scale variation. With extremely limited input views, directly…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Beizhen Zhao , Sicheng Yu , Guanzhi Ding , Yu Hu , Hao Wang

Automated 3D scene generation is pivotal for applications spanning virtual reality, digital content creation, and Embodied AI. While computer graphics prioritizes aesthetic layouts, vision and robotics demand scenes that mirror real-world…

Graphics · Computer Science 2026-03-31 Minzhang Li , Kuixiang Shao , Xuebing Li , Yuyang Jiao , Yinuo Bai , Hengan Zhou , Sixian Shen , Jiayuan Gu , Jingyi Yu

The boundary representation (B-Rep) models a 3D solid as its explicit boundaries: trimmed corners, edges, and faces. Recovering B-Rep representation from unstructured data is a challenging and valuable task of computer vision and graphics.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Jiaxing Yu , Dongyang Ren , Hangyu Xu , Zhouyuxiao Yang , Yuanqi Li , Jie Guo , Zhengkang Zhou , Yanwen Guo

Capturing and reconstructing high-speed dynamic 3D scenes has numerous applications in computer graphics, vision, and interdisciplinary fields such as robotics, aerodynamics, and evolutionary biology. However, achieving this using a single…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Zihao Zou , Ziyuan Qu , Xi Peng , Vivek Boominathan , Adithya Pediredla , Praneeth Chakravarthula

3D Gaussian Splatting (3DGS) has become an emerging tool for dynamic scene reconstruction. However, existing methods focus mainly on extending static 3DGS into a time-variant representation, while overlooking the rich motion information…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Zhiyang Guo , Wengang Zhou , Li Li , Min Wang , Houqiang Li

Recent advances in text-to-image diffusion models have been driven by the increasing availability of paired 2D data. However, the development of 3D diffusion models has been hindered by the scarcity of high-quality 3D data, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Tiange Xiang , Kai Li , Chengjiang Long , Christian Häne , Peihong Guo , Scott Delp , Ehsan Adeli , Li Fei-Fei

Accurate 3D reconstruction of dynamic surgical scenes from endoscopic video is essential for robotic-assisted surgery. While recent 3D Gaussian Splatting methods have shown promise in achieving high-quality reconstructions with fast…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Jialei Chen , Xin Zhang , Mobarakol Islam , Francisco Vasconcelos , Danail Stoyanov , Daniel S. Elson , Baoru Huang

This paper presents a multimodal framework that integrates touch signals (contact points and surface normals) into 3D Gaussian Splatting (3DGS). Our approach enhances scene reconstruction, particularly under challenging conditions like low…

Signal Processing · Electrical Eng. & Systems 2025-08-12 Yuchen Gao , Xiao Xu , Eckehard Steinbach , Daniel E. Lucani , Qi Zhang