English
Related papers

Related papers: Mind the Gap: Geometrically Accurate Generative Re…

200 papers

This paper tackles the problem of generalizable 3D-aware generation from monocular datasets, e.g., ImageNet. The key challenge of this task is learning a robust 3D-aware representation without multi-view or dynamic data, while ensuring…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Yuxin Wang , Qianyi Wu , Dan Xu

Generative models aim to learn the distribution of observed data by generating new instances. With the advent of neural networks, deep generative models, including variational autoencoders (VAEs), generative adversarial networks (GANs), and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Zifan Shi , Sida Peng , Yinghao Xu , Andreas Geiger , Yiyi Liao , Yujun Shen

We tackle the challenge of generating dynamic 4D scenes from monocular, multi-object videos with heavy occlusions, and introduce GenMOJO, a novel approach that integrates rendering-based deformable 3D Gaussian optimization with generative…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Wen-Hsuan Chu , Lei Ke , Jianmeng Liu , Mingxiao Huo , Pavel Tokmakov , Katerina Fragkiadaki

Gaussian Splatting (GS) has gained attention as a fast and effective method for novel view synthesis. It has also been applied to 3D reconstruction using multi-view images and can achieve fast and accurate 3D reconstruction. However, GS…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Natsuki Takama , Shintaro Ito , Koichi Ito , Hwann-Tzong Chen , Takafumi Aoki

The demand for semantically rich 3D models of indoor scenes is rapidly growing, driven by applications in augmented reality, virtual reality, and robotics. However, creating them from sparse views remains a challenge due to geometric…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Yijie Gao , Houqiang Zhong , Tianchi Zhu , Zhengxue Cheng , Qiang Hu , Li Song

3D human mesh recovery from monocular RGB images aims to estimate anatomically plausible 3D human models for downstream applications, but remains challenging under partial or severe occlusions. Regression-based methods are efficient yet…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Yang Liu , Zhiyong Zhang

Reconstructing 3D scenes from multiple viewpoints is a fundamental task in stereo vision. Recently, advances in generalizable 3D Gaussian Splatting have enabled high-quality novel view synthesis for unseen scenes from sparse input views by…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Shengji Tang , Weicai Ye , Peng Ye , Weihao Lin , Yang Zhou , Tao Chen , Wanli Ouyang

Open-vocabulary panoptic reconstruction is essential for advanced robotics perception and simulation. However, existing methods based on 3D Gaussian Splatting (3DGS) often struggle to simultaneously achieve geometric accuracy, coherent…

Robotics · Computer Science 2026-04-14 Xuan Yu , Yuxuan Xie , Changjian Jiang , Shichao Zhai , Rong Xiong , Yu Zhang , Yue Wang

While 3D Gaussian Splatting (3DGS) has revolutionized real-time photorealistic view synthesis, its fundamental reliance on symmetric Gaussian distributions introduces visual artifacts that hinder accurate spatial data exploration.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Beizhen Zhao , Yifan Zhou , Gaochao Song , Ziran Yin , Hao Wang

3D reconstruction and view synthesis are foundational problems in computer vision, graphics, and immersive technologies such as augmented reality (AR), virtual reality (VR), and digital twins. Traditional methods rely on computationally…

This paper proposes a novel framework for large-scale scene reconstruction based on 3D Gaussian splatting (3DGS) and aims to address the scalability and accuracy challenges faced by existing methods. For tackling the scalability issue, we…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Hanyue Zhang , Zhiliu Yang , Xinhe Zuo , Yuxin Tong , Ying Long , Chen Liu

In the realm of 3D reconstruction from 2D images, a persisting challenge is to achieve high-precision reconstructions devoid of 3D Ground Truth data reliance. We present UNeR3D, a pioneering unsupervised methodology that sets a new standard…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Hongbin Lin , Juangui Xu , Qingfeng Xu , Zhengyu Hu , Handing Xu , Yunzhi Chen , Yongjun Hu , Zhenguo Nie

We study the problem of single-image 3D object reconstruction. Recent works have diverged into two directions: regression-based modeling and generative modeling. Regression methods efficiently infer visible surfaces, but struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Zixuan Huang , Mark Boss , Aaryaman Vasishta , James M. Rehg , Varun Jampani

Feed-forward 3D reconstruction offers substantial runtime advantages over per-scene optimization, which remains slow at inference and often fragile under sparse views. However, existing feed-forward methods still have potential for further…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Tianyu Chen , Wei Xiang , Kang Han , Yu Lu , Di Wu , Gaowen Liu , Ramana Rao Kompella

Video-based 3D human pose and shape estimations are evaluated by intra-frame accuracy and inter-frame smoothness. Although these two metrics are responsible for different ranges of temporal consistency, existing state-of-the-art methods…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Xiaolong Shen , Zongxin Yang , Xiaohan Wang , Jianxin Ma , Chang Zhou , Yi Yang

Recently, 3D Gaussian Splatting (3DGS) has demonstrated excellent ability in small-scale 3D surface reconstruction. However, extending 3DGS to large-scale scenes remains a significant challenge. To address this gap, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 YuanZheng Wu , Jin Liu , Shunping Ji

While 3D Gaussian Splatting (3DGS) enables high-quality, real-time rendering for bounded scenes, its extension to large-scale urban environments gives rise to critical challenges in terms of geometric consistency, memory efficiency, and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Changbai Li , Haodong Zhu , Hanlin Chen , Xiuping Liang , Tongfei Chen , Shuwei Shao , Linlin Yang , Huobin Tan , Baochang Zhang

3D Gaussian Splatting (3DGS) has recently enabled real-time rendering of unbounded 3D scenes for novel view synthesis. However, this technique requires dense training views to accurately reconstruct 3D geometry. A limited number of input…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Haolin Xiong , Sairisheek Muttukuru , Rishi Upadhyay , Pradyumna Chari , Achuta Kadambi

Open-vocabulary 3D object detection aims to localize and recognize objects beyond a fixed training taxonomy. In multi-view RGB settings, recent approaches often decouple geometry-based instance construction from semantic labeling,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Youbin Kim , Jinho Park , Hogun Park , Eunbyung Park

Implicit neural representations and 3D Gaussian splatting (3DGS) have shown great potential for scene reconstruction. Recent studies have expanded their applications in autonomous reconstruction through task assignment methods. However,…

Robotics · Computer Science 2024-12-04 Jing Zeng , Qi Ye , Tianle Liu , Yang Xu , Jin Li , Jinming Xu , Liang Li , Jiming Chen