English
Related papers

Related papers: From None to All: Self-Supervised 3D Reconstructio…

200 papers

Feed-forward 3D reconstruction has revolutionized 3D vision, providing a powerful baseline for downstream tasks such as novel-view synthesis with 3D Gaussian Splatting. Previous works explore fixing the corrupted rendering results with a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yiming Huang , Baixiang Huang , Beilei Cui , Chi Kit Ng , Long Bai , Hongliang Ren

We introduce SPFSplat, an efficient framework for 3D Gaussian splatting from sparse multi-view images, requiring no ground-truth poses during training or inference. It employs a shared feature extraction backbone, enabling simultaneous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Ranran Huang , Krystian Mikolajczyk

Self-supervised pre-training has driven rapid progress in foundation models for language, 2D images, and video, yet remains largely unexplored for learning 3D-aware representations from multi-view images. In this paper, we present E-RayZer,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Qitao Zhao , Hao Tan , Qianqian Wang , Sai Bi , Kai Zhang , Kalyan Sunkavalli , Shubham Tulsiani , Hanwen Jiang

We introduce NoPoSplat, a feed-forward model capable of reconstructing 3D scenes parameterized by 3D Gaussians from \textit{unposed} sparse multi-view images. Our model, trained exclusively with photometric loss, achieves real-time 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Botao Ye , Sifei Liu , Haofei Xu , Xueting Li , Marc Pollefeys , Ming-Hsuan Yang , Songyou Peng

Generalizable 3D Gaussian Splatting reconstruction showcases advanced Image-to-3D content creation but requires substantial computational resources and large datasets, posing challenges to training models from scratch. Current methods…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Xiufeng Huang , Ka Chun Cheung , Runmin Cong , Simon See , Renjie Wan

We propose R3GS, a robust reconstruction and relocalization framework tailored for unconstrained datasets. Our method uses a hybrid representation during training. Each anchor combines a global feature from a convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Xu yan , Zhaohui Wang , Rong Wei , Jingbo Yu , Dong Li , Xiangde Liu

We present Spann3R, a novel approach for dense 3D reconstruction from ordered or unordered image collections. Built on the DUSt3R paradigm, Spann3R uses a transformer-based architecture to directly regress pointmaps from images without any…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Hengyi Wang , Lourdes Agapito

Image-based 3D reconstruction is a challenging task that involves inferring the 3D shape of an object or scene from a set of input images. Learning-based methods have gained attention for their ability to directly estimate 3D shapes. This…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Anurag Dalal , Daniel Hagen , Kjell G. Robbersmyr , Kristian Muri Knausgård

Recent advances in 2D-to-3D perception have enabled the recovery of 3D scene semantics from unposed images. However, prevailing methods often suffer from limited generalization, reliance on per-scene optimization, and semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Jie Hu , Shizun Wang , Xinchao Wang

Is a geometric model required to synthesize novel views from a single image? Being bound to local convolutions, CNNs need explicit 3D biases to model geometric transformations. In contrast, we demonstrate that a transformer-based model can…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Robin Rombach , Patrick Esser , Björn Ommer

Multi-view 3D reconstruction remains a core challenge in computer vision, particularly in applications requiring accurate and scalable representations across diverse perspectives. Current leading methods such as DUSt3R employ a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Jianing Yang , Alexander Sax , Kevin J. Liang , Mikael Henaff , Hao Tang , Ang Cao , Joyce Chai , Franziska Meier , Matt Feiszli

Novel view synthesis from raw images provides superior high dynamic range (HDR) information compared to reconstructions from low dynamic range RGB images. However, the inherent noise in unprocessed raw images compromises the accuracy of 3D…

Image and Video Processing · Electrical Eng. & Systems 2024-06-13 Zhihao Li , Yufei Wang , Alex Kot , Bihan Wen

We introduce $\pi^3$, a feed-forward neural network that offers a novel approach to visual geometry reconstruction, breaking the reliance on a conventional fixed reference view. Previous methods often anchor their reconstructions to a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yifan Wang , Jianjun Zhou , Haoyi Zhu , Wenzheng Chang , Yang Zhou , Zizun Li , Junyi Chen , Jiangmiao Pang , Chunhua Shen , Tong He

We propose SelfSplat, a novel 3D Gaussian Splatting model designed to perform pose-free and 3D prior-free generalizable 3D reconstruction from unposed multi-view images. These settings are inherently ill-posed due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Gyeongjin Kang , Jisang Yoo , Jihyeon Park , Seungtae Nam , Hyeonsoo Im , Sangheon Shin , Sangpil Kim , Eunbyung Park

Recent advances in 3D Gaussian Splatting (3DGS) present two main directions: feed-forward models offer fast inference in sparse-view settings, while per-scene optimization yields high-quality renderings but is computationally expensive. To…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Yueh-Cheng Liu , Jozef Hladký , Matthias Nießner , Angela Dai

We introduce SPFSplatV2, an efficient feed-forward framework for 3D Gaussian splatting from sparse multi-view images, requiring no ground-truth poses during training and inference. It employs a shared feature extraction backbone, enabling…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Ranran Huang , Krystian Mikolajczyk

This paper targets on learning-based novel view synthesis from a single or limited 2D images without the pose supervision. In the viewer-centered coordinates, we construct an end-to-end trainable conditional variational framework to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Xiaofeng Liu , Tong Che , Yiqun Lu , Chao Yang , Site Li , Jane You

We present Free-Range Gaussians, a multi-view reconstruction method that predicts non-pixel, non-voxel-aligned 3D Gaussians from as few as four images. This is done through flow matching over Gaussian parameters. Our generative formulation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Ahan Shabanov , Peter Hedman , Ethan Weber , Zhengqin Li , Denis Rozumny , Gael Le Lan , Naina Dhingra , Lei Luo , Andrea Vedaldi , Christian Richardt , Andrea Tagliasacchi , Bo Zhu , Numair Khan

Reconstructing 3D scenes from sparse, unposed images remains challenging under real-world conditions with varying illumination and transient occlusions. Existing methods rely on scene-specific optimization using appearance embeddings or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Vinayak Gupta , Chih-Hao Lin , Shenlong Wang , Anand Bhattad , Jia-Bin Huang

Recent photorealistic Novel View Synthesis (NVS) advances have increasingly gained attention. However, these approaches remain constrained to small indoor scenes. While optimization-based NVS models have attempted to address this,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Aditya Rauniyar , Omar Alama , Silong Yong , Katia Sycara , Sebastian Scherer