English
Related papers

Related papers: MapAnything: Universal Feed-Forward Metric 3D Reco…

200 papers

Despite the success of deep learning in close-set 3D object detection, existing approaches struggle with zero-shot generalization to novel objects and camera configurations. We introduce DetAny3D, a promptable 3D detection foundation model…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Hanxue Zhang , Haoran Jiang , Qingsong Yao , Yanan Sun , Renrui Zhang , Hao Zhao , Hongyang Li , Hongzi Zhu , Zetong Yang

Feed-forward 3D reconstruction has revolutionized 3D vision, providing a powerful baseline for downstream tasks such as novel-view synthesis with 3D Gaussian Splatting. Previous works explore fixing the corrupted rendering results with a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yiming Huang , Baixiang Huang , Beilei Cui , Chi Kit Ng , Long Bai , Hongliang Ren

Feed-forward paradigms for 3D reconstruction have become a focus of recent research, which learn implicit, fixed view transformations to generate a single scene representation. However, their application to complex driving scenes reveals…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Haochen Yu , Qiankun Liu , Hongyuan Liu , Jianfei Jiang , Juntao Lyu , Jiansheng Chen , Huimin Ma

We propose the Canonical 3D Deformer Map, a new representation of the 3D shape of common object categories that can be learned from a collection of 2D images of independent objects. Our method builds in a novel way on concepts from…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 David Novotny , Roman Shapovalov , Andrea Vedaldi

In addition to color and textural information, geometry provides important cues for 3D scene reconstruction. However, current reconstruction methods only include geometry at the feature level thus not fully exploiting the geometric…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Ruihong Yin , Sezer Karaoglu , Theo Gevers

Accurate monocular metric depth estimation (MMDE) is crucial to solving downstream tasks in 3D perception and modeling. However, the remarkable accuracy of recent MMDE methods is confined to their training domains. These methods fail to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Luigi Piccinelli , Yung-Hsu Yang , Christos Sakaridis , Mattia Segu , Siyuan Li , Luc Van Gool , Fisher Yu

Feed-forward transformer models have driven rapid progress in 3D vision, but state-of-the-art methods such as VGGT and $\pi^3$ have a computational cost that scales quadratically with the number of input images, making them inefficient when…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Haian Jin , Rundi Wu , Tianyuan Zhang , Ruiqi Gao , Jonathan T. Barron , Noah Snavely , Aleksander Holynski

Accurate reconstruction and tracking of dynamic human faces from image sequences is challenging because non-rigid deformations, expression changes, and viewpoint variations occur simultaneously, creating significant ambiguity in geometry…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Umut Kocasari , Simon Giebenhain , Richard Shaw , Matthias Nießner

Open-vocabulary panoptic reconstruction is essential for advanced robotics perception and simulation. However, existing methods based on 3D Gaussian Splatting (3DGS) often struggle to simultaneously achieve geometric accuracy, coherent…

Robotics · Computer Science 2026-04-14 Xuan Yu , Yuxuan Xie , Changjian Jiang , Shichao Zhai , Rong Xiong , Yu Zhang , Yue Wang

Feedforward 3D Gaussian Splatting (3DGS) overcomes the limitations of optimization-based 3DGS by enabling fast and high-quality reconstruction without the need for per-scene optimization. However, existing feedforward approaches typically…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Anran Wu , Long Peng , Xin Di , Xueyuan Dai , Chen Wu , Yang Wang , Xueyang Fu , Yang Cao , Zheng-Jun Zha

We present UniScale, a unified, scale-aware multi-view 3D reconstruction framework for robotic applications that flexibly integrates geometric priors through a modular, semantically informed design. In vision-based robotic navigation, the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Mohammad Mahdavian , Gordon Tan , Binbin Xu , Yuan Ren , Dongfeng Bai , Bingbing Liu

Panoramic image enables deeper understanding and more holistic perception of $360^\circ$ surrounding environment, which can naturally encode enriched scene context information compared to standard perspective image. Previous work has made…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Yuan Dong , Chuan Fang , Liefeng Bo , Zilong Dong , Ping Tan

Structure-from-Motion -- the process of simultaneously estimating camera poses and 3D scene structure from a collection of images -- remains a central challenge in computer vision, with many open problems yet to be solved. Recent advances…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Linfei Pan , Johannes Schönberger , Marc Pollefeys

Recent advances in text-to-3D scene generation have demonstrated significant potential to transform content creation across multiple industries. Although the research community has made impressive progress in addressing the challenges of…

We present Layout Anything, a transformer-based framework for indoor layout estimation that adapts the OneFormer's universal segmentation architecture to geometric structure prediction. Our approach integrates OneFormer's task-conditioned…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Md Sohag Mia , Muhammad Abdullah Adnan

We present Wid3R, a feed-forward neural network for multi-view visual geometry reconstruction that supports wide field-of-view camera models. Unlike existing methods that assume rectified or pinhole inputs, Wid3R directly models wide-angle…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Dongki Jung , Jaehoon Choi , Adil Qureshi , Somi Jeong , Dinesh Manocha , Suyong Yeon

Deep learning affords enormous opportunities to augment the armamentarium of biomedical imaging, albeit its design and implementation have potential flaws. Fundamentally, most deep learning models are driven entirely by data without…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Liyue Shen , Wei Zhao , Dante Capaldi , John Pauly , Lei Xing

The recent years have seen a surge of interest in methods for imaging beyond the direct line of sight. The most prominent techniques rely on time-resolved optical impulse responses, obtained by illuminating a diffuse wall with an ultrashort…

Computer Vision and Pattern Recognition · Computer Science 2020-01-30 Javier Grau Chopite , Matthias B. Hullin , Michael Wand , Julian Iseringhausen

We present Matrix3D, a unified model that performs several photogrammetry subtasks, including pose estimation, depth prediction, and novel view synthesis using just the same model. Matrix3D utilizes a multi-modal diffusion transformer (DiT)…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Yuanxun Lu , Jingyang Zhang , Tian Fang , Jean-Daniel Nahmias , Yanghai Tsin , Long Quan , Xun Cao , Yao Yao , Shiwei Li

We tackle the problem of automatically reconstructing a complete 3D model of a scene from a single RGB image. This challenging task requires inferring the shape of both visible and occluded surfaces. Our approach utilizes viewer-centered,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Daeyun Shin , Zhile Ren , Erik B. Sudderth , Charless C. Fowlkes