English
Related papers

Related papers: On Geometric Understanding and Learned Priors in F…

200 papers

3D foundation models (3DFMs) have recently transformed 3D vision, enabling joint prediction of depths, poses, and point maps directly from images. Yet their ability to reason under extreme, non-overlapping views remains largely unexplored.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Yiwen Zhang , Joseph Tung , Ruojin Cai , David Fouhey , Hadar Averbuch-Elor

Recent learning approaches that implicitly represent surface geometry using coordinate-based neural representations have shown impressive results in the problem of multi-view 3D reconstruction. The effectiveness of these techniques is,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Eduard Ramon , Gil Triginer , Janna Escur , Albert Pumarola , Jaime Garcia , Xavier Giro-i-Nieto , Francesc Moreno-Noguer

Dense matching methods like DUSt3R regress pairwise pointmaps for 3D reconstruction. However, the reliance on pairwise prediction and the limited generalization capability inherently restrict the global geometric consistency. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Yuheng Yuan , Qiuhong Shen , Shizun Wang , Xingyi Yang , Xinchao Wang

Human perception of 3D shapes goes beyond reconstructing them as a set of points or a composition of geometric primitives: we also effortlessly understand higher-level shape structure such as the repetition and reflective symmetry of object…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Yonglong Tian , Andrew Luo , Xingyuan Sun , Kevin Ellis , William T. Freeman , Joshua B. Tenenbaum , Jiajun Wu

Three-dimensional geometric data offer an excellent domain for studying representation learning and generative modeling. In this paper, we look at geometric data represented as point clouds. We introduce a deep AutoEncoder (AE) network with…

Computer Vision and Pattern Recognition · Computer Science 2018-06-13 Panos Achlioptas , Olga Diamanti , Ioannis Mitliagkas , Leonidas Guibas

Current feed-forward 3D/4D reconstruction systems rely on dense geometry and pose supervision -- expensive to obtain at scale and particularly scarce for dynamic real-world scenes. We present Flow3r, a framework that augments visual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Zhongxiao Cong , Qitao Zhao , Minsik Jeon , Shubham Tulsiani

Shape assembly, which aims to reassemble separate parts into a complete object, has gained significant interest in recent years. Existing methods primarily rely on networks to predict the poses of individual parts, but often fail to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Jiahan Li , Chaoran Cheng , Jianzhu Ma , Ge Liu

LiDAR-based 3D detection has made great progress in recent years. However, the performance of 3D detectors is considerably limited when deployed in unseen environments, owing to the severe domain gap problem. Existing domain adaptive 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Ziyu Li , Jingming Guo , Tongtong Cao , Liu Bingbing , Wankou Yang

Recent advances in DUSt3R have enabled robust estimation of dense point clouds and camera parameters of static scenes, leveraging Transformer network architectures and direct supervision on large-scale 3D datasets. In contrast, the limited…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Xingyu Chen , Yue Chen , Yuliang Xiu , Andreas Geiger , Anpei Chen

Reconstructing 3D representations from 2D inputs is a fundamental task in computer vision and graphics, serving as a cornerstone for understanding and interacting with the physical world. While traditional methods achieve high fidelity,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Weijie Wang , Qihang Cao , Sensen Gao , Donny Y. Chen , Haofei Xu , Wenjing Bian , Songyou Peng , Tat-Jen Cham , Chuanxia Zheng , Andreas Geiger , Jianfei Cai , Jia-Wang Bian , Bohan Zhuang

Incorporating geometric transformations that reflect the relative position changes between an observer and an object into computer vision and deep learning models has attracted much attention in recent years. However, the existing proposals…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Nishan Khatri , Agnibh Dasgupta , Yucong Shen , Xin Zhong , Frank Y. Shih

Multi-view image diffusion models have significantly advanced open-domain 3D object generation. However, most existing models rely on 2D network architectures that lack inherent 3D biases, resulting in compromised geometric consistency. To…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Hansheng Chen , Bokui Shen , Yulin Liu , Ruoxi Shi , Linqi Zhou , Connor Z. Lin , Jiayuan Gu , Hao Su , Gordon Wetzstein , Leonidas Guibas

Deep learning models evolve through training to learn the manifold in which the data exists to satisfy an objective. It is well known that evolution leads to different final states which produce inconsistent predictions of the same test…

Dynamical Systems · Mathematics 2021-06-16 Mohammed Eslami , Hamed Eramian , Marcio Gameiro , William Kalies , Konstantin Mischaikow

Deep approaches to predict monocular depth and ego-motion have grown in recent years due to their ability to produce dense depth from monocular images. The main idea behind them is to optimize the photometric consistency over image…

Robotics · Computer Science 2019-01-08 Vignesh Prasad , Dipanjan Das , Brojeshwar Bhowmick

This paper addresses metric 3D reconstruction of indoor scenes by exploiting their inherent geometric regularities with compact representations. Using planar 3D primitives - a well-suited representation for man-made environments - we…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Changkun Liu , Bin Tan , Zeran Ke , Shangzhan Zhang , Jiachen Liu , Ming Qian , Nan Xue , Yujun Shen , Tristan Braud

Recent advancements in neural visual geometry, including transformer-based models such as VGGT and Pi3, have achieved impressive accuracy on 3D reconstruction tasks. However, their reliance on full attention makes them fundamentally limited…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Leo Kaixuan Cheng , Abdus Shaikh , Ruofan Liang , Zhijie Wu , Yushi Guan , Nandita Vijaykumar

Current popular backbones in computer vision, such as Vision Transformers (ViT) and ResNets are trained to perceive the world from 2D images. However, to more effectively understand 3D structural priors in 2D backbones, we propose Mask3D to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Ji Hou , Xiaoliang Dai , Zijian He , Angela Dai , Matthias Nießner

Perceiving and reconstructing 3D scene geometry from visual inputs is crucial for autonomous driving. However, there still lacks a driving-targeted dense geometry perception model that can adapt to different scenarios and camera…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Sicheng Zuo , Zixun Xie , Wenzhao Zheng , Shaoqing Xu , Fang Li , Shengyin Jiang , Long Chen , Zhi-Xin Yang , Jiwen Lu

Recent advances in 3D Gaussian Splatting (3DGS) present two main directions: feed-forward models offer fast inference in sparse-view settings, while per-scene optimization yields high-quality renderings but is computationally expensive. To…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Yueh-Cheng Liu , Jozef Hladký , Matthias Nießner , Angela Dai

While conventional Transformers generally operate on sequence data, they can be used in conjunction with structure models, typically SE(3)-invariant or equivariant graph neural networks (GNNs), for 3D applications such as protein structure…

Machine Learning · Computer Science 2025-08-04 Isaac Ellmen , Constantin Schneider , Matthew I. J. Raybould , Charlotte M. Deane