English
Related papers

Related papers: RnG: A Unified Transformer for Complete 3D Modelin…

200 papers

Current non-rigid structure from motion (NRSfM) algorithms are mainly limited with respect to: (i) the number of images, and (ii) the type of shape variability they can handle. This has hampered the practical utility of NRSfM for many…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Chen Kong , Simon Lucey

Nowadays, transformer networks have demonstrated superior performance in many computer vision tasks. In a multi-view 3D reconstruction algorithm following this paradigm, self-attention processing has to deal with intricate image tokens…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Liying Yang , Zhenwei Zhu , Xuxin Lin , Jian Nong , Yanyan Liang

In this paper we present a novel unsupervised representation learning approach for 3D shapes, which is an important research challenge as it avoids the manual effort required for collecting supervised data. Our method trains an RNN-based…

Computer Vision and Pattern Recognition · Computer Science 2018-11-08 Zhizhong Han , Mingyang Shang , Yu-Shen Liu , Matthias Zwicker

Recent large reconstruction models have made notable progress in generating high-quality 3D objects from single images. However, current reconstruction methods often rely on explicit camera pose estimation or fixed viewpoints, restricting…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Hao He , Yixun Liang , Luozhou Wang , Yuanhao Cai , Xinli Xu , Hao-Xiang Guo , Xiang Wen , Yingcong Chen

Non-Rigid Structure from Motion (NRSfM) refers to the problem of reconstructing cameras and the 3D point cloud of a non-rigid object from an ensemble of images with 2D correspondences. Current NRSfM algorithms are limited from two…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Chen Kong , Simon Lucey

While object reconstruction has made great strides in recent years, current methods typically require densely captured images and/or known camera poses, and generalize poorly to novel object categories. To step toward object reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Hanwen Jiang , Zhenyu Jiang , Kristen Grauman , Yuke Zhu

We present a framework, called MVG-NeRF, that combines classical Multi-View Geometry algorithms and Neural Radiance Fields (NeRF) for image-based 3D reconstruction. NeRF has revolutionized the field of implicit 3D representations, mainly…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Marco Orsingher , Paolo Zani , Paolo Medici , Massimo Bertozzi

Towards the aim of generalized robotic manipulation, spatial generalization is the most fundamental capability that requires the policy to work robustly under different spatial distribution of objects, environment and agent itself. To…

Robotics · Computer Science 2026-04-30 Xiuwei Xu , Angyuan Ma , Hankun Li , Bingyao Yu , Zheng Zhu , Jie Zhou , Jiwen Lu

This work presents a flexible system to reconstruct 3D models of objects captured with an RGB-D sensor. A major advantage of the method is that our reconstruction pipeline allows the user to acquire a full 3D model of the object. This is…

Computer Vision and Pattern Recognition · Computer Science 2015-05-22 Aitor Aldoma , Johann Prankl , Alexander Svejda , Markus Vincze

Reconstructing and understanding 3D scenes from unposed sparse views in a feed-forward manner remains as a challenging task in 3D computer vision. Recent approaches use per-pixel 3D Gaussian Splatting for reconstruction, followed by a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Honggyu An , Jaewoo Jung , Mungyeom Kim , Chaehyun Kim , Minkyeong Jeon , Jisang Han , Kazumi Fukuda , Takuya Narihira , Hyuna Ko , Junsu Kim , Sunghwan Hong , Yuki Mitsufuji , Seungryong Kim

Generating 3D models from multi-view 2D RGB images has gained significant attention, extending the capabilities of technologies like Virtual Reality, Robotic Vision, and human-machine interaction. In this paper, we introduce a hybrid…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Ajith Balakrishnan , Sreeja S , Linu Shine

The rapid progress of large multimodal models has inspired efforts toward unified frameworks that couple understanding and generation. While such paradigms have shown remarkable success in 2D, extending them to 3D remains largely…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Yongwei Chen , Tianyi Wei , Yushi Lan , Zhaoyang Lyu , Shangchen Zhou , Xudong Xu , Xingang Pan

Large Reconstruction Models (LRMs) have recently become a popular method for creating 3D foundational models. Training 3D reconstruction models with 2D visual data traditionally requires prior knowledge of camera poses for the training…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Shiu-hong Kao , Xiao Li , Jinglu Wang , Yang Li , Chi-Keung Tang , Yu-Wing Tai , Yan Lu

Fast and robust three-dimensional reconstruction of facial geometric structure from a single image is a challenging task with numerous applications. Here, we introduce a learning-based approach for reconstructing a three-dimensional face…

Computer Vision and Pattern Recognition · Computer Science 2016-09-27 Elad Richardson , Matan Sela , Ron Kimmel

Recently single-view 3D generation via Gaussian splatting has emerged and developed quickly. They learn 3D Gaussians from 2D RGB images generated from pre-trained multi-view diffusion (MVD) models, and have shown a promising avenue for 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Yiyang Shen , Kun Zhou , He Wang , Yin Yang , Tianjia Shao

We propose NormalGAN, a fast adversarial learning-based method to reconstruct the complete and detailed 3D human from a single RGB-D image. Given a single front-view RGB-D image, NormalGAN performs two steps: front-view RGB-D rectification…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Lizhen Wang , Xiaochen Zhao , Tao Yu , Songtao Wang , Yebin Liu

This paper explores convolutional generative networks as an alternative to iterative reconstruction algorithms in medical image reconstruction. The task of medical image reconstruction involves mapping of projection main data collected from…

Medical Physics · Physics 2020-12-04 V. S. S. Kandarpa , Alexandre Bousse , Didier Benoit , Dimitris Visvikis

The Transformer architecture has gained growing attention in graph representation learning recently, as it naturally overcomes several limitations of graph neural networks (GNNs) by avoiding their strict structural inductive biases and…

Machine Learning · Statistics 2022-06-14 Dexiong Chen , Leslie O'Bray , Karsten Borgwardt

We present a method to map 2D image observations of a scene to a persistent 3D scene representation, enabling novel view synthesis and disentangled representation of the movable and immovable components of the scene. Motivated by the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Prafull Sharma , Ayush Tewari , Yilun Du , Sergey Zakharov , Rares Ambrus , Adrien Gaidon , William T. Freeman , Fredo Durand , Joshua B. Tenenbaum , Vincent Sitzmann

Implicit neural networks have emerged as a crucial technology in 3D surface reconstruction. To reconstruct continuous surfaces from discrete point clouds, encoding the input points into regular grid features (plane or volume) has been…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Shengtao Li , Ge Gao , Yudong Liu , Yu-Shen Liu , Ming Gu