English
Related papers

Related papers: SpaRP: Fast 3D Object Reconstruction and Pose Esti…

200 papers

Synthesizing novel view images from a few views is a challenging but practical problem. Existing methods often struggle with producing high-quality results or necessitate per-object optimization in such few-view settings due to the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Paul Yoo , Jiaxian Guo , Yutaka Matsuo , Shixiang Shane Gu

3D object generation from a single image involves estimating the full 3D geometry and texture of unseen views from an unposed RGB image captured in the wild. Accurately reconstructing an object's complete 3D structure and texture has…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Hritam Basak , Hadi Tabatabaee , Shreekant Gayaka , Ming-Feng Li , Xin Yang , Cheng-Hao Kuo , Arnie Sen , Min Sun , Zhaozheng Yin

Recently, methods like Zero-1-2-3 have focused on single-view based 3D reconstruction and have achieved remarkable success. However, their predictions for unseen areas heavily rely on the inductive bias of large-scale pretrained diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Hao Chen , Jiafu Wu , Ying Jin , Jinlong Peng , Xiaofeng Mao , Mingmin Chi , Mufeng Yao , Bo Peng , Jian Li , Yun Cao

Inferring 3D structures from sparse, unposed observations is challenging due to its unconstrained nature. Recent methods propose to predict implicit representations directly from unposed inputs in a data-driven manner, achieving promising…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Songchun Zhang , Chunhui Zhao

We introduce a novel learning-based method to reconstruct the high-quality geometry and complex, spatially-varying BRDF of an arbitrary object from a sparse set of only six images captured by wide-baseline cameras under collocated point…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Sai Bi , Zexiang Xu , Kalyan Sunkavalli , David Kriegman , Ravi Ramamoorthi

Estimating camera poses is a fundamental task for 3D reconstruction and remains challenging given sparsely sampled views (<10). In contrast to existing approaches that pursue top-down prediction of global parametrizations of camera…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Jason Y. Zhang , Amy Lin , Moneish Kumar , Tzu-Hsuan Yang , Deva Ramanan , Shubham Tulsiani

Existing approaches for multi-view multi-person 3D pose estimation explicitly establish cross-view correspondences to group 2D pose detections from multiple camera views and solve for the 3D pose estimation for each person. Establishing…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Jiahao Lin , Gim Hee Lee

This paper studies the complex task of simultaneous multi-object 3D reconstruction, 6D pose and size estimation from a single-view RGB-D observation. In contrast to instance-level pose estimation, we focus on a more challenging problem…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Muhammad Zubair Irshad , Thomas Kollar , Michael Laskey , Kevin Stone , Zsolt Kira

Gaussian Splatting (GS) has gained attention as a fast and effective method for novel view synthesis. It has also been applied to 3D reconstruction using multi-view images and can achieve fast and accurate 3D reconstruction. However, GS…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Natsuki Takama , Shintaro Ito , Koichi Ito , Hwann-Tzong Chen , Takafumi Aoki

Estimating metric relative camera pose from a pair of images is of great importance for 3D reconstruction and localisation. However, conventional two-view pose estimation methods are not metric, with camera translation known only up to a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Yumin Li , Dylan Campbell

We address the task of estimating 6D camera poses from sparse-view image sets (2-8 images). This task is a vital pre-processing stage for nearly all contemporary (neural) reconstruction algorithms but remains challenging given sparse views,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Amy Lin , Jason Y. Zhang , Deva Ramanan , Shubham Tulsiani

Novel view synthesis via Neural Radiance Fields (NeRFs) or 3D Gaussian Splatting (3DGS) typically necessitates dense observations with hundreds of input images to circumvent artifacts. We introduce Deceptive-NeRF/3DGS to enhance sparse-view…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Xinhang Liu , Jiaben Chen , Shiu-hong Kao , Yu-Wing Tai , Chi-Keung Tang

Recovering multi-person 3D poses with absolute scales from a single RGB image is a challenging problem due to the inherent depth and scale ambiguity from a single view. Addressing this ambiguity requires to aggregate various cues over the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 Jianan Zhen , Qi Fang , Jiaming Sun , Wentao Liu , Wei Jiang , Hujun Bao , Xiaowei Zhou

In this paper, a novel Diffusion-based 3D Pose estimation (D3DP) method with Joint-wise reProjection-based Multi-hypothesis Aggregation (JPMA) is proposed for probabilistic 3D human pose estimation. On the one hand, D3DP generates multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Wenkang Shan , Zhenhua Liu , Xinfeng Zhang , Zhao Wang , Kai Han , Shanshe Wang , Siwei Ma , Wen Gao

Recently, data-driven single-view reconstruction methods have shown great progress in modeling 3D dressed humans. However, such methods suffer heavily from depth ambiguities and occlusions inherent to single view inputs. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Pierre Zins , Yuanlu Xu , Edmond Boyer , Stefanie Wuhrer , Tony Tung

Depth ambiguity and joint uncertainty are the two main obstacles in obtaining accurate human pose predictions by 2D-to-3D lifting methods proposed in the literature. In particular, these issues are caused by 2D joint locations that can be…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Alessandro Simoni , Riccardo Catalini , Davide Di Nucci , Guido Borghi , Davide Davoli , Lorenzo Garattoni , Gianpiero Francesca , Yuki Kawana , Roberto Vezzani

Text-to-3D with diffusion models has achieved remarkable progress in recent years. However, existing methods either rely on score distillation-based optimization which suffer from slow inference, low diversity and Janus problems, or are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Jiahao Li , Hao Tan , Kai Zhang , Zexiang Xu , Fujun Luan , Yinghao Xu , Yicong Hong , Kalyan Sunkavalli , Greg Shakhnarovich , Sai Bi

Radiance fields including NeRFs and 3D Gaussians demonstrate great potential in high-fidelity rendering and scene reconstruction, while they require a substantial number of posed images as inputs. COLMAP is frequently employed for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Zhirui Gao , Renjiao Yi , Chenyang Zhu , Ke Zhuang , Wei Chen , Kai Xu

Monocular object pose estimation, as a pivotal task in computer vision and robotics, heavily depends on accurate 2D-3D correspondences, which often demand costly CAD models that may not be readily available. Object 3D reconstruction methods…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Luqing Luo , Shichu Sun , Jiangang Yang , Linfang Zheng , Jinwei Du , Jian Liu

We present SPAD, a novel approach for creating consistent multi-view images from text prompts or single images. To enable multi-view generation, we repurpose a pretrained 2D diffusion model by extending its self-attention layers with…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Yash Kant , Ziyi Wu , Michael Vasilkovsky , Guocheng Qian , Jian Ren , Riza Alp Guler , Bernard Ghanem , Sergey Tulyakov , Igor Gilitschenski , Aliaksandr Siarohin