English
Related papers

Related papers: Exploiting Priors from 3D Diffusion Models for RGB…

200 papers

Reconstructing desired objects and scenes has long been a primary goal in 3D computer vision. Single-view point cloud reconstruction has become a popular technique due to its low cost and accurate results. However, single-view…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Wenrui Li , Zhe Yang , Wei Han , Hengyu Man , Xingtao Wang , Xiaopeng Fan

Prediction-based active perception has shown the potential to improve the navigation efficiency and safety of the robot by anticipating the uncertainty in the unknown environment. The existing works for 3D shape prediction make an implicit…

Robotics · Computer Science 2023-08-09 Harnaik Dhami , Vishnu D. Sharma , Pratap Tokekar

Diffusion Probabilistic Models (DPMs) have recently shown remarkable performance in image generation tasks, which are capable of generating highly realistic images. When adopting DPMs for image restoration tasks, the crucial aspect lies in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Yi Zhang , Xiaoyu Shi , Dasong Li , Xiaogang Wang , Jian Wang , Hongsheng Li

Estimating the 6D pose and 3D size of an object from an image is a fundamental task in computer vision. Most current approaches are restricted to specific instances with known models or require ground truth depth information or point cloud…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Adam Bethell , Ravi Garg , Ian Reid

3D part assembly aims to understand part relationships and predict their 6-DoF poses to construct realistic 3D shapes, addressing the growing demand for autonomous assembly, which is crucial for robots. Existing methods mainly estimate the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Ruiyuan Zhang , Qi Wang , Jiaxiang Liu , Yu Zhang , Yuchi Huo , Chao Wu

Ptychography is a data-intensive computational imaging technique that achieves high spatial resolution over large fields of view. The technique involves scanning a coherent beam across overlapping regions and recording diffraction patterns.…

Image and Video Processing · Electrical Eng. & Systems 2025-05-14 Refik Mert Cam , Junjing Deng , Rajkumar Kettimuthu , Mathew J. Cherukara , Tekin Bicer

Generating 3D scenes is a challenging open problem, which requires synthesizing plausible content that is fully consistent in 3D space. While recent methods such as neural radiance fields excel at view synthesis and 3D reconstruction, they…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Titas Anciukevičius , Fabian Manhardt , Federico Tombari , Paul Henderson

Recent diffusion-based Single-image 3D portrait generation methods typically employ 2D diffusion models to provide multi-view knowledge, which is then distilled into 3D representations. However, these methods usually struggle to produce…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Haoran Wei , Wencheng Han , Xingping Dong , Jianbing Shen

We introduce GeoGS3D, a novel two-stage framework for reconstructing detailed 3D objects from single-view images. Inspired by the success of pre-trained 2D diffusion models, our method incorporates an orthogonal plane decomposition…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Qijun Feng , Zhen Xing , Zuxuan Wu , Yu-Gang Jiang

Neural Radiance Fields (NeRFs) are gaining significant interest for online active object reconstruction due to their exceptional memory efficiency and requirement for only posed RGB inputs. Previous NeRF-based view planning methods exhibit…

Robotics · Computer Science 2024-02-14 Sicong Pan , Liren Jin , Hao Hu , Marija Popović , Maren Bennewitz

Sparse-view 3D modeling represents a fundamental tension between reconstruction fidelity and generative plausibility. While feed-forward reconstruction excels in efficiency and input alignment, it often lacks the global priors needed for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Zhisheng Huang , Jiahao Chen , Cheng Lin , Chenyu Hu , Hanzhuo Huang , Zhengming Yu , Mengfei Li , Yuheng Liu , Zekai Gu , Zibo Zhao , Yuan Liu , Xin Li , Wenping Wang

Utilizing pre-trained 2D large-scale generative models, recent works are capable of generating high-quality novel views from a single in-the-wild image. However, due to the lack of information from multiple views, these works encounter…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Yunhan Yang , Yukun Huang , Xiaoyang Wu , Yuan-Chen Guo , Song-Hai Zhang , Hengshuang Zhao , Tong He , Xihui Liu

Event cameras, mimicking the human retina, capture brightness changes with unparalleled temporal resolution and dynamic range. Integrating events into intensities poses a highly ill-posed challenge, marred by initial condition ambiguities.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Jinxiu Liang , Bohan Yu , Yixin Yang , Yiming Han , Boxin Shi

Diffusion models (DMs) have demonstrated remarkable ability to generate diverse and high-quality images by efficiently modeling complex data distributions. They have also been explored as powerful generative priors for signal recovery,…

Machine Learning · Computer Science 2025-05-28 Anqi Tang , Youming Chen , Shuchen Xue , Zhaoqiang Liu

The computer vision community has developed numerous techniques for digitally restoring true scene information from single-view degraded photographs, an important yet extremely ill-posed task. In this work, we tackle image restoration from…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yucheng Mao , Boyang Wang , Nilesh Kulkarni , Jeong Joon Park

Recent advances in large models have significantly advanced image-to-3D reconstruction. However, the generated models are often fused into a single piece, limiting their applicability in downstream tasks. This paper focuses on 3D garment…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Xuan Li , Chang Yu , Wenxin Du , Ying Jiang , Tianyi Xie , Yunuo Chen , Yin Yang , Chenfanfu Jiang

A single-pass driving clip frequently results in incomplete scanning of the road structure, making reconstructed scene expanding a critical requirement for sensor simulators to effectively regress driving actions. Although contemporary 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Sicong Du , Jiarun Liu , Qifeng Chen , Hao-Xiang Chen , Tai-Jiang Mu , Sheng Yang

Completely capturing the three-dimensional (3D) data of an object is essential in industrial and robotic applications. The task of next-best-view (NBV) planning is to calculate the next optimal viewpoint based on the current data, gradually…

Robotics · Computer Science 2025-11-18 Zhizhou Jia , Yuetao Li , Qun Hao , Shaohui Zhang

We present 3DiffTection, a state-of-the-art method for 3D object detection from single images, leveraging features from a 3D-aware diffusion model. Annotating large-scale image data for 3D detection is resource-intensive and time-consuming.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Chenfeng Xu , Huan Ling , Sanja Fidler , Or Litany

Object rearrangement, a fundamental challenge in robotics, demands versatile strategies to handle diverse objects, configurations, and functional needs. To achieve this, the AI robot needs to learn functional rearrangement priors in order…

Robotics · Computer Science 2024-03-11 Yiming Zeng , Mingdong Wu , Long Yang , Jiyao Zhang , Hao Ding , Hui Cheng , Hao Dong