English
Related papers

Related papers: DM-OSVP++: One-Shot View Planning Using 3D Diffusi…

200 papers

Reconstructing 3D clothed humans from images is fundamental to applications like virtual try-on, avatar creation, and mixed reality. While recent advances have enhanced human body recovery, accurate reconstruction of garment geometry --…

Graphics · Computer Science 2025-05-16 Ren Li , Cong Cao , Corentin Dumery , Yingxuan You , Hao Li , Pascal Fua

Route planning for navigation under partial observability plays a crucial role in modern robotics and autonomous driving. Existing route planning approaches can be categorized into two main classes: traditional autoregressive and…

Robotics · Computer Science 2024-04-04 Gengyu Zhang , Hao Tang , Yan Yan

We present GSD, a diffusion model approach based on Gaussian Splatting (GS) representation for 3D object reconstruction from a single view. Prior works suffer from inconsistent 3D geometry or mediocre rendering quality due to improper…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Yuxuan Mu , Xinxin Zuo , Chuan Guo , Yilin Wang , Juwei Lu , Xiaofeng Wu , Songcen Xu , Peng Dai , Youliang Yan , Li Cheng

We introduce "ImageDream," an innovative image-prompt, multi-view diffusion model for 3D object generation. ImageDream stands out for its ability to produce 3D models of higher quality compared to existing state-of-the-art,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Peng Wang , Yichun Shi

We propose SparseFusion, a sparse view 3D reconstruction approach that unifies recent advances in neural rendering and probabilistic image generation. Existing approaches typically build on neural rendering with re-projected features but…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Zhizhuo Zhou , Shubham Tulsiani

Novel view synthesis has observed tremendous developments since the arrival of NeRFs. However, Nerf models overfit on a single scene, lacking generalization to out of distribution objects. Recently, diffusion models have exhibited…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Rukhshanda Hussain , Hui Xian Grace Lim , Borchun Chen , Mubarak Shah , Ser Nam Lim

As the task of 2D-to-3D reconstruction has gained significant attention in various real-world scenarios, it becomes crucial to be able to generate high-quality point clouds. Despite the recent success of deep learning models in generating…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Yu Feng , Xing Shi , Mengli Cheng , Yun Xiong

Advancements in 3D scene reconstruction have transformed 2D images from the real world into 3D models, producing realistic 3D results from hundreds of input photos. Despite great success in dense-view reconstruction scenarios, rendering a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Fangfu Liu , Wenqiang Sun , Hanyang Wang , Yikai Wang , Haowen Sun , Junliang Ye , Jun Zhang , Yueqi Duan

3D scene reconstruction is essential for applications in virtual reality, robotics, and autonomous driving, enabling machines to understand and interact with complex environments. Traditional 3D Gaussian Splatting techniques rely on images…

Graphics · Computer Science 2025-03-04 Changlin Song , Jiaqi Wang , Liyun Zhu , He Weng

Applying diffusion models to physically-based material estimation and generation has recently gained prominence. In this paper, we propose \ttt, a novel material reconstruction framework for 3D objects, offering the following advantages.…

Graphics · Computer Science 2025-11-25 Xiuchao Wu , Pengfei Zhu , Jiangjing Lyu , Xinguo Liu , Jie Guo , Yanwen Guo , Weiwei Xu , Chengfei Lyu

Reconstructing 3D clothed humans from monocular images and videos is a fundamental problem with applications in virtual try-on, avatar creation, and mixed reality. Despite significant progress in human body recovery, accurately…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Yingxuan You , Ren Li , Corentin Dumery , Cong Cao , Hao Li , Pascal Fua

We propose a modular framework for single-view indoor scene 3D reconstruction, where several core modules are powered by diffusion techniques. Traditional approaches for this task often struggle with the complex instance shapes and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Yuxiao Li

Generating novel views of a natural scene, e.g., every-day scenes both indoors and outdoors, from a single view is an under-explored problem, even though it is an organic extension to the object-centric novel view synthesis. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Wonbong Jang , Jonathan Tremblay , Lourdes Agapito

Decompositional reconstruction of 3D scenes, with complete shapes and detailed texture of all objects within, is intriguing for downstream applications but remains challenging, particularly with sparse views as input. Recent approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Junfeng Ni , Yu Liu , Ruijie Lu , Zirui Zhou , Song-Chun Zhu , Yixin Chen , Siyuan Huang

With the proliferation of small aerial vehicles, acquiring close up aerial imagery for high quality reconstruction of complex scenes is gaining importance. We present an adaptive view planning method to collect such images in an automated…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Cheng Peng , Volkan Isler

We present a novel diffusion-based approach for coherent 3D scene reconstruction from a single RGB image. Our method utilizes an image-conditioned 3D scene diffusion model to simultaneously denoise the 3D poses and geometries of all objects…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Manuel Dahnert , Angela Dai , Norman Müller , Matthias Nießner

Recent advancements in leveraging pre-trained 2D diffusion models achieve the generation of high-quality novel views from a single in-the-wild image. However, existing works face challenges in producing controllable novel views due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Yunhan Yang , Shuo Chen , Yukun Huang , Xiaoyang Wu , Yuan-Chen Guo , Edmund Y. Lam , Hengshuang Zhao , Tong He , Xihui Liu

Next-Best View (NBV) planning is a long-standing problem of determining where to obtain the next best view of an object from, by a robot that is viewing the object. There are a number of methods for choosing NBV based on the observed part…

Robotics · Computer Science 2024-06-25 Harnaik Dhami , Vishnu D. Sharma , Pratap Tokekar

The ability to manipulate objects in a desired configurations is a fundamental requirement for robots to complete various practical applications. While certain goals can be achieved by picking and placing the objects of interest directly,…

Robotics · Computer Science 2023-09-18 Utkarsh A. Mishra , Yongxin Chen

Recent advancements in open-world 3D object generation have been remarkable, with image-to-3D methods offering superior fine-grained control over their text-to-3D counterparts. However, most existing models fall short in simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Minghua Liu , Ruoxi Shi , Linghao Chen , Zhuoyang Zhang , Chao Xu , Xinyue Wei , Hansheng Chen , Chong Zeng , Jiayuan Gu , Hao Su